Apache Web server JS file transfer way too slow

I'm using Apache Web server for an Angular Web Application. Its deployed in a CentOS 7 server. Server load is always very less, as you can see below.

CentOS server Load

However, when loading the Angular web app for the first time, the files are taking too long to get transferred to the browser. Is there any setting in httpd.conf file (Or any other configuration) we can tweak to reduce the response time? I'm not so familiar with all the parameters, and except max-connections, I have not changed anything.

The JS File Transfer from Apache - 2 MB file takes ~50 Seconds

Please advice.