The slow load speed of your dashboard might not entirely be stemming from ACF and the HTTP requests. Do you think you could deactivate your theme and switch to one of the stock WP themes to test the result?
The issue might also be limited to your local environment maybe you could try it out on a staging server.
Welcome to the Advanced Custom Fields community forum.
Browse through ideas, snippets of code, questions and answers between fellow ACF users