Just to confirm, this is JS lag, not PHP load time?
Have you checked your console log for any errors reported?
The latest version of ACF feature some minimal and efficient JS, so perhaps there is something else going on here. Does the issue completely go away when ACF is deactivated?
Can you deactivate all other plugins and leave ACF, does this help the issue?
Welcome to the Advanced Custom Fields community forum.
Browse through ideas, snippets of code, questions and answers between fellow ACF users