I would tend to agree with what you are saying in general. But nearly all of the popular forms plugins (Gravity, Formidable, Ninja) have phone number fields that validate against US, international, and (I believe) even a custom definable pattern.
They all make it work. Something similar in ACF is all that we are looking for.
Welcome to the Advanced Custom Fields community forum.
Browse through ideas, snippets of code, questions and answers between fellow ACF users