Hi there.
I had the same issue a while ago and didn’t found a proper and safe solutions without a heavy SQL query.
So I created a plugin using functions by ACF to remove unused metadata.
Create a database dump and give it a try:
https://de.wordpress.org/plugins/whatwedo-acf-cleaner/
Hope it helps not just me