These forums didn’t get much love 2 years ago, sorry for your long wait.
I just had a look in ACF5 Pro and the data is deleted from the options table when a term is deleted, and looking in 4 it appears to be the same.
In the next version or two term meta should be incorporated into ACF.