in ACF you can only choose the location of an entire field group, not individual fields.
If you want to do this ACF supplies a filter https://www.advancedcustomfields.com/resources/acf-prepare_field/. Using this filter you could check for the template type of the post and return false for the template where you don’t want it to show.
However, I don’t know if this will work when switching templates. The post may need to be saved for the change to take effect.
I would probably create different field groups for the different templates. With ACF 5 you could use the Clone Field to clone all the common fields into both of these field groups.
