What are the location rules on your field group?
Is this happening in a particular browser? Have you tried testing in another browser?
It sounds like the group is being hidden because selecting a term in the taxonomy field is triggering the group to not be active. I testes this and I’m not seeing the behavior you describe.