If you are showing fields that are associated with each post then this is the only way to do so. Are the fields edited when editing a post?
If you want to show fields on a term page and not on the post then the location of the fields should be set to the taxonomy and not posts. Is this the case and this is what you are attempting to show?
