I’m looking at this same thing now (2 months later) and I’ve found that Advanced Custom Fields isn’t attaching a user to a taxonomy properly.
Instead of properly adding an entry to the wp_term_relationships
table they’re just adding an entry to the wp_user_meta
table.
Bump. Please add the ability to control if an option is auto loaded.