I’m looking at this same thing now (2 months later) and I’ve found that Advanced Custom Fields isn’t attaching a user to a taxonomy properly.
Instead of properly adding an entry to the wp_term_relationships table they’re just adding an entry to the wp_user_meta table.
