Hi @charlie
Are you sure you are using the taxonomy add-on? Or are you using the taxonomy field which is part of ACF v4?
To run the filter on your specific field, you will need to look at the $field parameter of the filer like so:
if( $field['name'] != 'my_specific_name' )
{
return $args;
}