Looking at the documentation again for acf_register_block_type(), there is an option for post_type restriction:
'post_types' => array('post', 'page'),
This seems to take care of the category issue, too. If the category is empty, it will not show.
Potentially solved?
