1) You have to make sure you’re calling remove_action() after the corresponding add_action() is called by using the correct hook and priority. More than likely you’ll need to put this inside another action that is called at the right time. For example on the WP “init” hook.
2) Make sure that you are using the same priority that is used for the add_action() call.