There isn’t a filter to directly effect layouts.
I think you can use acf/prepare_field on the flex field. In the filter you should be able to loop over the layouts ($field[‘layouts’]) and remove layouts. See this https://support.advancedcustomfields.com/forums/topic/disable-layout-from-showing-in-template/#post-53129