Ok, solved it.
Changed:
<?php if (get_row_layout() == 'paragraph_content'): ?>
To:
<?php if (get_row_layout() == 'paragraph_content' && get_row_index() == 1): ?>
and removed the break… all works as it should. No need for putting post, or cat, IDs in the fields!