Thanks @hube2 but to be honest that code is not doing anything in my end :S
Sorry for being asking the same thing in 2 threads, I thought this was not being watched anymore.
But @hopkirk described this problem very eloquently, the fact of the matter if it is currently impossible to remove images from a gallery in a front end form.
I described the specific problem in this thread
https://support.advancedcustomfields.com/forums/topic/show-gallery-remove-icon-not-just-on-hover/
Thanks!