I’d rather stick to something more native to WordPress, so the second route would be better…but I’m not sure what you mean by:
just query the part of the gallery you need on each page.
I do work with PHP, but I’m not sure how to get pagination to work on images.