Hi @kkyang,
Thanks a lot for reaching out to us.
This is most likely due to the size of the images in your gallery.
The gallery fields simply stores an array of ID/Links to the images and thus has little effect on the memory.
You could checkout plugins such as https://wordpress.org/plugins/wp-smushit/ that will help you out with optimizing the images.
I hope this helps.
