Hi @jakniktinny,
Thanks for the post.
I am not sure I have clearly understood the use case, have you tried changing the user roles that the field groups can be mapped to?
If you had set the user role to admin, perhaps you could map the group to another user level such as subscriber or author.