You’re not going to be able to remove the ACF plugin and add on. Even if you put the fields into a plugin ACF will still need to be installed for anything to work.
If you don’t want to anyone else to fiddle with things you can hide the menus for ACF. http://www.advancedcustomfields.com/resources/how-to-hide-acf-menu-from-clients/
