With huge numbers of fields there will be performance issues. If you have a lot of wysiwyg fields then you can set them to delayed init.
All layouts will be generated at least once, even when not used. These are hidden and used when inserting a layout. The hidden “clone” layout is copied to the new instance.
