The pen button opens the standard WP edit screen for the file. This works the same as if you went to the media folder and opened the WP editor for it from there. You can’t delete the button, but you can probably hide it with some custom CSS added to the admin of your site.
