Thanks, John.
For anyone following along, this is the SQL query to get this done if your fields are simple fields (not repeaters or flexible):
DELETE FROM wp_postmeta WHERE wp_postmeta.meta_key = "custom_field_name" OR wp_postmeta.meta_key = "_custom_field_name"