With labels on the left you are going to have this issue with any field that does not have a label. The label is floating on the left and this causes the fields to align on the right.
You can either add a label to the field or you can add custom CSS to your admin pages to add a left margin to the field input.