For the query I gave above you could also use between comparing them as number values
meta_query => array(
'relation' => 'AND',
array(
'key' => 'date_picker_field_name',
'value' => array($first_day_of_month, $last_day_of_month),
'type' => 'NUMERIC',
'compare' => 'BETWEEN'
)
)