After some more testing, it appears that I was wrong. The relation did not make any difference. The field worked perfectly when there was only one post returned by the query but it there are 2 or more matching posts then for some reason it fails. I am extremely confused now.
