Actually, it’s not a half bad idea. The relationship field can have some issues with extremely large sites with thousands of posts. Similar issues can be seen with extremely large numbers of terms. These subjects come up from time to time here and replacing the WP query or the get terms calls with a $wpdb query would be a good solution for these.
If I have time I’m going to explore this further.
