If the value you wanted to order them by was already saved in term meta it would be easy. The difficulty is really that what you really want to order the terms by has something to do with the posts in those terms.
It might also be possible to construct (a very complicated and over my head) MySQL query and use $wpdb to do the work.
