In your OP I didn’t realize that you could not even get to the upgrade page. On that page there is a list of sites and you can choose which to upgrade.
More than likely this does have something to do with being installed in a sub directory and in that case it is definitely a bug that you should submit a ticket for.
