I don't think there's anything particularly weird with having capitals on an island as long as 1. it's a well established city and 2. it's close to the mainland. Personally, I find it much weirder when capital cities are right along the border of another country (I'm looking at you Kinshasa/Brazzaville and Bratislava!)