Is it wrong for me to base a decision off this factor?

This is really a question of what is most important to you. The classes that interest you in a new environment or sticking to what you know. In my opinion, everything you aren't keen on is something you'll easily adjust to. It's only one year, like nine months really.