In my case, it was the reverse. Loved Mathematics, shunned everything else. They had something called a "Distinguished Scholar's Program," which meant I was basically able to design my own curriculum. By the end of the first year, when I'd figured out just how much latitude that afforded me, I was taking only Math classes. Now, I think that left me with a somewhat unbalanced view of the world, and I paid for it later. But if you go and talk to your professors about how much flexibility there is in the degree requirements, you might be pleasantly surprised.

You'll be sorry if you don't learn calculus, though!