The problem with that theory is that just because you don't love it doesn't mean that there aren't lots of others who do love it. Trading off your joy doesn't mean you aren't still competing in a field where your competitors love it ... it just means you don't.

For the concern you cite, avoiding what you love is misguided, you want to actually study the markets for various options to see what is getting bid down -- and choose something that has an attractive combination of economic conditions resulting from others preferences and interaction with your preferences.