I've had a couple friends in similar situations as you. It's been interesting to watch the evolution of one in particular. Grew up a BYU fan, switched to Utah after going to school there. Initially after the switch, he still liked BYU. A couple years later, he was ambivalent. And now he's a bad cliche of a Yewt who bashes BYU and uses BYU as a conduit for his disgruntlement with the Church. The other friend is a huge Utah fan, but still likes BYU if they're not playing Utah.
I'm not equating you to either of my friends above, but am curious how you feel about BYU now, and It'll be interesting to see how those feelings evolve.