I think it may be a result of the mandatory football games, but I don't think I know anyone who was a fan of a different team before USAFA who would root against them.
Even now, I have complicated loyalties between Utah and BYU. But despite making the Air Force my career, and teaching there for some time, I don't feel any loyalty or support for the football team there. It's honestly weird how little fandom that place builds.