I don't know about other fans - but I'll keep watching games because I like them. Even if BYU loses to Texas this year. Even if they are playing Idaho State.
Now - I do like conference races. But, frankly, I'm not sure I care more about winning the AAC/MAC/MWC/ETC than I care about having some good games to watch. In all honesty, being in a conference race increases the chances of me watching other teams in the conference when their game's outcome affects my teams standings. But not being in a conference doesn't make me not want to watch football. And it doesn't make me not want to watch BYU.