They schedule an OOC rival + one other game. There are many other schools with great non conference rivalries that are played annually and treated like games that are non-negotiable on the schedule.
Utah basically panicked when they joined the Pac and decided that if they want to be competitve they have to kill the rivalry. It should have told the Pac they needed to play BYU opposite the Notre Dame game every year on Thanksgiving weekend and play Colorado the week before opposite Stanford/Cal. It actually fixes the PAC scheduling problem caused by ND that will never go away.
This would be good for the rivalry and good for Utah because the game would be played after the conference schedule is complete. It could potentially be a problem on the rare occasion that Utah wins the as south, but if Utah is that good, dispatching BYU shouldn't be a problem.