And it's not that different. I have watched probably a dozen rivalry games with fans of BYU, no problem. Admittedly, those were at home, not in person, but you should be able to watch a rivalry game with opposing fans without causing a problem, particularly if you work with them (or your spouse does).