Calling a game is hard. Fouls occur every time down the floor.
Just call it the same both ways, and don't take a player out of the game because he's doing the same thing his opponent is.
With only 5 fouls per player in college, inconsistent calls have a huge impact on whether a team can play the lineup they want.