Officials aren't just there to throw flags and march off penalties. During the game, they are the caretakers and are vested with the authority to manage the game within the confines of the rules and policies of those who give them the authority. i.e. whatever conference or governing body that controls play. It's not all written in the rulebook but game management is part of being an official and it's written down in officials manuals and taught at clinics. I've taught these clinics and have experience as an official in both football and baseball that spans literally thousands of games. I also have coached a lot of football as well.