Good answer. I don't think he needs to care. I'd spend every bit of my thoughts focusing on just getting from one game to the next until you end undefeated, something which is incredibly tough to do and doesn't happen much.
Sounds like he's just basically saying he'll worry about doing his job before worrying about a committee doing their job. The latter doesn't matter without the former being effective.
I actually really liked the interview. He stuck it to a lot of people. Rivals, conferences, playoffs, etc. Sure it's all garbage but it doesn't matter unless BYU gets the W's first.