Especially those who are disinterested (Wisconsin) or experiencing extreme coaching turmoil (Tennessee) or both (USC).
Almost every P5 team will have better talent so BYU needs other factors to go in their favor to balance things out.
I think one of the reasons Utah is so tough for BYU as they have better talent, better coaching, and usually won't overlook BYU (like the first half last year).