This true to some extent but if you are a winning program, ranked year in and
year out, it won't matter as much.
BYU plays a PAC XII schedule almost, meaning we play many of those teams each season. Now we don't compete for their conference crown but its as close as will come till some P5 conference invites us.