It's easier to pull the upset as a perceived underdog
It doesn't mean that BYU can't beat Baylor, but as a top 20 team they will likely have the Bears full attention. I'm not sure that has always been the case in some of the other games you mentioned.