There's only been one non-G5 team in the last 5 full seasons that finished outside the top 10 with only 2 losses.
If BYU loses to Baylor but then wins 6 games in a row to end the season, including the bowl win, they will most likely climb back towards the top 15 as other teams get to 3 losses.