A quick search of the Sagarin archives tells me...
that Utah's 2004 SOS was 67 compared to BYU's 2014 SOS of 75. That's with us playing twice as many P5 teams. I'll say it again...the number of P5 teams on the schedule is a poor way to measure that schedule's difficulty.