The difference in relative terms isn't as great. In 2004, Utah ranked 70th out of 120 schools in terms of SOS. In 2008, 80th of 120. I think the formula also liked 2004 Utah's blowout win of Texas A&M early in the season. Utah also played one more game in 2008 than in 2004, a game against MWC-level talent.