Plain and simple. Sure there are other factors like game time, but that is really just a small subset of the fan base.
If we had 5 10 win seasons this decade, beaten Utah a couple of times, the stands would be full and there would still be a big buzz around the program. ESPN's contract would already be renewed.
Independence isn't hurting the program.