BYU is a much more known quantity than Utah St. No, we're not USC or Oregon or even Wisconsin necessarily. But we're also not Utah St, Tulsa or UAB either.
Playing good opponents and generally being pretty good carries some weight. I'd definitely rather play football at BYU than at Utah St, even if I was non-LDS from Florida.