The fact of the matter is that BYU is a non-P5 team playing in the most sparsely-populated continental timezone. Many people can't be bothered to keep up on the shuffling and re-shuffling of mid-major conferences in the intermountain west.
I think many of us are guilty of the same in the other timezones. How many of us can differentiate between the MAC, the Sunbelt, and Conference USA? How many us us can keep track of the C-USA moves to the AAC?