they know it bothers you? No, of course you didn't. Fact of the matter is that many BYU and Aggie fans are very similar. The majority are LDS and are separated by less than 200 miles.
I'd wager that if USU fans weren't constantly screaming about how holier-than-thou BYU and its fans are, I'd bet you'd have a lot fewer "validations" of your view. My wife is an Aggie and we get along fine.