Unfortunately this happens. It also happened back in BYU's glory days. Some Ute fans jumped ship in those days.
Human nature I suppose. Some people have pretty fragile egos. They think if their team doesn't play well it automatically means they are a loser.