If you can just choose to stop being a fan then you were never really a fan to begin with. True fandom isn't something you can just switch on or off like a light switch.
I get that it's frustrating and sometimes I wish that I could stop caring but I can't. BYU blood runs in my veins and I'm a fan for life, thick or thin, for better or worse, and even into death. 😀