“person filled with excessive and single-minded zeal, especially for an extreme religious or political cause.”
So if you don’t even watch the games then you definitely are not filled with zeal. So by definition, you’re not a fan (at least temporarily). Doesn’t mean you’re a bad person.