interested in or enthusiastic about following said team.
Now, to further illustrate the point, if a fan were to switch fan allegiance from the losing team to a winning one, then you could say they were a fan of victory and not the team. Like switching allegiance from BYU to Utah right now.