Spoken like a fan of a team who has not fared well in such polls
I don't have data, but I would guess that what you are saying is kind of true, but also kind of not true. Voters have a hard time dropping teams who win, even if they underperform. So there is at least some inertia.