They aren't evaluated by fans. They are evaluated by experienced officials who can properly score their performance. There are plenty of officials waiting in the wings if they are bad enough. Fans really aren't in a proper position nor do they have the knowledge to truly evaluate an official's performance.