It was much more of a thank you than it was a backhanded jab towards the fans. I think you're looking to be offended. He spent more time showing appreciation for the fans who were still there with the team. He didn't say anything derogatory towards the fans. Had he said, " I can't believe our fans would leave. I'm disappointed in them", then you would have an argument. I think you're reading way too much into this.
P.s. Nobody's happy with the way this season (or others) has gone. We all want 24 less ankle injuries and taysom back.