He doesn't like the fact that the Yankee payroll is and always has been the highest in baseball. Yankee Stadium fans can be pretty rude, even to their own team.
There's another side to the Yankees that to me is sort of magical. 80,000 fans in old Yankee Stadium was something else in the old days.