I don't think most people think that most of the poor are lazy and don't work.
When people gripe about lazy people who won't work, they're talking about people who are lazy and won't work. Like my neighbor who flat out told me that he quit his job because he gets almost as much in welfare as he got paid.