A set of work clothes, a set of clothes for wear around the house, and a set for going out. So naturally you see pictures of people in public they’re wearing their one set for going out.
Also if you look closely, those clothes (except for the most well-off people) are crudely made, of coarse materials and heavily worn with frayed edges and patches.
Things always look better at a distance.