Nobody cares if you have super fashionable trendy clothing, but it's sad when you see guys walking about in shorts with long white socks pulled up and their crocs. That's the bigger issue.
Cargo shorts just shout "out of touch, nerdy dad". Some (generally older) men couldnt care less and they fit that stereotype perfectly, so more power to them. Same goes for long white socks with crocs wearers.