I don’t disagree with all the trouble with women sizes, but as a somewhat taller than average man with long arms, whose belly did not grow with torso length, who likes to stand upright with shoulders back, I can tell you, shopping for men’s clothes is not the simple thing you paint it here.
And god forbid those times when I am fit and have muscles. That’s nightmarish for finding clothes.
When men wear clothes like sacks, you can imagine that it’s not because they don’t care, but because they gave up.