The now-fading business suit and its cousin, the sports coat, is an adaptation of the army officer's tunic of the Napoleonic wars, with the lapels folded back. Officers were aristocrats (the British didn't want a military coup, so the British Army leadership, unlike the more meritocratic because less threatening Royal Navy's officers, came from the insiders who already owned Britain; the British Army intentionally didn't fulfill the Corsican adventurer Bonaparte's ideal of "careers open to talent"), so tailors evolved a garment with padded shoulders that would do a pretty good job of making even a rather pear-shaped officer look like a natural leader of men.
Today, however, we have more of a fashion meritocracy where the charismatic individuals who spread fashions aren't more or less average looking aristocrats, but people who are chosen specifically for their physical superiority -- models, entertainers, and athletes. If you're Brad Pitt or Angelina Jolie or Giselle Bundchen or Tom Brady, a winner in the genetic lottery, wearing the old aristocratic styles that would make the average person look better is silly. Indeed, the point of meritocratic fashion becomes to mercilessly expose the physical flaws of the wearer.