Unfortunately, your clothes and hair can reflect so much about you, particularly attitude, that you will be either disregarded as trash or regarded as someone respectable depending on how you groom and clothes yourself. So in a way, they do make the man.
Maybe it's just me, but I don't think we have a broken system. Somehow we're living in a suddenly super-liberal society where people question and complain about everything and then marry their dogs. There may not be anything to correct when people don't conform, but conforming does not imply something needs to be corrected. If everyone "dressed and appeared however they wanted from birth", we'd all be naked. We're not born to wanna wear clothes (unless you live in Antarctica). That's a socially constructed norm, so by putting on your underwear this morning, you've already played into conformity.