In thinking about it, I wonder if that would really be so great? Would we really end up being able to wear what we want without any flak? Or would we just find ourselves dealing with a new orthodoxy, but one that requires us to have bigger closets?
A long time ago, when I was young, most offices required men to wear a suit and tie. When you graduated from college, you went out and bought a few suits, and the same set of suits served you for any "formal" occasion, from a day at the office to dinner with the President. You only replaced things as they wore out (or shrank

Then they instituted "casual Fridays", and you had to have a second work wardrobe, called "casual," which is not the same as what you wear on weekends.
Women's greater "freedom" has meant that they have to pay a lot more attention to what they wear. A "suit" involves not only a skirt or dress (and maybe a jacket), but also blouses, pantyhose, purse, shoes, and jewelry that coordinate in style and color. That's called an outfit, and a woman is expected to have several, because it's considered weird to wear the same outfit two days in a row. And all the different styles out there mean you have to match the style to your workplace. A big, conservative company will expect more conservative suits, a more dynamic company will expect more dramatic, maybe edgier fashions. And she can't wear daywear to an evening event, or office wear to a friend's wedding or a family funeral, etc. Virtually every major event involves running out and buying appropriate clothes. (And I do mean buy, because while a man can rent a tux, women can't rent a bridesmaid's dress, or a mother-of-the-bride dress, or an evening gown, etc.)
Do we really want that kind of freedom?
In most places, we already have the freedom to wear skirts and kilts outside of work and maybe a few family functions and the snobbiest of restaurants. You may get some guff, but no more than what you get for being, say, a Democrat in a largely Republican workplace.
One advantage to men in skirts/kilts being such a novelty is that there aren't any generally accepted rules. If a man is wearing a skirt, he's so far outside all the usual rules that nobody except a SkirtCafe member is going to scrutinize what else he's wearing. If he wears a kilt, he may get some scrutiny if he comes within range of the kilt-Taliban, but most people are going to see the kilt and not look at what else he's wearing. (Well, some may want to check out his underwear -- or lack thereof.)