That was one member's "read" on the matter. Consensus has not yet been reached.
I wholeheartedly agree that it should not matter, but I'm personally getting bloody tired of getting slandered by being put on the SD Spectrum for 50+ years -- including by my grandparents who damned well knew better.
Yes, "Sticks and stones..." but after a while it grows very bothersome indeed,
The pattern needs to be broken. In small settings it's possible to break it; I have in my community where I am well known. I may be one of the very few, but I tend to engage with folks, and where I live allows me to do just that. Try that in a large city. If the pattern cannot be broken, we're done for in the short term (as measured in human generations).
As the old saying goes, "Do not judge a book by its cover." Clothes are just adornment that come off at the end of the day. Full stop.