IMHO ultimately the problem is down to the natural human need to put things in labelled boxes ("Autism", "ADHD") to simplify a complex world into a simpler enough representation that it fits most people's mental capabilities and they can understand it - something which ends up causing problems for everybody significantly away from the norm in anything which is a range or a spectrum (for example, I suspect the problems around sexual orientation and transsexualism derive from this) - and people's emotional need to feel comfortable which is challenged when they interact with people who don't look like or behave within a certain common range of appearance or behavior people are familiar with - something which gets solved with familiarity, but that does mean that the more uncommon somebody's pattern of behavior is or the more people like that tend to refrain from social contact, the less people in general out there will be familiar and thus comfortable with it.
A large part of the problem with these is that they're emotional and/or subconscious, so to overcome such human tendencies in oneself one needs to be at least somewhat intelligent, know about this kind of thing, actually have enough empathy to want to do it for the other person on the other side AND have enough self-awareness to spot in themselves such tendency, a combination of character traits which is at best uncommon.