I think it's normal to struggle with those thoughts, there's not really a good answer other than moderation, i.e. people of my sex tend to do these things more often, so I'll try to be a bit more aware about it, but not have the idea of doing something I'd never do rule over me because I'm "more likely" to do it. Unfortunately that moderation is even harder having autism.
Suffering happens whether you have privilege or not, and it's all relative. You can (and should) be grateful for what you do have, but you breaking your ankle doesn't suddenly not hurt because someone else lost their foot. Doubly so for emotional stuff.