Whilst I wouldn't call it "walking on eggshells" - I've had my perspective invalidated in discussions based on my perceived identity (majority culture, male) on more than one occasion.
I'm also part of an "invisible" minority which does necessitate actually "walking on eggshells" in certain contexts.
It is a bit disheartening that my being part of an invisible minority somehow makes my personal perspective "more valid" to some people. Every person is an individual, and personal, lived experiences are so much more important than demographic markers and groups.