I mean, if that's the way you want to look at it, go ahead. It doesn't seem like a very friendly world to live in, but you are welcome to it. However, here is how I look at it.

Humans observe other humans. They see humans doing things that are good for themselves and others, and they see humans doing things that are bad for themselves and others. They lump these actions into broad categories with only the necessary nuance needed to live their own personal lives. Then when they hear of a human who greatly values doing things in one of those categories, their interest in interacting more with that human increases or decreases based on their preconcieved notion of the thing. Humans communicate with each other, sharing information. And via communication through all of society, broad cultural consenses emerge about the acceptableness or unacceptableness of being heavily invested in a certain activity.

So the thing to realize is that if you feel like you are often socially rejected when you talk about your hobbies, it may just be that you need to rephrase them, and they will become very interesting to others. For example, if you like reading about history on Wiki, you can say "I like to learn about history", and this might lead to a discussion of horse technology in the Mongol empire or something.

And if someone else says they like reading, but only actually read the most basic trash novels - well whatever. That's not your problem. You are too busy talking about horse mounted archery.