It's like anything else people obsess over--food, wine, cars, health, exercise, drugs, guns, etc.
The problem isn't the obsession--you do you, glad you have a hobby--the problem is they won't shut the fuck up about it, and the air of superiority. Go geek out at your audiophile conventions, which I assume is a thing. Control yourself around we normies. Or don't, I guess, and be annoying.