I don't know how old you are, but when smartphones were first on the market there was real concern that people (presumably "perverts") would use them to take pictures of people without their knowledge. I recall that there was even a push for legislation to require smartphone cameras to make noises when taking a picture, in response to this concern.
And look at how you're describing them. "Pervert glasses". Are legally blind people who use this technology to better navigate the world "perverts"?
It seems like the real concern is that so-called smart glasses are new, not that they actually change much. If/When they become aa commonplace as phones, I'm guessing no one will even notice them, just as we do with everyone having a phone.