If the interruption is for instance by strangers saying how nice the weather is, the complaint is valid, some interruptions are frivolous.
But if the book is more important than personal contact with friends and family, you are the problem.
IMO some people need to get over themselves, the book auto pauses when you look up, and you can continue at the exact same spot at any time. It's not like you will be missing something and not understand the rest of the book, because you missed a key element.
If you don't want to be disturbed go somewhere private.