You say that, but I have no problem at all with subtitles if I need them for another language. I've been watching Das Boot with my newborn by my side and it's a great experience.
I think the issue I'm trying to complain about is having two options (e.g. if I'm watching with someone that insists on subtitles) where I could have the better experience without them. My brain can't opt out of reading them.
When I need subtitles due to language then there is no other option so the one way to watch is with them. Dubbed versions of some stuff exists, of course, but it's extra effort to track them down.