Interestingly enough, I don't seem to have that exact problem. The content speeds I'm comfortable with are highly variable, and I think it has something to do with attention bandwidth.

My default speed for videos is 2.5x when I have it on a big screen and I can pump the audio directly into my head via headphones. Without the headphones, anything over 2x usually feels too fast, so I guess filtering ambient noise is using 0.5x worth of brain power. When I lose the visual component (as with audiobooks) to anchor attention onto, I'm most comfortable at 1.5x.

In real life conversations, so much of my attention is on other things (like what my hands and eyeballs should be doing) that 1x is back to feeling normal.

The only thing it maybe hurts is watching videos with other people, but I don't do that a lot and can usually still get away with 1.25x or 1.5x. Also, I sometimes get the feeling that I'm talking too slowly, but I think I've always felt that.