The same can't be said for blindness, because we never have periods where we just see completely nothing all across our vision.

I mean, that's demonstrably untrue, just close your eyes in a dark room (hell if it's dark enough you don't even need to close your eyes). Eyes work by detecting light, we don't see darkness just the same as we don't hear silence. The brain implies darkness by the absence of light, just as it implies silence by the absence of sound waves.

If anything, I'll argue that total blindness is probably the easiest sense to simulate losing. The body has lots of ways of making its own sound: small movements, breathing, swallowing, digestion, even your heartbeat, so there is an argument there that experiencing total silence is rare. You can always taste, smell, and feel yourself (even if your brain filters most of it out), there's not much you can do there. On the other hand, the human body doesn't give off visible light and blocking visible light from external sources is easy and cheap, so you can relatively easily isolate your eyes from the outside world and render them inert. Then you're just left with what your brain comes up with, but that's true for all sensations or lack thereof.