I've spent the last 30 years deep in the deaf community and this conversation does come up now and then because the deaf can feel oppressed at times and I expect most deaf have had the "you shouldn't even be driving" comment thrown at them.
The problem is, any heightened senses are not going to make much difference, and the deaf have the right to drive like anyone else and would fight for that right should it be threatened. I would fight for their right to drive too, and so at the same time I can't also say "but you can't wear headphones" as its a double standard.