i'm convinced the core problem is that cars fuck up your view of the world.
Stuff like not hearing your surroundings and the sounds your own cars makes, the big hood and all the other parts of the car blocking the view, probably the fact that you're seated plays a part as well, and of course the absolute lack of subtle feedback to the controls.

When you get into a car it becomes way more difficult to do any sort of fine adjustments and suddenly 15km/h feels painfully slow, so a driver who thinks they're crawling along is actually going fast enough that they have absolutely no chance of stopping in time if something pops out from around a corner.