theyre automatic cars, so the only time youd shift gears is to park, or switch from go to reverse or vice versa, both usually done while breaking, so its understandable to some extent. it also prevents someone from shifting gears while in motion.
had evs be "manual" then that would be dangerous
an example of bad physical design would be cars with gear shift knobs near a volume knob, which would be infinitely more dangerous