I’ve always said that edge cases will continue to plague “AI” things like self driving cars until true AGI exists. In the decades I’ve been driving I’ve seen all manner of edge cases that neither Waymo nor any other self driving car would handle properly.
One example I like to use is when I stopped at a red light next to a construction site. I was watching the red light and didn’t see a cop next to the construction zone who was waving me through the red light. He eventually took a few steps towards my car and yelled to get my attention, after which I drove through the red light.
For a self driving car to respond in a situation like that it would need to recognize the cop as an authority figure and not just a pedestrian that is overriding the red light you stopped at.