Raw LLM Responses

How about when the self-driving car encounters something it wasn't programmed for in a context not requiring quick reflexes? A burst water main is gurgling onto the street and the computer thinks the hump of water is a living creature and refuses to run it over. Or a small mudslide is covering the street and the computer thinks it's a barrier of some kind. Or a banner over the street has fallen down and the computer stops because it can't tell the difference between concrete and fabric. A human driver would just go through slowly, or pull onto the sidewalk to get around. The self-driving cars might just stop, and then quickly clog the street so the first cars can't back out. Are we assuming the computers will be 100% competent at dealing with every scenario from the get-go? It's one thing to say humans suck at driving compared to the computers, it's another thing to say humans always suck in every scenario so no more steering wheel ever.