I agree! See my comment about the US nuclear industry though. Humans are lazy when given an easy option so the probability of a problem skyrockets just by using LLMs.

In an ideal world they would never have been invented and we'd all be better off. For now I would accept something to the effect of restricting LLM use to the extent of "advanced search engine" and " really good static analysis tool"; it can point but can't touch. I recognize that there's very little in the way of distinguishing those uses and ultimately it would be better to never use it for any reason at all.