Checking for existing errors is a completely different thing than saying "do this"
We use a lot of automation at work, but it's stuff like that or "pull this number and put it there" where a human might make a typo.
But still, way different than actually making something from a handful of vague suggestions.
And at that point it's not really a LLM, it's just botting.