AI is not capable of novel or complex stuff,
This seems to be both untrue and mostly irrelevant.
The recent FLT proof is clearly complex and novel.
But also a huge amount of programming is only barely complex and not really novel at all.
The biggest issues I've seen with AI so far are:
- The slop comments are just painful to read. I think this might mostly be Claude though, I recently switched to Codex and it's way less annoying.
- It is so benchmaxxed to "succeed at all costs" it will often do stupid things just to make the test pass or whatever. To be fair a lot of humans are like that - "I dunno but it seems to work" attitude.