78
AI Software Development Is Near-Impossible (www.youtube.com)
submitted 4 months ago by to c/programming@programming.dev
81 comments fedilink hide all child comments
 

Support this channel on Patreon ► https://www.patreon.com/zoranhorvatGenerative AI can write code, but it cannot develop software on its own. Here is why the...

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 months ago (2 children)

It probably depends on what model you are using, but what you describe is more akin to the kind of advice I've gotten when I've asked for suggestions for optimizations, rather than asked the LLM to identify (not solve) problems in the code. When I've asked the LLM to identify problems, the overwhelming majority of issues raised where true positives, though most of them weren't very serious either

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 4 months ago* (1 child)

    Yeah I would say it's pretty good at catching most mistakes the majority of the time, it's just the few times when it does make a mistake that I'm not sure is a mistake or not, it'll argue in a way that seems plausible and forces me to rethink and verify the code that was already correct. I probably still save time with it, but it can be incredibly annoying and time consuming when it fails.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 4 months ago

    True. Most of the false positives were easy to dismiss, but I did spent a significant amount of time of time on a couple of them, since it wasn't immediately clear to me that the code was correct. In one case the agent had missed a precondition that was verified elsewhere, and in the other it had misrepresented what the C++ standard actually said

  • permalink
  • fedilink
  • source
  • parent