938
AI agents wrong ~70% of time: Carnegie Mellon study (www.theregister.com)
submitted 1 year ago by to c/technology@lemmy.world
246 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 17 points 1 year ago (1 child)

They've done studies, you know. 30% of the time, it works every time.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] 9 points 1 year ago

    I ask AI to write simple little programs. One time in three they actually compile without errors. To the credit of the AI, I can feed it the error and about half the time it will fix it. Then, when it compiles and runs without crashing, about one time in three it will actually do what I wanted. To the credit of AI, I can give it revised instructions and about half the time it can fix the program to work as intended.

    So, yeah, a lot like interns.

  • permalink
  • fedilink
  • source
  • parent