829
AI-generated code contains more bugs and errors than human output (www.techradar.com)
submitted 10 months ago by to c/technology@lemmy.world
204 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 29 points 10 months ago* (14 children)

It can't even copy and paste a Hello World example properly. If someone says it's working well for them, I'm going to now assume they are too ignorant to understand what's broken.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 14 child comments
    •
  • [–] 7 points 10 months ago (4 children)

    It works well for recalling something you already know, whether it be computer or human language. What's a word for... what's a command/function that does...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 9 points 10 months ago (2 children)

    For words, it's pretty good. For code, it often invents a reasonable-sounding function or model name that doesn't exist.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 10 months ago* (1 child)

    It's not even good for words. AI just writes the same stories over and over and over and over and over and over. It's the same problem as coding. It can't think of anything novel. Hell it can't even think. I'd argue the best and only real use for an llm is to help be a rough draft editor and correct punctuation and grammar. We've gone way way way too far with the scope of what it's actually capable of

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 10 months ago

    @Xenny @frongt it's definitely not good for words with any technical meaning, because it creates references to journal articles and legal precedents that sound plausible but don't exist.Ultimately it's a very expensive replacement for the lorem ipsum generator keyboard shortcut.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 10 months ago (6 children)

    What’s your preferred Hello world language? I’m gunna test this out. The more complex the code you need, the more they suck, but I’ll be amazed if it doesn’t work first try to simply print hello world.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 9 points 10 months ago* (5 children)

    Malbolge is a fun one

    Edit: Funny enough, ChatGPT fails to get this right, even with the answer right there on Wikipedia. When I tried running ChatGPT's output the first few characters were correct but it errors with invalid char at 37

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 10 months ago (4 children)

    Cheeky, I love it.

    Got correct code first try. Failed creating working docker first try. Second try worked.

    tmp="$(mktemp)"; cat >"$tmp" <<'MBEOF'
('&%:9]!~}|z2Vxwv-,POqponl$Hjig%eB@@>}=<M:9wv6WsU2T|nm-,jcL(I&%$#"
`CB]V?Tx<uVtT`Rpo3NlF.Jh++FdbCBA@?]!~|4XzyTT43Qsqq(Lnmkj"Fhg${z@>
MBEOF
docker run --rm -v "$tmp":/code/hello.mb:ro esolang/malbolge malbolge /code/hello.mb; rm "$tmp"

    Output: Hello World!

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 10 months ago* (last edited 10 months ago) (2 children)

    I'm actually slightly impressed it got both a working program, and a different one than Wikipedia. The Wikipedia one prints "Hello, world."

    I guess there must be another program floating around the web with "Hello World!", since there's no chance the LLM figured it out on its own (it kinda requires specialized algorithms to do anything)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 10 months ago

    I use it for things that are simple and monotonous to write. This way I’m able to deliver results to tasks I couldn’t have been arsed to do. I’m a data analyst and mostly use mysql and power query

  • permalink
  • fedilink
  • source
  • parent