256
“I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program…” (geohot.github.io)
submitted 4 months ago by to c/webdev@programming.dev
83 comments fedilink hide all child comments
💯 3
 

I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.

you are viewing a single comment's thread
view the rest of the comments
[–] -3 points 4 months ago (5 children)

This is like saying "but it is just a sophisticated network of neurons. All it can do is transform input signals into output signals. That's what it does."

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 3 points 4 months ago (4 children)

    Not really.

    A machine learning model is a computer program. It is fundamentally a math equation, which we understand completely.

    A living brain is not fundamentally a math equation, and is not purely a statistical model, at least not in any empirically demonstrable way. We don't understand completely how it works, but we do know that it's more complex than what you're trying to imply.

    The comparison is not valid. Machine learning models are not an equivalent to a biological brain.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] -1 points 4 months ago (2 children)

    A machine learning model is a computer program. It is fundamentally a math equation, which we understand completely.

    Lol you couldn't be more wrong about this. One of the most widely commented things about DNNs is that we don't really understand them completely. I don't know how you would miss that if you knew anything about AI at all.

    A living brain is not fundamentally a math equation

    It is. A very complicated one, sure. Which part of the brain do you think is impossible to simulate with maths?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 4 months ago (1 child)

    One of the most widely commented things about DNNs is that we don't really understand them completely. I don't know how you would miss that if you knew anything about AI at all.

    No one who actually works on digital neural networks thinks this. We may not be able to predict the behavior of a particular neural network with certainty (because there are a lot, like millions, of variables), but that does not mean that we don't understand how they work.

    Which part of the brain do you think is impossible to simulate with maths?

    simulation ≠ reality

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 months ago

    simulation ≠ reality

    Yes it is, if your simulation is sufficiently accurate. Let me rephrase. Which part of the brain do you think has behaviour that is required for intelligence/consciousness and that behaviour cannot be replicated with sufficient accuracy on a computer (of arbitrary capacity)?

  • permalink
  • fedilink
  • source
  • parent