you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 2 days ago (3 children)

No computer program can go beyond what it is programmed to do. Computers cannot think, they can only follow the code.

Fire cannot think either. It follows a very predictable kind of behavior. It spreads and grows to new sources of fuel and oxygen.

A fire can still burn out of control.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 2 days ago (2 children)

    That isn't a good analogy. We have absolute control over every aspect of the program, the environment it runs in, and the hardware it runs on. We can't even force computers to do anything actually random. The best we can do is approximate randomness.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 days ago (1 child)

    You're right, but think back to things like the "worms" of old. Their program specified their behaviour precisely, but no-one could predict their spread. We're placing random instruction generators inside harnesses which loop and execute their instructions. The range of possible outcomes is almost anything.

    Honestly the thought of running agentic harnesses with no safety guards is one of the most stupid ideas I've seen. Orders of magnitude more than curl | sh.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 2 days ago

    No one anthropomorphized malware like this though. The worms didn't go rogue. And people didn't see the damage done and decide there should be no consequences and the best course of action was to give billions of dollars to the person who built the worm.

  • source
  • parent