you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 weeks ago (2 children)

I agree that there is no autonomy, as anything it does was determined by its training, which comes from a human source at some point. If we wanted to get really deep, one could argue the same point for humans - the whole "I stood on the shoulder of giants" thing, we all learn by being taught by other humans, or by experiences ourselves that show what works and what doesn't.

I have seen Claude go out and do things not remotely suggested (sometimes it's a good thing, but sometimes it's too much). Now, is there some subtleness in the prompt that spurred that? It must be very hidden, as when Claude says it's doing X, Y, and also saw it could do Z, and I was only looking for X...

But sure, it's a simulation and somewhere along the process of doing X it saw in training data, or rather the training data steered it towards also adding in Y and Z as useful. Not thinking, but it's a gray line sometimes.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 weeks ago (1 child)

    To a lot of people it certainly appears to think.

    I am tempted to get posters made of the AI quotes from Dune, in particular the one that Ive referencened all too much:

    "But what the O.C. Bible should've said is: 'Thou shalt not make a machine to counterfeit a human mind.'"

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 weeks ago

    Dune is a fair warning for a lot of reasons, but fortunately we're not at that level yet. We just did our version of it so far completely wrong in every possible way and may ruin ourselves with the not-intelligent ones and our own egos.

  • source
  • parent