361
[US] Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization (www.axios.com)
submitted 2 weeks ago by to c/fuck_ai@lemmy.world
66 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 2 weeks ago (7 children)

Yes, but not necessarily told to go get the data, where to find it, how to access it, etc. You stated AI doesn't do ANYTHING on its own, but that's not technically accurate, so that was my point. The calculations are it determining what steps to get to the goal, and they don't involve the user or prompt all the time. It's not intelligent, so sometimes the steps are very all over the place, but they aren't all prompted.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 8 points 2 weeks ago (3 children)

    This might be a philosophical difference we're approaching here.

    My argument is that it is not doing anything with autonomy.

    If I'm understanding you correctly, you're arguing that, (at least by the way it spawns subagents), the prompts it creates for those subagents are what you count as autonomous.

    In my experience with Claude and Claude Code, it won't spawn uncontrolled subagents unless something in the prompt context makes that a suggestion.

    In sessions where I've used it without subagents and it performs things it self-describes as "against its instructions by mistake" I can find what caused it to do that in the original context.

    In my opinion, at most, it simulates autonomy. Otherwise, its just like every other machine in existence that it does exactly what you tell it do to, not what you intend it to do.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 2 weeks ago (2 children)

    I agree that there is no autonomy, as anything it does was determined by its training, which comes from a human source at some point. If we wanted to get really deep, one could argue the same point for humans - the whole "I stood on the shoulder of giants" thing, we all learn by being taught by other humans, or by experiences ourselves that show what works and what doesn't.

    I have seen Claude go out and do things not remotely suggested (sometimes it's a good thing, but sometimes it's too much). Now, is there some subtleness in the prompt that spurred that? It must be very hidden, as when Claude says it's doing X, Y, and also saw it could do Z, and I was only looking for X...

    But sure, it's a simulation and somewhere along the process of doing X it saw in training data, or rather the training data steered it towards also adding in Y and Z as useful. Not thinking, but it's a gray line sometimes.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 weeks ago (1 child)

    To a lot of people it certainly appears to think.

    I am tempted to get posters made of the AI quotes from Dune, in particular the one that Ive referencened all too much:

    "But what the O.C. Bible should've said is: 'Thou shalt not make a machine to counterfeit a human mind.'"

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 weeks ago

    Dune is a fair warning for a lot of reasons, but fortunately we're not at that level yet. We just did our version of it so far completely wrong in every possible way and may ruin ourselves with the not-intelligent ones and our own egos.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 2 weeks ago (2 children)

    You're both right

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •