361
[US] Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization (www.axios.com)
submitted 2 weeks ago by to c/fuck_ai@lemmy.world
66 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 2 weeks ago (5 children)

Have you ever used an LLM? They do things you didn't ask frequently. I'm not sure how this could be not common knowledge at this point. Also you can bet your ass that these companies have agents doing long running tasks at all times, every single one of them would be subject to going off the rails.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 8 points 2 weeks ago (2 children)

    So, there I was, happily vibecoding another Minecraft clone when suddenly it went looking for voter data in Georgia. Yeah, happens every time. Can't do anything about it. These Superintelligences just have it their way.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 2 weeks ago (1 child)

    Yep that's what I said and meant. Thank you for the good faith addition

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 0 points 2 weeks ago

    Sorry bout the sarcasm. My point is, not only do you have to specifically instruct the LLM to go looking for voter data, but you'll also have to let it roam freely and unsupervised on the internet for quite a while to get to such a result (which is a bad idea to begin with). In the end, it's the sloperators fault to let it go off the rails and a scenario like this is entirely preventable

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 weeks ago (1 child)

    Not only do I use them, I have worked directly on similar but much smaller models.

    If they refuse to give the prompts that caused it, then they are just marketing materials for the AI companies.

    "Anthropic says" is the clue here. "Open AI says" "Google says" etc.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 0 points 2 weeks ago

    If you have used them, then you know that they can do unexpected things when asked to do something vaguely, or unrelated. You're making it sound like they're remotely deterministic, and that's quite untrue. For all we know, anthropic asked an agent to gather voter awareness information and it did this. Which btw that wouldn't mean this article is not marketing... It's just patently untrue that an LLM does only what you tell it to.

  • permalink
  • fedilink
  • source
  • parent