518
Dev Says He’s Getting Threats After Leaving a Booby Trap for Vibe Coders (gizmodo.com)
submitted 5 months ago by to c/fuck_ai@lemmy.world
111 comments fedilink hide all child comments
 

One critic called the move “petulance beyond measure.”

you are viewing a single comment's thread
view the rest of the comments
[+] -33 points 5 months ago (3 children)

Both sides have a point. The great thing about open source projects is that any malicious code (which this was and why he's getting threats) will get theoretically caught before too much damage is done. On the other hand, anyone deploying AI agents for commercial purposes should have security measures put in place to prevent exactly this threat scenario. It's like the most obvious prompt injection attack; it's obnoxious to pretend to be surprised by it at this point as if basic security measures don't apply to you and your tools because it's inconvenient.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] 58 points 5 months ago

    The code wasn't malicious. The prompts their LLM'S followed were in plain text. They failed to read. That's on them.

    I can say that this person should have considered what might happen if someone fell for it, and death threats were certainly firmly in the realm of possibilities, but let's not pretend this wasn't their own fault.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 27 points 5 months ago

    I saw the prompt, you know what it does? it attempts to delete the source code of the project from the system. that's it. it's not supposed to go off and delete the whole system or anything else.

    you would have to be an absolute retard to allow AI to run unprompted on your system and allow it to make system calls. anyone who got caught by this "injection" attack deserves the same amount of sympathy a fool gets for piping a web script directly through bash without reading it first.

    you get what you get and your don't say shit.

  • permalink
  • fedilink
  • source
  • parent