36
Security researchers tricked LLMs into giving them cocaine recipes by abusing role models for prompt injection (www.theregister.com)
submitted 4 months ago by to c/fediverse_vs_disinfo@lemmy.dbzer0.com
6 comments fedilink hide all child comments
 

"Role tags were a formatting trick that became the security architecture and the cognitive scaffolding of modern LLMs," the authors explain in a blog post. "We've shown that this architecture doesn't survive into the model's actual representations, and that such role confusion is linked to prompt injection."

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 months ago (1 child)

Coca Cola actually still contains coca in it for the flavor, it just has the cocaine drug portion removed from it. They do this so that the drink still has the same flavor as it originally did, just without the extra kick

They remove it and then sell it to pharmaceutical companies, making Coca Cola the largest producer and distributor of cocaine in the entire world.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •