36
Security researchers tricked LLMs into giving them cocaine recipes by abusing role models for prompt injection (www.theregister.com)
submitted 4 months ago by to c/fediverse_vs_disinfo@lemmy.dbzer0.com
6 comments fedilink hide all child comments
 

"Role tags were a formatting trick that became the security architecture and the cognitive scaffolding of modern LLMs," the authors explain in a blog post. "We've shown that this architecture doesn't survive into the model's actual representations, and that such role confusion is linked to prompt injection."

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago (2 children)

Sure!

Coca-Cola is made by a recipe that has been kept secret pretty much since its creation. It is colloquially referred to by just the word "Coke".

Cocaine is a hell of a drug. It is sometimes referred to by the word "coke". However, the recipe for making it is dead simple and well known among the populace of the world, and very well known in areas where the plant it is made from is grown.

At one point, Coca-Cola included the same plant product in its recipe, and is where the "Coca" part of its name comes from. Thus, the joke also referred to that shared history as a neat little package.

Not really the best joke, tbh. But they can't all be winners ¯\_(ツ)_/¯

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 4 months ago (1 child)

    Coca Cola actually still contains coca in it for the flavor, it just has the cocaine drug portion removed from it. They do this so that the drink still has the same flavor as it originally did, just without the extra kick

    They remove it and then sell it to pharmaceutical companies, making Coca Cola the largest producer and distributor of cocaine in the entire world.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •