245
Using an AI Agent Makes You a Sucker for Phishing Emails: "The real flaw is that the model can’t tell the difference between text it’s supposed to read and instructions it’s supposed to follow." (futurism.com)
submitted 3 weeks ago by to c/technology@lemmy.world
16 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 weeks ago

This is why LLMs should not be used as AI agents. They suck at following simple instructions AND stopping there.

What we need is dedicated translators that turn your instructions into executable code - an AI scripting language, if you will - and use limited language models to process text based on those instructions.

By mixing "code" (instructions) and "data" (text to read / analyze) into these models' training, prompt injection was just waiting to happen.

OpenAI and friends are just repeating Microsoft's mistakes. Remember MS Word viruses? Exactly the same thing.

  • permalink
  • fedilink
  • source
    •