26
Phishing / spam detection with local LLMs? (lemmy.ca)
submitted 1 month ago by to c/selfhosted@lemmy.world
14 comments fedilink hide all child comments
 

I've tried giving screenshots of phishing emails to a local Qwen instance and so far it always correctly detected it as scam, even points out the exact elements that it based its judgement on. Sending screenshots to it ad-hoc isn't too scalable for family and friends. I'd like to be able to either forward emails for screening, or perhaps have it screen everything from a mailbox.

Has anyone done anything like this? Is there anything self-hostable that does this?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 month ago (1 child)

I only read about that today, so I hadn't even considered that angle. They're doing some cool stuff in that space. jeff is the self-hostable one that does best as far as I know.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    You actually have a lot of options in this space. You can take the prefill engine of just about any LLM and turn it's transformer into a classifier by lobotomizing out the decoder. You can also use a diffusion model on single pass to surprisingly competent result.

    If Jeff looks easy enough to deploy by all means start there, but don't discount the idea if Jeff sucks; you have a lot of options.

  • permalink
  • fedilink
  • source
  • parent