329
A Project to Poison LLM Crawlers (rnsaffn.com)
submitted 10 months ago by to c/technology@lemmy.world
105 comments fedilink hide all child comments
 

Website operators are being asked to feed LLM crawlers poisoned data by a project called Poison Fountain.

The project page links to URLs which provide a practically endless stream of poisoned training data. They have determined that this approach is very effective at ultimately sabotaging the quality and accuracy of AI which has been trained on it.

Small quantities of poisoned training data can significantly damage a language model.

The page also gives suggestions on how to put the provided resources to use.

you are viewing a single comment's thread
view the rest of the comments
[–] 25 points 10 months ago (3 children)

A test they’ll have to pass.

This makes me chuckle, as they invented euphemisms like 'hallucinations' because their LLM models can't do what they promise. Fabulous marketing, but clearly they didn't do enough testing.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 4 points 10 months ago (1 child)

    as they invented euphemisms like ‘hallucinations’

    Seems like a pretty accurate word to use, no? Could also use fabrication, concoction, phantom, or something else? I think "lie" and its synonyms are not accurate, since that requires intent. Since the LLM does not have intent, it cannot "lie".

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 12 points 10 months ago

    That's why "bullshit," as defined by Harry Frankfurt, is so useful for describing LLMs.

    A lie is a false statement that the speaker knows to be false. But bullshit is a statement made by a speaker who doesn't care if it's true or false.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 10 months ago

    I said, in other words, that it doesn't matter what they do until this problem is solved. So if this is described as some sort of rebellion against AI (or "AI"), then no. At the point where it becomes dangerous technology in itself and not just for economy, it won't be.

  • permalink
  • fedilink
  • source
  • parent