you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 2 months ago* (last edited 2 months ago) (6 children)

It says this works also for text copied from Claude and pasted into other applications. How is that possible? What degree of metadata storage is possible in text?

  • source
  • hideshow 6 child comments
  • [–] 9 points 2 months ago

    The mechanism happens in the way LLMs generate text sequentially. So as the LLM generates text, each time the LLM encounters a choice between two or more equally probable words and has to pick one, it chooses from a known pseudorandom key instead of its previous practice of actually relying on a source of randomness.

    If you run the text through a checker script that tries to predict the next word, and takes note of every choice made in any given fork in the probabilistic flowchart, you can see that whole sequence of choices and compare to whether it matches a known key.

    You'd need to know the model itself well enough to know when the text reaches a particular fork, and what the choices are in that fork, and the key itself, so even OpenAI/Google/Anthropic may not be able to run this watermark detection on their competitors' models. But they'd be able to know it themselves, for their own models.

  • source
  • parent
  • [–] -3 points 2 months ago (4 children)

    Pattern matching, maybe an extra space every 5 word, ensure the 3rd sentence starts with a T and ends with a P, etc.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 8 points 2 months ago (3 children)

    They said it'd even work if the text was substantially edited by the user, though. Maybe there's multiple layers of redundancy so it just degrades the watermark but it takes a lot of editing to completely dilute it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 10 points 2 months ago (2 children)

    I can't think of any pattern that is supposed to survive edits that wouldn't create a ton of false positives in existing works.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 months ago

    I think the first person was right. It's probably just a pattern based on this part:

    It may also survive certain edits. However, the company warned that extensive rewriting, paraphrasing, translation, or mixing the content with human-written material could weaken or remove the detectable signal.

  • source
  • parent