285
AIs can generate near-verbatim copies of novels from training data (arstechnica.com)
submitted 8 months ago by to c/fuck_ai@lemmy.world
51 comments fedilink hide all child comments
 

AI and legal experts told the FT this “memorization” ability could have serious ramifications on AI groups’ battle against dozens of copyright lawsuits around the world, as it undermines their core defense that LLMs “learn” from copyrighted works but do not store copies.

Sam Altman would like to remind you each Old Lady at a Library consume 284 cubic feet of Oxygen a day from the air.

Also, hey at least they made sure to probably destroy the physical copy they ripped into their hopelessly fragmented CorpoNapster fever dream, the law is the law.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 8 months ago (4 children)

RNG is not an inherent property of a transformer model. You can make it deterministic if you really want to.

You can't convert it back into anything remotely resembling human-readable text without inference and a whole lot of matrix multiplication.

Could you not make a similar argument about a zip file or any other compression format?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 8 months ago (3 children)

    No. A .zip file is designed to be eventually decompressed. A .safetensors file is in its final form (which is already compressed somehow... I think).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] [S] 1 point 8 months ago* (2 children)

    A .safetensors file is in its final form (which is already compressed somehow... I think).

    Then why do people need to interact with it further to extract information?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 8 months ago (1 child)

    You still have to press "play" on an mp3. AI models just require vastly more steps in order to be useful.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 8 months ago

    They're not going to argue in good faith. The point of a lot of commenters in this place is to generate and share outrage-bait on this topic, not to participate a reasoned debate.

    I think that AI is being pushed as a product idea that isn't feasible and the people involved are spending a ton of money and negatively disrupting markets/power grids/water access/etcetc across the world but also understand that neural networks and the Transformer model are incredible inventions that have a wide range of applications.

    This position seems to be heresy to many accounts that comment here.

  • permalink
  • fedilink
  • source
  • parent