you are viewing a single comment's thread
view the rest of the comments
[–] 30 points 6 months ago (7 children)

identify AI that has used copyrighted material

but, that is basically all modern "AI".

(the only LLM i've heard of which actually claims that its training corpus is freely licensed is Apertus...)

  • source
  • hideshow 7 child comments
  • [–] 2 points 5 months ago (2 children)

    Traditionally, with machine learning, it is standard practice to mention what datasets and/or pretrains were used, so that the results are transparent and can be replicated. With GPT-2, it was "the common crawl and our own crawled 8 million web pages", and since then I feel it's mostly left out, falling back on (easily manipulated) benchmarks instead 😬

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 5 months ago* (1 child)

    Yep. But just providing a list of millions of URLs and saying "we trained on this" as some models in the past have done also didn't make it possible to replicate; by the time anyone re-fetches them all, many of the URLs will inevitably have changed or disappeared.

  • source
  • parent
  • hideshow 1 child comment