393
Huggingface have scraped the entirety of Github. (huggingface.co)
submitted 3 months ago by to c/programming@programming.dev
108 comments fedilink hide all child comments
 

Would be a terrible shame if lots of people opted out.

If you are a EU citizen you might also want to write a complaint to privacy@huggingface.co because they are collecting your personally identifiable information in machine-readable form which they are distributing to third parties.

you are viewing a single comment's thread
view the rest of the comments
[–] 20 points 3 months ago* (last edited 3 months ago) (1 child)

We want to give developers agency over their source code by letting them decide whether or not it should be used to develop and evaluate machine learning models.

crawled directly from GitHub and built to pre-train code LLMs with full-repository context

Repositories that opted out are removed from the dataset before each patch release.

"agency"

Which AI company will not use v1 which has all of the data but will use later patch releases instead which have less data?

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •