393
Huggingface have scraped the entirety of Github. (huggingface.co)
submitted 3 months ago by to c/programming@programming.dev
108 comments fedilink hide all child comments
 

Would be a terrible shame if lots of people opted out.

If you are a EU citizen you might also want to write a complaint to privacy@huggingface.co because they are collecting your personally identifiable information in machine-readable form which they are distributing to third parties.

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 3 months ago (1 child)

Mine are all GPLv3 or forks of other repos and they are listed. I'm sanguine because the license allows for study and if it's good enough for humans I don't see why it's not for clankers.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 6 points 3 months ago

    For me, and a few other projects I checked, it only has non-GPL repos. But it also does not have everything that isn't GPL, despite the repos being much older than the cut-off date. But it does have repos without a license, which they are simply not allowed to copy.

    I wonder if those repos have been deduplicated, and one of the forks (on some other person's account) is included instead. Unfortunately you can only search the first 5M records via the website, and I don't have time to play around with the API at the moment, so I could neither confirm nor deny that possibility

  • permalink
  • fedilink
  • source
  • parent