393
Huggingface have scraped the entirety of Github. (huggingface.co)
submitted 3 months ago by to c/programming@programming.dev
108 comments fedilink hide all child comments
 

Would be a terrible shame if lots of people opted out.

If you are a EU citizen you might also want to write a complaint to privacy@huggingface.co because they are collecting your personally identifiable information in machine-readable form which they are distributing to third parties.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 3 months ago (11 children)

don’t steal the repositories

How is this remotely stealing?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 11 child comments
    •
  • [–] 17 points 3 months ago (1 child)

    It's not, but it may be violation of licenses. And also, if it has personal information on it, that's probably illegal under the GDPR.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 3 months ago

    but it may be violation of licenses

    They excluded code with non-permissive licenses apparently:

    Each file is labelled permissive (at least one permissive license detected, no conflicting non-permissive license), no_license (no licenses detected, or only non-license legal texts such as CLAs), or non_permissive. The permissive allowlist follows the Blue Oak Council list plus licenses categorized as Permissive or Public Domain by ScanCode. Files classified as non_permissive are excluded from both released datasets.

    also, if it has personal information on it, that’s probably illegal under the GDPR.

    It's all public so I would be extremely surprised if that were the case.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 3 months ago* (7 children)

    the method on github is to fork it not steal all the data in an external storage for external purposes without consent of the user.

    edit: you can also report their whole account to github here: https://support.github.com/contact/report-abuse?category=report-abuse&report=bigcode-project&report_id=110470554&report_type=user

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 5 points 3 months ago (6 children)

    I'm pretty sure they just cloned the repos. That's how GitHub is designed to work. Have you never cloned a repo from GitHub?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 5 points 3 months ago (4 children)

    Yes, but I used it under the licence terms of the original developer.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 0 points 3 months ago (3 children)

    So have they. They filter by license - see my other comment.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •