What's wrong with copyleft code?
post
replies:
Olmo might be the closest you can get
https://allenai.org/olmo (website straight up crashes my phone)
https://huggingface.co/allenai/OLMo-7B
Olmo is trained on the Dolma dataset, “a diverse mixture of web content, scientific papers, code, public-domain books, social media, and encyclopedic materials”, so this might be a more ethical source, but I’m not sure if it’s copyleft free.
https://huggingface.co/papers/2402.00159
You could rent a cluster of GPUs and remove copyleft material and retrain
replies:
Just because code isn't copyleft doesn't mean it does not require attribution or consent to being scraped by LLMs!
Also, I don't think there's any model out there that has asked for permission for scraping, and if any claim they do, they're almost certainly liars.
In my opinion, you should ideally avoid LLMs if you can do the task yourself. It definitely has some genuine applications, especially translation, but functionally, ethically, and legally, it is not a suitable option for most people.
replies:
So you want an LLM that says they don't train on "copyleft" code, even if they do, so you can virtue signal to yourself without facing any kind of real inconvenience?
How about you start by clarifying what you mean by "copyleft" as that's not a standard term, and it means different things to different people. I've seen it used to refer to MIT style licenses, GPL style licenses, and public domain stuff... All of which are very different things.
replies:
all 13 comments