AI as a tool for unleashing the devastating power of unregulated capitalism against its enemies, what a brilliant coup by the techbros and banksters. Not to mention the actual breakdown of community sites by AI scrapers, mostly using dirty botnet hacking techniques. This poison will eat itself one way or another. The question is: what can we do to make this happen sooner than later?
post
There are upsides.
Software freedom is usually associated with FOSS (legal and public exchange), but there's also scene (underground exchange based on personal connections).
The latter, of course, is not quite the heaven many people have learned to believe in, with everything being a public verified project with all the source code visible and legal to use for every purpose.
But the latter also has advantages, it's a non-neutered culture with all the old anarchist and hacker substrate.
Any heaven offered is usually a trap anyway.
I wonder if the whole purpose of promotion of FOSS by big companies was, long-term, this. Finding some way to abuse openness and collect for free the resource that becomes digital oil in the next stage, but only for those who own the foundries - computing resources for ML, that is.
Essentially almost all FOSS software is under an OSS license of some sort, which allows anyone to re-use their code or software as long as what re-uses it also remains free and open source or at least having at least as open/permissive of a license policy as the original work/code.
LLMs ignore that, hide it behind a subscription, and use it to train their models for selling to soulless corporate entities who will never ever allow their code to be in the FOSS world, thus, breaking the contract.
It's not even an implicit contract, it's explicit, and LLM companies are ignoring this and using their investment to squash any FOSS projects that want to challenge them in court on it.
There is absolutely no way you're using an LLM to rewrite the Linux kernel in any way. That's not what they do, and whatever it produces wouldn't be even a fraction of effective as the current kernel.
They're text prediction machines. That's it. Markov generators on steroids.
I'd also be curious about where that 15-20% productivity increase comes from in aggregate. That's an extremely misleading statistic. The truth is there are no consensus data on any productivity improvements with LLMs today in aggregate. Anything anyone has is made up. It's also not taking into account the additional bugs and issues caused by LLMs, which are significant, and also not a thing you want to have happening on every PR with kernel code, I promise.
Regardless of all of that, the companies with these LLMs are using free software to train their models to make money without making their models free and open source or providing a way for people to use it for free/open source projects, so this is a clear violation of every single FOSS license model I'm familiar with (most commonly used is the Apache one).
TL;DR; they are stealing code meant to be free and public with any derivative works, profiting off it, and then refusing to honor the license model of the code/project they stole.
This is illegal. The only reason why we're not seeing a lot about it is these FOSS generally have no money and are not going to sue them and potentially lose a substantial sum of their negligible funds in court. That's it. Otherwise, what they are doing is very illegal. The sort of thing any professional software development company you work for's legal team warns you about the second you start using an OSS project in your for profit business application codebase.
LLMs get away with it because $$$$$$$$$$$$$$$$$. That's it.
Edit: added link to security article with LLMs
Training proprietary LLMs on open source code is shitty, rent-seeking behavior, but not really a unique development, and certainly not something that undermines the core value of open source.
Destroying "share alike" doesn't undermine the core value of open source? What IS the core value?
You can't "train" on code you haven't copied. That is kind of obvious, right? So did they have the right to copy and then reproduce the work without attribution?
As i understand, Linux is under a license (GPL) which explicitly prevents closing the reuse of its code. So it's all about legal interpretation of "reuse" and so far the GPL stands up against abuses. I suppose that a company specifically targeting the source code for the intend of creating another OS might need to hire more lawyers than developers with far from certain results. But who knows, in a world where billions $ are free as soon as "AI" is mentioned in a business plan.
So the issue is that AI strips the provenence of the open source contributors and then the output it spits out based on the data it consumed is not subject to the same open source licensing that applies to the open source projects, and these AI companies make profit from this but the open source contributors don't see a dime. We'll that's kinda always been the case though, so many amazing open source projects get coopted by tech giants like Microsoft and then repackaged as proprietary software for a profit, embrace, extend, extinguish, but back then they needed a team of developers to do that, now it's more automated I guess with AI
Copyleft software isn't supposed to just be repackaged as proprietary, though. Permissive licenses, sure - but people know what they were signing up for (presumably) there.
I believe the discourse that the FSF has managed to spread is greatly harming for the developers and communities. They are copyleft absolutists who believe no restrictions should be imposed in the use of our code, not even to megacorps that massively profit from it with oftentimes nothing in return.
I am in the process of making a revised version of the copyfarleft Cooperative Software License with a lawyer and once its done I will switch most of my development to it, with a clear warning for any company that uses my code to fuck off (or pay me I guess).
If the code used to train LLM was released with copyleft license then there’s only way to interpret how the output should be licensed. There’s nothing absolutist about it, just how GPL and such were intended to work. If you don’t like it, don’t use it to train models.
You don't want copyleft. What you're looking for is called "copyright"
No, its copyfarleft. Both it and copyleft USE copyright. I recommend you the Telecommunist Manifest on this topic, and you can find the stupid take of the FSF on this in here. I don't want copyleft anymore, I don't think it is enough. The FSF's justification is hipocritical and coward as they state that "...embedding that desire (ethical behavior) in software license requirements will backfire, by legitimizing fundamentally unjust power over others" while using the power of copyright themselves, and in a world where we already see bad actors profiting from collective work.
Edit: Adding to this, the first word of the GNU GENERAL PUBLIC LICENSE is Copyright lmao
destroy the bargain that made free software spread like wildfire
If you didn't want your code to be used by others then don't make it open source.
Do you understand how free software works? Did you read the post? I'd love to clarify, but I'm not going to rewrite the article.
Also - this conclusion is ridiculous:
By incorporating copyleft data into their models, the LLMs do share the work - but not alike. Instead, the AI strips the work of its provenance and transforms it to be copyright free.
That is absolutely not true. It doesn't remove the copyright from the original work and no court has ruled as such.
If I wrote a "random code generator" that just happened to create the source code for Microsoft Windows in entirety it wouldn't strip Microsoft of its copyright.
That is absolutely not true. It doesn't remove the copyright from the original work and no court has ruled as such.
Sorry, I just got around to this message. That is the idea of the provenance -- clearly, the canonical work is copyright. It is the version that has been stripped of its provenance via the LLM that no longer retains its copyright (because as I pointed out, LLM outputs cannot be copyright).
That doesn't make it "no longer copy-written" though. The original copyright holder retains their copyright on it. I can't see any court ruling otherwise.
The output of the LLM can be incorporated into copyrighted material and is copyright free. I never claimed that the copyright on the original work was lost.
I highly doubt the law is settled on this topic and you're assuming it is. I can't see the courts accepting that your duplicate version of my work created through "magic" is not going to be a violation of my copyright. Especially if my work was included as input to the "magic box" that created the output.
Yes. And this is kinda hand-wavy bullshit.
By incorporating copyleft data into their models, the LLMs do share the work - but not alike. Instead, the AI strips the work of its provenance and transforms it to be copyright free.
That's not how it works. Your code is not "incorporated" into the model in any recognizable form. It trains a model of vectors. There isn't a file with your for loop in there though.
I can read your code, learn from it, and create my own code with the knowledge gained from your code without violating an OSS license. So can an LLM.
I can read your code, learn from it, and create my own code with the knowledge gained from your code without violating an OSS license. So can an LLM.
Not even just an OSS license. No license backed by law is any stronger than copyright. And you are allowed to learn from or statistically analyze even fully copyrighted work.
Copyright is just a lot more permissive than I think many people realize. And there's a lot of good that comes from that. It's enabled things like API emulation and reverse engineering and being able to leave our programming job to go work somewhere else without getting sued.
No you can't. In the same way you can't watch a Mickey mouse movie and then draw your own Mickey mouse from what you recall from the movie.
Copying can be done manually by memory, it doesn't need to be a 1:1 match. Otherwise you could take a GPL licensed file, change the name of 1 variable, and make it proprietary code.
LLMs are just fancy lossy compression algorithms you can interact with. If I save a Netflix series in my hard drive, then re encode it, it is still protected by copyright, even if the bytes don't match.
No you can't. In the same way you can't watch a Mickey mouse movie and then draw your own Mickey mouse from what you recall from the movie
Yes, I can. I can create a legally distinct mouse-bases cartoon.
You're right that if an llm gives you copyrighted code that it would be a potential problem. But the article saying that it somehow "strips the code of any copyright" is ridiculous.
Is there anything in the LLMs code preventing it from emitting copyrighted code? Nobody outside LLM companies know, but I'm willing to bet there isn't.
Therefore, LLMs DO emit copyrighted code. Due to them being trained on copyrighted code and the statistical nature of LLMs.
Does the LLM tell its users that the code it outputted has copyright? I'm not aware of any instance of that happening. In fact, LLMs are probably programmed to not put a copyright header at the start of files, even if the code it "learnt" from had them. So in the literal sense, it is stripping the code of copyright notices.
Does the justice system prosecute LLMs for outputting copyrighted code? No it doesn't.
I don't know what definition you use for "strip X of copyright" but I'd say if you can copy something openly and nobody does anything against it, you are stripping it's copyright.
I don’t know what definition you use for “strip X of copyright” but I’d say if you can copy something openly and nobody does anything against it, you are stripping it’s copyright.
Just what was stated in the fucking article
By incorporating copyleft data into their models, the LLMs do share the work - but not alike. Instead, the AI strips the work of its provenance and transforms it to be copyright free.
That's bullshit.
I can read your code, learn from it, and create my own code with the knowledge gained from your code without violating an OSS license.
Why is Clean-room design a thing then?
create my own code with the knowledge gained from your code
Not copy your code. Use it to learn what algorithms it uses and ideas on how to implement it.
No, sometimes they spit out shit verbatim.
You are assuming way too much about how the models work.
The article is about how LLMs circumvent copyleft licenses like GPL
"If you didn't want people in your house then don't have doors" buddy... That's not how anything works.
If you put a fucking sign on your door saying "come on in!" then don't be angry when people do?
We do hang signs on the doors but they say something sightly different
https://en.wikipedia.org/wiki/Open-source_license
Public domain licenses are truly as you describe, but copyleft licenses are far from that. There are also many "source available" licenses which aren't open at all. Just because you can read a book doesn't mean you can print and sell it.
Who is wholesale copying OSS code and releasing it under a non-compliant license with an LLM?
Uh... Lots of people? That's kinda the problem. Maybe use a search engine. There are plenty of cases of LLMs 'laundering' copyleft code into (often) proprietary codebases. And that's just the most blatant and brain-dead obvious example; the use of GPL code to train commercial models is a bit more subtle and nuanced but no less nefarious, and the laws are currently unequipped to handle that part at all.
You don't need an LLM to find and copy GPL code. The LLM isn't adding anything new here.
These guys: AI bad! It takes jobs!
Also these guys: Check out this thumbnail tho!
Also:
https://eyeofthesquid.com/ai-is-breaking-the-moral-foundation-of-modern-society-a145d471694f
AI renders [Rawls' and Nozick's] disagreement moot by violating the premise they shared. When your talents become training data harvested without consent, when your creative work becomes parameters in a model, you’re being used as a pure instrument. Not for social benefit (Rawls’s concern) and not with your voluntary consent (Nozick’s requirement). You’re raw material extracted for someone else’s capital accumulation. Both philosophers would recognize this as the instrumentalization they were trying to prevent.
I've started hearing the term "reverse centaur" being used to describe this situation:
In automation theory, a “centaur” is a person who is assisted by a machine. You’re a human head being carried around on a tireless robot body. Driving a car makes you a centaur, and so does using autocomplete.
And obviously, a reverse centaur is machine head on a human body, a person who is serving as a squishy meat appendage for an uncaring machine.
Cloudflare drafted the Content Signals Policy which complement licenses.
The Content-Signal directive works by signaling your preference of either allowing (yes) or disallowing (no) certain categories of AI actions
It references existing EU law, ie the DSA. It's good to set clear policy and terms of use scrappers can parse. It's new so I suspect most don't honor this yet. But once they get caught, the website could argue this violate term of use.
# ANY RESTRICTIONS
# EXPRESSED VIA CONTENT
# SIGNALS ARE EXPRESS
# RESERVATIONS OF RIGHTS
# UNDER ARTICLE 4 OF THE
# EUROPEAN UNION DIRECTIVE
# 2019/790 ON COPYRIGHT AND
# RELATED RIGHTS IN THE
# DIGITAL SINGLE MARKET.
IANAL, consult with a law profesionnal for advice on how to enforce this legally.
I think the HOW and WHY here are really important:
By incorporating copyleft data into their models, the LLMs do share the work - but not alike. Instead, the AI strips the work of its provenance and transforms it to be copyright free.
That is because the US copyright office has rightly advised that AI generated works are not copyrighted.
So crucially, here, we have them gobbling up methods and ideas and passing them off as their own, stripping the code of its copyright protection.
There's a whole other argument to be made about whether the cod actually works, but that feels too close to being apologist for me.
top 22 comments