Potential Linux security vulnerabilities.
post
This is misleading.
Edit: "misleading" was the wrong word. I was just pointing out that showing data from 4.x to 5.x, 5.x to 6.x also would have made this post more meaningful.
Linux kernel full releases always have CVEs shortly after them because new features, drivers, memory handling tuning, and other capabilities arr introduced, and people (or ai) hammer away at them as soon as they appear.
I acknowledge that the bump has more amplitude because ai tools accelerate this, but this graph isn't the shocker you think it is.
The Linux kernel team has a policy that all bugs are potential security threats and should be assigned a CVE. That does not mean these CVEs are exploitable. Many will be for features that aren't even enabled on typical systems.
LLMs are allowing researchers to locate known classes of bugs more easily than an exhaustive search with other tools. Security researchers are driving the bus here. Not the tech companies or their products. Don't believe the marketing hype. The tech companies want us to be dependent on subscriptions to their products and deskilling is part of their agenda. Good stuff is coming from security researchers using expertise and tooling.
How many of them are new?
oh wow fam, ai is protecting us from... ai
how many are introduced by new ai code?
Assuming that Linux kernel team continues to use the same review process they always had, there's zero reason to think that there would be an increased rates of bugs due to LLM generated code. This seems to be something people without programming experience don't understand. Code quality isn't premised on trust, it's a product of the development process. Projects ensure quality by having specifications, tests, doing code reviews, and so on. As long as the practices the kernel team has established continue to be applied, they will catch the bugs made by LLMs or humans exactly the same way.
Idk man. I've certainly become more lenient in Code Reviews because I have to do like 5 a day instead of 2-3 a week, all with like 2k lines of changes. I literally don't have the time to fully read tests anymore, I mostly just skim them and check whether they have an assess statement that looks somewhat reasonable.
Hell, I've recently had a meatpuppet of a coworker brag about how his implementation of a Card component for the UI library had 199 tests. I'm so glad I wasn't assigned to review that shit. But it sure looks great to the higher-ups 🫠
Hopefully working on the Linux Kernel doesn't suck as much as working for a big corp.
Large corps always end up implementing shitty practices because business practices are driven by pencil pushers. Even before LLMs, some of the most soul crushing jobs were found at large corps working with shit like J2EE. That's nothing new really.
At my job, we use LLMs, but nobody is making 2k loc PRs all of a sudden, and we still pair up to review code, and generally work at human speed.
As long as the practices the kernel team has established continue to be applied,
Right, the question is, if they're changing the writing code practices, do you think there might be any change in the reviewing process?
I've seen no evidence of that so far. I also fail to see how writing code practices are related to the review and quality control process. These things aren't linked in any way that I'm aware of.
The ability to comprehend code underlies both of those and is trained by both. Doing less of one reduces your training.
LLM use leads to skill deficits, it's shown up in studies but also just, use it or lose it.
The only studies I'm aware of used tiny samples and produced muddled conclusions. If you have some conclusive empirical research then do feel free to share it though. Meanwhile, using LLMs doesn't mean doing less, it just means focusing on different things. The skill deficit here is the same kind as the skill deficit people have using punch cards or writing assembly by hand today. As more aspects of coding become automated, different things become relevant and that's what people shift their attention to.
Not sure about AI specifically, but the number of new bugs seems to be going down in new releases:

If this is primarily fixing old issues, over time we should see a sharp drop off and then even fewer security fixes then before due to fewer being introduced, due to being caught by AI upfront.
On the other hand, if AI is introducing more issues than it is resolving, we’ll see the baseline of security issues being found permanently addressed.
People here can't seam to get past there built in kneejerk reaction to anything AI related.
get past there built in kneejerk reaction to anything AI related
Maybe because it's not kneejerk. We know how AI works, what it takes to have it running, how it was built, who controls it. For many people, the ends do not justify the means (and that's if we assume fixing CVEs on Linux is somehow worth the very problematic ends AI is leading us towards anyway).
Some people seem to be unable to fathom the fact that AI can be useful in some circumstances, always assuming the worst despite no evidence to suggest it.
AI can be useful in some circumstances
And the point is that this statement can be true AND we can still think AI should cease to be used. The "useful in some circumstances" benefit does not justify the ethical and environmental cost.
What would your preferred outcome in this situation be then? The bad guys are going to use AI to find exploits. What should the good guys do?
Dollars to donuts says they don't have a preferred outcome, or at least not anything that amounts to more than wishful thinking.
It's crazy how many people have only reactionary opinions that are largely divorced from reality when it comes to humanity's relationship with AI.
What should the good guys do?
Legislate AI away, except for the already existing open models that run on consumer-grade GPUs and are therefore orders of magnitude weaker and can't be used to break down any systems.
Or penalize heavily any company developing a model that is subsequently used to invade a system, stopping this madness of separating the models from the operators of said models.
Legislate AI away
Why on earth would the whole world agree to that while the economic incentives (to name just one) to do exactly the opposite are so high
Legislate AI away
Yes, because that has worked so well in the past for alcohol, cannabis, homosexuality, or nuclear proliferation.
existing open models that run on consumer-grade GPUs and are therefore orders of magnitude weaker and can't be used to break down any systems.
This class of models is already perfectly capable of finding and exploiting vulnerabilities in software, and is within spitting distance of the frontier.
Or penalize heavily any company developing a model that is subsequently used to invade a system.
Yeah, that case will be on the docket right behind U.S.A. vs Lockheed Martin, Northrop Grumman, and Raytheon surely.
Do you seriously believe any of these are within the realm of possibility, or even believability?
Thank you for doing this for me.
Yes, because that has worked so well in the past for alcohol, cannabis, homosexuality, or nuclear proliferation.
A list of examples where prohibition didn't work is quite far from an argument that it never works, Plato. Leaded gasoline, CFCs, asbestos, DDT, should I go on?
This class of models is already perfectly capable of finding and exploiting vulnerabilities in software, and is within spitting distance of the frontier.
If you think frontier models are close to Qwen running on your 5090, you're completely devoid of any knowledge on the subject and therefore this discussion becomes meaningless.
Your examples of prohibition and mine are not the same. Mine were purposefully chosen because they are or were contentious, just like AI is now.
Your examples, on the other hand, outline situations where we were using something harmful that we did not realize at the time was harmful. Once that realization came to light, everyone agreed to stop. If you want to say this is the current situation with AI, then that's coherent. This is my olive branch to you.
As for local models if you want to maintain that DSv4.1, GLM-5.3-f, M-3.1, or ther ilk are not near frontier-level. Then, I guess you are allowed to be wrong.
As for local models if you want to maintain that DSv4.1, GLM-5.3-f, M-3.1, or ther ilk are not near frontier-level. Then, I guess you are allowed to be wrong.
lol
Your dialectic skills truly know no bounds.
Qwen 3.8 27b is now on par with claud fable 5 acording to this benchmark local llms are only a few months behind frontier models and are capable of many things.
Fable is rank 5, Qwen 3.8 (with nothing claiming it's the reduced 27b one) is rank 29, fuck you are you talking about.
That's fable 5.1 I said fable 5. Also it seems like the link I sent wasn't for the benchmark I meant to send. Try to find the one for code rather than agentic work. Qwen 3.8 27B scores 1590 while Claude fable 5 scores 1624 which is a very slim margin considering fable 5 was one of, if not the best model when it was released.
I have softened very VERY slightly on AI code. If it can identify genuine issues than that is fine. It is when folks just trust it blindly and just send 50 commits without understanding a thing or even remotely testing it, that is just crazy. But then on the flip side, yeah all the other issues probably aren't worth it.
It is complicated at times but then things like this always are. The most successful evil always has some claim to virtue.
Alas, occasionally you have to walk with the devil to achieve some good. One just has to weigh up if it is worth it.
I once asked Stallman about how he used to build and run GNU tools before having the Linux kernel. He was using a proprietary Minix system as a means to get work done until there was a better alternative. I mean running a proprietary system is one thing, burning through the amazon with 100 quintillion tokens is very different.
the very problematic ends AI is leading us towards anyway.
Please Mr. Time Traveller. Tell us about the future.
A plane's wings are burning and it's heading towards a mountain, opposite way to the nearest airport. Need a time machine to figure out what's about to happen?
I asked you to provide specifics about the future that AI is leading us towards, not a summary of the early 21st century. However, I understand how the question could have been confusing to one such as yourself who swims in the steam of prescience.
Or, if we must stick to metaphor, where is AI in this airplane?
Your dialectic skills truly know no bounds.
Edit: I responded to the wrong person.
Just like most technologies, they aren't all bad or all good. In this case it's been good.

all 88 comments