AI might be useful to find some bugs that might otherwise have been missed, but you still need to do the manual work to make sure it's actually valid and produce a proof of concept.
post
We now ban every reporter Instantly who submits reports we deem AI slop. A threshold has been reached. We are effectively being DDoSed. If we could, we would charge them for this waste of our time.
We still have not seen a single valid security report done with AI help.
~ Daniel Stenberg
Source [2025]
---
For those of you who don't want to click into linked in, https://hackerone.com/reports/3125832 is the latest example of a invalid curl report
Source: https://news.ycombinator.com/item?id=43907751 [2025-05-06]
It's worth noting that curl has since seen at least one good AI-assisted report, but in that case the submitter had already done the work of sorting the output and only passing valid issues along.
That was 2025. This year he has stated that there get many AI reports per day and nearly all are real issues. Things have changed a lot in the past few months.
Though CURL didn't restart their bug bounty program so there is no inventive to submit slop anymore.
That was 2025.
Man I'm really starting to empathize with my grandparents and struggling to keep with tech. I used to think it was silly that they said stuff moved too fast when it had been 5 years. Now apparently your opinion on AI is only good for less than 12 months (probably less)
You know those bug reports where the user somehow didn't see the huge bug report right on the front page with 100 comments, pinned to the top of the issues page, and they duplicated it? Where they didn't provide a log or a stack trace, or even their system specs? The kind of report which caused the developers to implement a massive issue template that the user just ignored?
We automated that 😎
That template? — Filled with garbage.
That stack trace? — Contains methods that don't actually exist.
It's not debugging, it's deblowmyfuckingbrainsout.
“So just to make it really clear: If you found a bug using AI tools, the chances are somebody else found it too. If you actually want to add value, read the documentation, create a patch too, and add some real value on top of what the AI did. Don't be the drive-by ‘send a random report with no real understanding’ kind of person. OK?”
Makes sense to me, most of the time the AI output need to be used as input for a human who can then deliver the real value, or at least verify the correctness of the AI output.
The funny thing is that this is the ONE usecase where LLMs can't themselves make anything worse, because if used sensibly it's basically just a black box that pokes at your software until something breaks, the whole point is to break things!
But of course AI-users can't even fucking handle that, they're so utterly incapable of doing any work themselves that "look at the thing and write down things that go wrong and why it went wrong, and check if it has already been reported before submitting your own report" is too much for them to handle.
The morons spamming the list aren't going to read that either, unfortunately.
the linked source is the kernel mailing list.
https://lkml.org/lkml/2026/5/17/896
"
From Linus Torvalds <>
Date Sun, 17 May 2026 14:29:22 -0700
Subject Linux 7.1-rc4
You all know the drill by now - another week, another release candidate.
Things continue to look fairly normal (where "normal" is the "new
normal" with a fair amount of changes). Drivers are about half the
patch, with GPU leading the way as is tradition. But there's a little
bit of everything in driver land.
The rest is mostly networking, core kernel, filesystems, and arch updates.
Some of the documentation updates might be worth highlighting: the
continued flood of AI reports has basically made the security list
almost entirely unmanageable, with enormous duplication due to
different people finding the same things with the same tools. People
spend all their time just forwarding things to the right people or
saying "that was already fixed a week/month ago" and pointing to the
public discussion.
Which is all entirely pointless churn, and we're making it clear that
AI detected bugs are pretty much by definition not secret, and
treating them on some private list is a waste of time for everybody
involved - and only makes that duplication worse because the reporters
can't even see each other's reports.
AI tools are great, but only if they actually help, rather than cause
unnecessary pain and pointless make-believe work. Feel free to use
them, but use them in a way that is productive and makes for a better
experience.
The documentation may be a bit less blunt than I am, but that's the
core gist of it. So just to make it really clear: if you found a bug
using AI tools, the chances are somebody else found it too. If you
actually want to add value, read the documentation, create a patch
too, and add some real value on top of what the AI did. Don't be the
drive-by "send a random report with no real understanding" kind of
person. Ok?
- Linus
"
Better get an AI to manage the mailbox then eh /s
Train it exclusively on Linus's entire mailing list history so that it actively insults poor merge requests and code lol.
Ironically, this is probably the way it is going to go. As we keep going deeper into the information age, managing all the information thrown at us is becoming unmanageable. With the introduction of AI it will get worse, even as AI becomes the only way of handling the influx of information. Using machine learning has been a way to sort information for a long time (spam sorting is a type of AI after all) and present generative AI are an evolution of that.
I dont think thats necessarily true.
FWIW im team "AI can be a useful tool", but on the day when other people's chat bots start emailing my chat bot who summarises it for me im just going to go throw my laptop in the river.
I think Linus has kind of addressed it: if you found it with a tool then we already found it.
Maybe im being naive. IDK. Im so sick of tech just generally.
This is how many spam filters have worked for a very long time. Using an LLM to help with classification could be a real option.
It wouldn't help with determining which security reports are slop and which are real, though.
Short version: AI is not a shortcut to being a Linux programmer and contributor. You still actually need to know how to read/write code and documentation.
Which should be obvious but the hype has brainwashed the masses into thinking they can be overnight successes using AI. 😒
Too bad the old Torvalds has gone, replaced by this mild-mannered gentleman. The idiot submitters could really do with a bit of stern telling-to.
It was a conspiracy from the beginning! AI bros knew they needed to nerf Linus ahead of time in order to succeed!
You’re attributing too much independent though, rationality, intelligence and forward thinking to people that have outsourced their brains to a chatbot - and a meagre one at that. Maybe oooohhh MYTHOS aaaAahhh is recursive self improving???
cm0002 meant it with /s
I don’t know, I can’t tell anymore. I work at Clanker Town, I am knee deep in the braindead, inundated with “ohhh claude code awwww yissss”. Actually, I feel often like I’m nearing the end of a Last Nan Standing type of game and all the rest of humanity has turned into cyber zombies.
So yeah, I might miss this kind of sarcasm. Sorry.
It's worth mentioning that the recent high CVE privilege escalation bugs were discovered by AI.
There is some good, but it's important that the submitters include very clear POCs to make verification trivial for maintainers.
In the hands of experienced researchers, AI can be good.
AI is like any other tool, in the hands of an expert for whatever domain they're using it for, good things can happen.
But like any other tool, in the hands of an amateur, who knows what could happen lmao
What a fucking headline. Just wow. Care to mention the context and the part where he said it was helpful?
Didn't he say it's okay to submit AI slop code "as long as submitters take responsibility"? Didn't he also say AI writes better code than him?
If this wasn't an invitation to submit slop code PRs, I don't know what it was.
You asked for it and now you have it.
I guess it's time to use AI to manage that mailing list...
A completely false and reductionist interpretation of what he said.
Didn’t he also say AI writes better code than him?
Unless I'm mistaken, he said that about Python. He doesn't usually write Python, see the commit message here: torvalds/AudioNoise@4e524250.
maybe he will finally stop using a fucking mailing list then
@robbo @cm0002 That would be only the form. The amount of tasks to process would not change. His mailing software has very likely a tree view or so.
It would make it easier for people to find if a bug has already been reported, which is what Torvalds mentions as being a problem.
The mailing list for security vulnerabilities is private, in order to keep zero days a secret before they are patched. This is the issue, not the mailing list. Moving away from mailing lists wouldn't solve this because the vulnerabilities would still have to be private.
I've found that the LLMs tend to over classify and nitpick a fair bit, often missing broader context that accounts for the flaw being tolerated or undiscovered.
They're not wrong, but have no context for triage and so give far too many results. It forces you to consider an LLM subscription yourself just to keep up with the other LLM users which is starting to feel like some form of zero sum red queen's race.
The tsunami of reports won't be receding for a while yet, and we can only hope the teams on the receiving end don't drown in it.
It must suck because all chatbot output I seen speaks like a corporate email, just can't get to the point.
Is it really a waste of time if the computer can find the bugs, and the dev can focus on fixing them instead of pulling double duty?
I'll say it till I turn blue in the face. Unless you've been verified as a trusted source, there should be a small donation required for submitting any type of "help" to a project. (pull requests, bug bounties, etc.) Especially since it always requires humans take time out of their day to review the issues and code changes.
If you love the project, donate to it. If you're a trusted source or can't afford even a small donation, get verified.
that entirely depends on the size of the project though, i'm not gonna demand donations for people to contribute to my fucking modpack with 1000 downloads..
Yeah, there's a ton of spam now. My view is that devs should use LLMs themselves to scan for issues, and then see if there's anything to fix. But when it comes to accepting reports or patches, you kind of have to be selective. A lot of the time stuff LLMs will flag can be either hallucinated, or not really an issue. A lot of the reports come from automated systems that don't really do any due diligence to figure out if something is an actual issue that needs addressing. So, I can definitely understand why projects might want to stop accepting random bug reports or code submissions going forward.
Fully automated systems that file issues sound like a nightmare. I hope it’s easy to ban those as they appear.
I figured you'd probably be sympathetic.
The next few years are going to be interesting because we're moving into uncharted territory in a lot of ways. There's a ton of hype around LLMs, and tons of people abusing this tech in every which way, and then there are useful nuggets where people figure out how to apply it effectively. Eventually we'll need to figure out how to suppress the noise and how to start using these things in productive ways.
This is a serious issue! How is it fixed? And how quickly can it be implemented?
Don't just upvote, offer suggestions.
Yeah, I'm a mouth-breather. I don't have any suggestions.
I'm hoping people smarter than me have some ideas.
Perhaps some form of vetting system, where known human reporters get higher priority, and can vouch for other reporters?
top 9 comments