top 80 comments

sorted by: hot top controversial new old
[–] 184 points 4 months ago (38 children)

script kiddies wrecking corporate security is funny
prompt kiddies doing it is just depressing

  • source
  • hideshow 38 child comments
  • [–] 89 points 4 months ago (11 children)

    Didn't think I'd ever side with no script kiddie but at this point fuck it.
    If your company can't be bothered to do the bare minimum in security then yeah I hope the least skilled hacker ever comes along and wrecks it.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 28 points 4 months ago (10 children)

    Thing is, with the latest frontier models, the least skilled person can find a crack in the most secure company around, as long as they can string a few sentences together.

    It isn’t about “bare minimum” anymore. All it takes is a single lapse in vigilance from a single employee, and they’re in… and the LLM doesn’t have to pause to figure out what to do next.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 25 points 4 months ago (9 children)

    Pentesters have access to LLMs too

  • source
  • parent
  • hideshow 9 child comments
  • [–] 33 points 4 months ago

    some hacker unleashes malicious AIs to the internet, breaking it apart cause AI keeps finding vulnerabilities in everything and break things faster than humans can fix

    corporates build corporate internet and the blackwall, which is AI to fight malicious AIs

    Gooooood morning Night City!

  • source
  • parent
  • [–] 11 points 4 months ago* (6 children)

    Yeah, but an LLM's arms race isn't "doing the bare minimum in security", which is what the poster before was saying.

    This is a genuine concern, where whoever has access to the best/most recent/most expensive models can unleash chaos - I'm talking state-sponsored attacks, mega-corp espionage, bored billionaires,...

  • source
  • parent
  • hideshow 6 child comments
  • [–] 7 points 4 months ago (5 children)

    The people you listed were already doing this. The problem is Darrell, the guy who thinks Earth is flat, can also do this.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 7 points 4 months ago* (last edited 4 months ago) (4 children)

    Meh. When you're expecting to have to defend against an army battalion, how much of a thread is Darrell the flat-earther and his AR-15?

    Because if Darrell is doing damage, you've been conquered and didn't even noticed.

    Edit: in case you're not following the thread and feel an urge in your loins to come defend Darrell, do note that I'm not disparaging the issues a dimwit with AI can cause. I'm pointing out that other players will have even larger sticks than your friend Darrell.

    Case in point, Darrell will not have Claude Fable. Others will.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 4 months ago (1 child)

    In this analogy Darrell fires an ICBM, because everyone has access to a ton of those for $20/mo.

    The overall point is that doing (what used to be) the bare minimum is no longer even close to enough. To be considered adequate, you need super ironclad defense, because even low skilled attackers have access to very powerful weapons.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 4 months ago

    You said so yourself, everyone has a ton of those.

    Darrell is firing an ICBM at a place that is being hit with hypersonic hydrogen bombs all the time. Either he's hitting rubble, or a damn impressive defense that he's unlikely to break.

  • source
  • parent
  • [–] 43 points 4 months ago (6 children)

    And no-skilled attackers can buy exploits.

    Claude helping is insignificant to the story.

    The real headline should be:

    At least 14 companies' IT security is practically non-existent

  • source
  • parent
  • hideshow 6 child comments
  • [–] 7 points 4 months ago (4 children)

    It is significant because a random teenager can't google "download exploits" and have them available 5mins later.

    Powerful AI models and agents though are on your fingertips without you even asking.

    Sure, people can buy guns. But what if every person could materialize a chainsaw instead regardless of their skill, maturity, age, or criminal record? 🤔

  • source
  • parent
  • hideshow 4 child comments
  • [–] 23 points 4 months ago (1 child)

    Random teenagers can absolutely google "download exploits" and have them available, that's pretty much always been the case..

    https://www.exploit-db.com/

    Full disclosure was a thing once upon a time, where exploits and proofs of concept were dumped publicly, forcing companies to fix the issue or be compromised. That's mostly been moved away from in favor of responsible disclosure, giving companies time to patch the issue before it's known publicly.

    Maybe we should be moving back to full disclosure to force these companies to take data security seriously. Or at least then we could point to a known vulnerability as proof the company is shitty and is neglecting their infrastructure.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 4 months ago

    Sometimes I read stories of how reading web page source code is tried to be presented as hacking in order to not actually do anything for security, and of white hats sued for doing their job, and think that there are plenty of targets even for someone without exploits or LLMs

  • source
  • parent
  • [–] 6 points 4 months ago (1 child)

    Teenagers are definitely able to find exploits via google in 5 if they're motivated.

    Buying a disassembled ak-47 on post order and having it shipped to your address anywhere in the world is also possible.

    Rules only apply to people that care about them.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 4 months ago (1 child)

    As someone who works in security, llms just make security happen or not happen faster.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 4 months ago

    I also work in security.

    My company (which can damn well afford the costs) 100% REFUSES to leverage AI in any meaningful fashion. The CISO himself wrote the most braindead email to the CIO saying basically that AI isn't a threat and then showed it to the rest of us like he's proud of it.

    I tried to push some adoption of AI based tools to help detect our own weaknesses and do some basic cleanup work. Nope. Stonewalled. I argued that every attacker is stealing accounts and burning tokens to tear us to shreds using every possible tools they can steal or even buy. We use Copilot.

    Blank stares and crickets. We just keep managing our shit in spreadsheets that some dumbass emails as attachments and wonders why everyone has a different version of some useless thing.

    At least they're paying me well. When they collapse in a little while, I suppose I won't be too surprised.

  • source
  • parent
  • [+] 16 points 4 months ago (15 children)
  • [–] 16 points 4 months ago (14 children)

    Most people on lemmy seem to condemn use of LLMs in any way for anything, I wonder what those folks opinion of this stance is - should companies use the tools or not?

  • source
  • parent
  • hideshow 14 child comments
  • [–] 18 points 4 months ago (2 children)

    Cybersecurity is actually one of the few fields that can benefit from AI. There are companies like Horizon3 who are using it alongside their other threat models to do continuous pen testing.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 4 months ago (2 children)

    Finding holes in software has employed "fuzzing", where you send completely random payloads, as a research tactic for quite a while (and it has found exploits). LLMs just seem like "educated" fuzzing, I don't see why anyone would complain about updating your suite with them.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 4 months ago

    As long as they produce a PoC like fuzzing tools, I don't think anyone is complaining

    It's the theoretical attacks that nearly always turn out to be impossible, wasting time, and making it harder to find the real issues that need investigation that's the problem with slop reports

  • source
  • parent
  • [–] 3 points 4 months ago*

    I’ve been fucking around with using Claude to solve CTF challenges. I’m using a harness built out of a custom agent I wrote that progressively loads specific a specific skill for the challenge category, cryptography, binary exploitation, reverse engineering, forensics, etc.

    It’s solving the simple shit in <1m using sonnet. It’s solved some shit that I couldn’t figure out at all during the CTF in the time limit we had in ~20 minutes. There’s been 2 challenges that after about 25 minutes I’ll kill the agent working on it, change to opus, then opus solved them in about 20m. One crypto challenge was so math heavy i never would have figured it out. One bin exp challenge didn’t provide a local binary, everything was remote. There was a catch that I never would have solved bc it was remote only and I couldn’t locally debug it.

    It’s fucking scary good at solving these things. I just prompt with “use to solve ./category/challenge/“ and it fully just does everything. It’s definitely akin a fuzzer that can be used for way more than just finding crashes and memory leaks. It takes some work and understanding to make it context/token efficient I think, but it lowers the bar so tremendously that I definitely see why there’s concern here. And again it’s solving most of these things with sonnet, not even opus and definitely not fable.

    All told, this feels like the same panic that happened when metasploit first got released/demo’d at defcon back in the day.

  • source
  • parent
  • [–] 5 points 4 months ago (7 children)

    Well the problem is that for example curl got flooded with generated security reports where only 5% had some true security potential. So your llm will basically flood you with false positives

  • source
  • parent
  • hideshow 7 child comments
  • [–] 5 points 4 months ago (6 children)

    If 5% of the reports are genuine security vulnerabilities that they wouldn't have found otherwise, that's looking like a big win to me, not sure how you see it differently.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 4 months ago (4 children)

    The problem is identifying which 5%. Nobody wants to filter that much AI slop.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 9 points 4 months ago (3 children)

    If you're working for a company's cybersec, that's your job. And a much preferable one to waiting for an attacker to do it for you.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 6 points 4 months ago

    If you’re submitting a vulnerability to a public repo, that’s also your job. These slop reports that are wasting maintainers time should never have been reported. The person tasking the LLM is out of their depth and can’t be the human in the loop that verifies the vulnerability report before submitting because they don’t have the required knowledge to do that. It’s a shame, because if people who had the requisite knowledge were the ones submitting, the ratio of valid reports to noise would be way higher than 5% and open source maintainers wouldn’t be feeling burned the fuck out.

  • source
  • parent
  • [–] -1 points 4 months ago

    Sure, but nobody wants to do that, even at fair pay. Unpaid open source volunteer projects REALLY don't want to do that, and risk burning out what is typically a solo main dev.

  • source
  • parent
  • [–] 1 point 4 months ago

    No 5% is very low compared to before AI and this still does not mean the absolute number of found bugs has risen. From my understanding it didn't for curl. Further it is unlikely that bugs in curl are not found. Basically everything works with curl and it's a paid bug bounty program so a lot of security researchers are looking at it

  • source
  • parent
  • [–] 78 points 4 months ago (4 children)

    My takeaway from stories like this is that it was always really easy to crack in to companies, but most knowledgeable people had better things to do.

  • source
  • hideshow 4 child comments
  • [–] 5 points 4 months ago (1 child)

    My feeling is companies leave themselves open by allowing everyone access to the network so the idiot who has been told 50 times not to click on a link in a suspicious email will still do it or hand out passwords to anyone on the phone. Even if you run a tight ship you'll give access to some contractor who doesn't.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 72 points 4 months ago

    Alternative title: the ubiquitous race for cheapest developers and fastest time to maket leaves everything insecure.

  • source
  • [–] 81 points 4 months ago (5 children)

    they fired hordes of tech people, and neglected cybersecurity in many companies. this was bound to happen.

  • source
  • hideshow 5 child comments
  • [–] 33 points 4 months ago (2 children)

    The IT Paradox :

    • "Why am I paying IT if everything works"
    • "Why am I paying IT if nothing works"
  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 44 points 4 months ago (8 children)

    I would love to see the term 'low-skilled' used more often within the context of LLM's and the manner in which people use them.

  • source
  • hideshow 8 child comments
  • [–] 6 points 4 months ago (7 children)
  • [–] 1 point 4 months ago (5 children)
  • [–] 9 points 4 months ago (2 children)

    "lamer" is old (sigh) forum/IM/IRC slang for a low-skilled/obnoxious individual, "someone who's lame"

  • source
  • parent
  • hideshow 2 child comments
  • [–] 29 points 4 months ago (4 children)
  • [–] 13 points 4 months ago (2 children)

    @Grok, is this picture legit?

    Tap for spoiler/s

  • source
  • parent
  • hideshow 2 child comments
  • [–] 12 points 4 months ago

    The attacker’s inexperience was also evident in his operational security failures. At one point he asked Claude to help edit his resume, which contained his full name, location, education history, and LinkedIn profile.

    Later, while investigating a potential compromise of one of his own hosts, he inadvertently confirmed his home IP address to the agent. Based on this and other corroborating evidence, the researchers believe the attacker to be a young man based in Addis Ababa, Ethiopia.

    Wow.

  • source
  • [–] 13 points 4 months ago (1 child)
  • [–] 6 points 4 months ago

    And this is why they want to know everything we're doing online at all times.

  • source
  • [–] 10 points 4 months ago (5 children)

    Wait until someone more skilled hacks the nuclear codes using AI and launches a few at US cities.

  • source
  • hideshow 5 child comments
  • [–] 14 points 4 months ago (5 children)

    Bad look for Claude after their vigorous insistence their model can't be used this way.

    Also bad look for the 50 people I get in my inbox telling me AI is completely useless every time I talk about it. These arguments were worthy of entertainment a few years ago but not in 2026.

  • source
  • hideshow 5 child comments
  • [–] 23 points 4 months ago (1 child)

    What’s the use here? A random Ethiopian kid doxxing himself while “breaching companies”?

    This article reads like yet another sensationalist advertisement for ai. How many people have supposedly now gained the ability to “breach dozens of companies” simply by typing “please” into a text box? Hundreds of millions? How is society still functioning if this is going on?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 4 months ago

    The reason things haven't fallen apart is because there's a lot of devs working a lot more than they used to making sure they're patching vulnerabilities. Last year if you asked me what portion of my time was spent updating dependencies and responding to reports of vulnerabilities I'd say like 5-10%, this year that's easily more like 30%

    I'm sure not every company is doing this, but depending on the sensitivity of the data the company is holding I'd imagine you'd see similar patterns elsewhere

  • source
  • parent
  • [–] 5 points 4 months ago (1 child)

    AI (specifically LLM) isn't unless unless you need it to be accurate. You don't need to be accurate to find software vulnerabilities for example, you just need to be able to sift enough of the false positives to be able to identify the real bugs for example.

    LLMs are over hyped and being given away below the cost of training and running the models in the hope of getting entrenched then ramping up the costs though.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 4 months ago* (last edited 4 months ago)

    Fair I agree it's overhyped. But to be honest the amount I think it's overhyped continues to decline as its capabilities continue to advance. And we're at a point now where it is clearly useful for many tasks, even if it's not appropriate for everything.

  • source
  • parent