Anthropic says it has blocked multiple accounts that used the company's artificial intelligence models in ways that could support the development of biological weapons.

In a report published Thursday, the AI company known for its Claude model said it considers biological misuse one of the "most serious risks" to artificial intelligence models.

The new report outlines five real-life case studies in which users "circumvented controls" that block users from specific regions and "engaged in other efforts to obfuscate the purpose of their research to evade our safeguards." The examples include possible gain-of-function research and involve both infectious diseases, such as bird flu, and novel venoms and toxins.

all 12 comments

sorted by: hot top controversial new old
[–] 36 points 1 month ago

These idiots can't stop experimental agents from escaping onto the internet, their ability to "block" bioweapon "research" is unlikely to even approximate the ability of a sieve to stop water.

  • source
  • [–] 25 points 1 month ago

    Everyone's using the bogus hacking claims as marketing these days, gotta come up with some new misuse claims for marketing.

  • source
  • [–] 11 points 1 month ago

    Narrator: this, was of course, total bullshit

  • source
  • [–] 10 points 1 month ago

    I wish these braindead news outlets would stop doing free marketing for anthropic or openai.

    This shit is as bad as everyone suddenly acting like foldable phones are relevant just because shitfuck apple decided to finally enter the market with their $2k phone made of recycled sewage.

    People were doing all this stuff back when GPT-3 dropped and literally every model on HF has hundreds of ablated/uncensored versions that makes whatever limitations anthropic and openai impose completely irrelevant.

    Even if some adversary wanted a high quality output for nefarious purposes, they'd just download uncensored deepseek and run it on their expensive hardware they can already afford.

    Why is every god damn article pretending the past 3 years never happend?

  • source
  • [–] 8 points 1 month ago

    What do they want, a fucking cookie?

  • source
  • [–] 8 points 1 month ago

    The future is Twelve Monkeys

  • source
  • [–] 5 points 1 month ago

    Next up: Rogue agents breached containment and built the torment nexus. Request additional funding for safeguards.

  • source
  • [–] 5 points 1 month ago
    [–] 4 points 1 month ago

    Only the wealthy will ever see empowerment of this technology. The rest of us will see censorship, manipulation, propaganda and social control systems.

  • source
  • [–] 2 points 1 month ago (1 child)

    I feel like it’s significantly easier to track the sale of certain equipment than trying to prevent the knowledge from getting around.

  • source
  • hideshow 1 child comment
  • [–] 2 points 1 month ago

    Given several glass jars, a pressure cooker, and some beef, you could make enough botulin to kill humanity within a few weeks.

    The problem is delivering it.

    US Air Force has a publicly available manual with instructions for the first part.

  • source
  • parent
  • [–] 1 point 1 month ago* (last edited 1 month ago)

    Invest now before the brain worms get us!

  • source