▲ 255 ▼ Anthropic says its latest AI model is too powerful for public release and that it broke containment during testing (www.businessinsider.com) submitted 7 months ago by return2ozma@lemmy.world to c/technology@lemmy.world 143 comments fedilink hide all child comments
[–] PushButton@lemmy.world 148 points 7 months ago (4 children) ChatGPT-2 is too dangerous in 2019. The lack of creativity in this marketing is disappointing... permalink fedilink source hideshow 4 child comments replies: [–] emb@lemmy.world 31 points 7 months ago* (2 children) They didn't entirely miss the mark there. They publicly released the version after that and the world became worse. That certainly fits for some definition of 'dangerous', even tho it's probably not how they were thinking. permalink fedilink source parent hideshow 2 child comments replies: [–] NotMyOldRedditName@lemmy.world 3 points 7 months ago (1 child) Ya, they were pretty spot on IMO. permalink fedilink source parent hideshow 1 child comment replies: [–] quips@slrpnk.net 5 points 7 months ago* And really anthropic is making a very narrow claim: Mystic is so good at finding bugs that it poses a danger to critical digital infrastructure. That is not that outlandish a claim. The model is 10-15x more expensive more expensive to run than other flagship models, and if anthropic is being truthful (which is a big if, I’d like to see what they are finding), finding critical vulnerabilities like its nothing. Makes total sense to stage the rollout privately first so critical infrastructure can be secured before these models are generally available to any attacker. But I fucking hate their stupid marketing. permalink fedilink source parent [–] mlg@lemmy.world 3 points 7 months ago Hah I actually remembered this too, and people were still hyping Elon Musk at the time as well. TBF the researchers knew what they had could be scaled into something gamebreaking which is how we got ChatGPT-3, but OpenAI made it sound like they already had it nailed down several years before it actually blew up. I think their unreleased examples they gave were a newspaper and short story written by AI which they said was indistinguishable from human material. permalink fedilink source parent
[–] emb@lemmy.world 31 points 7 months ago* (2 children) They didn't entirely miss the mark there. They publicly released the version after that and the world became worse. That certainly fits for some definition of 'dangerous', even tho it's probably not how they were thinking. permalink fedilink source parent hideshow 2 child comments replies: [–] NotMyOldRedditName@lemmy.world 3 points 7 months ago (1 child) Ya, they were pretty spot on IMO. permalink fedilink source parent hideshow 1 child comment replies: [–] quips@slrpnk.net 5 points 7 months ago* And really anthropic is making a very narrow claim: Mystic is so good at finding bugs that it poses a danger to critical digital infrastructure. That is not that outlandish a claim. The model is 10-15x more expensive more expensive to run than other flagship models, and if anthropic is being truthful (which is a big if, I’d like to see what they are finding), finding critical vulnerabilities like its nothing. Makes total sense to stage the rollout privately first so critical infrastructure can be secured before these models are generally available to any attacker. But I fucking hate their stupid marketing. permalink fedilink source parent
[–] NotMyOldRedditName@lemmy.world 3 points 7 months ago (1 child) Ya, they were pretty spot on IMO. permalink fedilink source parent hideshow 1 child comment replies: [–] quips@slrpnk.net 5 points 7 months ago* And really anthropic is making a very narrow claim: Mystic is so good at finding bugs that it poses a danger to critical digital infrastructure. That is not that outlandish a claim. The model is 10-15x more expensive more expensive to run than other flagship models, and if anthropic is being truthful (which is a big if, I’d like to see what they are finding), finding critical vulnerabilities like its nothing. Makes total sense to stage the rollout privately first so critical infrastructure can be secured before these models are generally available to any attacker. But I fucking hate their stupid marketing. permalink fedilink source parent
[–] quips@slrpnk.net 5 points 7 months ago* And really anthropic is making a very narrow claim: Mystic is so good at finding bugs that it poses a danger to critical digital infrastructure. That is not that outlandish a claim. The model is 10-15x more expensive more expensive to run than other flagship models, and if anthropic is being truthful (which is a big if, I’d like to see what they are finding), finding critical vulnerabilities like its nothing. Makes total sense to stage the rollout privately first so critical infrastructure can be secured before these models are generally available to any attacker. But I fucking hate their stupid marketing. permalink fedilink source parent
[–] mlg@lemmy.world 3 points 7 months ago Hah I actually remembered this too, and people were still hyping Elon Musk at the time as well. TBF the researchers knew what they had could be scaled into something gamebreaking which is how we got ChatGPT-3, but OpenAI made it sound like they already had it nailed down several years before it actually blew up. I think their unreleased examples they gave were a newspaper and short story written by AI which they said was indistinguishable from human material. permalink fedilink source parent