▲ 255 ▼ Anthropic says its latest AI model is too powerful for public release and that it broke containment during testing (www.businessinsider.com) submitted 7 months ago by return2ozma@lemmy.world to c/technology@lemmy.world 143 comments fedilink hide all child comments
[–] StillAlive@piefed.world 40 points 7 months ago (4 children) And you believe Anthropic? permalink fedilink source parent hideshow 4 child comments replies: [–] paraphrand@lemmy.world 15 points 7 months ago* (last edited 7 months ago) (3 children) Well, for now. I’m sure any of those 12 partner companies they called out as new security partners will end up leaking that this is all lies eventually. If it’s just made up bullshit. Anthropic announced new partnerships to inform the companies of security issues and to work with them to fix said issues. If it’s bullshit, it’s gonna be wasting their time. And that’ll surface eventually. The meme still applies to people asking the AI to tell them what they wanna hear, and delusional people spiraling with sycophantic AI. But I believe Anthropic when they say their models are not working as intended and posing security risks. Claude Mythos Preview's large increase in capabilities has led us to decide not to make it generally available," Anthropic wrote in the preview's system card. "Instead, we are using it as part of a defensive cybersecurity program with a limited set of partners." permalink fedilink source parent hideshow 3 child comments replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago (2 children) Try clicking the link and reading the article this time permalink fedilink source parent hideshow 2 child comments replies: [–] paraphrand@lemmy.world 4 points 7 months ago* (last edited 7 months ago) (1 child) I wasn’t wrong in this reply. I was asked about believing Anthropic. Are you saying they are lying? Why should I disbelieve Anthropic? permalink fedilink source parent hideshow 1 child comment replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago* Your reasoning was (paraphrased, so hopefully I understood you correctly) "why would they lie about the model disobeying instructions because that looks bad for them" But I believe Anthropic when they say their models are not working as intended and posing security risks. But when you actually read the article, they had specifically prompted the model to do the things it did. Also Anthropic has a patterned history of greatly exaggerating and outright lying. permalink fedilink source parent
[–] paraphrand@lemmy.world 15 points 7 months ago* (last edited 7 months ago) (3 children) Well, for now. I’m sure any of those 12 partner companies they called out as new security partners will end up leaking that this is all lies eventually. If it’s just made up bullshit. Anthropic announced new partnerships to inform the companies of security issues and to work with them to fix said issues. If it’s bullshit, it’s gonna be wasting their time. And that’ll surface eventually. The meme still applies to people asking the AI to tell them what they wanna hear, and delusional people spiraling with sycophantic AI. But I believe Anthropic when they say their models are not working as intended and posing security risks. Claude Mythos Preview's large increase in capabilities has led us to decide not to make it generally available," Anthropic wrote in the preview's system card. "Instead, we are using it as part of a defensive cybersecurity program with a limited set of partners." permalink fedilink source parent hideshow 3 child comments replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago (2 children) Try clicking the link and reading the article this time permalink fedilink source parent hideshow 2 child comments replies: [–] paraphrand@lemmy.world 4 points 7 months ago* (last edited 7 months ago) (1 child) I wasn’t wrong in this reply. I was asked about believing Anthropic. Are you saying they are lying? Why should I disbelieve Anthropic? permalink fedilink source parent hideshow 1 child comment replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago* Your reasoning was (paraphrased, so hopefully I understood you correctly) "why would they lie about the model disobeying instructions because that looks bad for them" But I believe Anthropic when they say their models are not working as intended and posing security risks. But when you actually read the article, they had specifically prompted the model to do the things it did. Also Anthropic has a patterned history of greatly exaggerating and outright lying. permalink fedilink source parent
[–] theunknownmuncher@lemmy.world 3 points 7 months ago (2 children) Try clicking the link and reading the article this time permalink fedilink source parent hideshow 2 child comments replies: [–] paraphrand@lemmy.world 4 points 7 months ago* (last edited 7 months ago) (1 child) I wasn’t wrong in this reply. I was asked about believing Anthropic. Are you saying they are lying? Why should I disbelieve Anthropic? permalink fedilink source parent hideshow 1 child comment replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago* Your reasoning was (paraphrased, so hopefully I understood you correctly) "why would they lie about the model disobeying instructions because that looks bad for them" But I believe Anthropic when they say their models are not working as intended and posing security risks. But when you actually read the article, they had specifically prompted the model to do the things it did. Also Anthropic has a patterned history of greatly exaggerating and outright lying. permalink fedilink source parent
[–] paraphrand@lemmy.world 4 points 7 months ago* (last edited 7 months ago) (1 child) I wasn’t wrong in this reply. I was asked about believing Anthropic. Are you saying they are lying? Why should I disbelieve Anthropic? permalink fedilink source parent hideshow 1 child comment replies: [–] theunknownmuncher@lemmy.world 3 points 7 months ago* Your reasoning was (paraphrased, so hopefully I understood you correctly) "why would they lie about the model disobeying instructions because that looks bad for them" But I believe Anthropic when they say their models are not working as intended and posing security risks. But when you actually read the article, they had specifically prompted the model to do the things it did. Also Anthropic has a patterned history of greatly exaggerating and outright lying. permalink fedilink source parent
[–] theunknownmuncher@lemmy.world 3 points 7 months ago* Your reasoning was (paraphrased, so hopefully I understood you correctly) "why would they lie about the model disobeying instructions because that looks bad for them" But I believe Anthropic when they say their models are not working as intended and posing security risks. But when you actually read the article, they had specifically prompted the model to do the things it did. Also Anthropic has a patterned history of greatly exaggerating and outright lying. permalink fedilink source parent