307
OpenAI says it will no longer train its AI models on the live internet, citing 'significant risks' | TechCrunch (techcrunch.com)
submitted 1 week ago by to c/technology@lemmy.world
73 comments fedilink hide all child comments
 

On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.

The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.

you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 1 week ago (4 children)

I heard that the public isn't the target of these "we're being safe" messages, their developers are. Developers sometimes leave because they think they company isn't being safe enough... So claiming they're being safe is a way to retain developers.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 1 week ago

    I don't think they need to make these announcements public if the target audience is their own developers. I know some Anthropic engineers, and some former OpenAI engineers, and from our conversations it sounds like both companies do rely on internal messaging to manage workplace morale and address concerns. And warn them about honeypot spies looking for secrets, apparently.

    So maybe this message is mainly for regulators and investors, not necessarily their current employees.

  • permalink
  • fedilink
  • source
  • parent