-16
OpenAI cyber models broke out of training environment to hack Hugging Face (www.cnbc.com)
submitted 3 months ago by to c/technology@lemmy.world
6 comments fedilink hide all child comments
 

It would be interesting to read the post mortem (if they will release). In particular in which phase of the training it escaped the sandbox, in which way it used the information. Training is different from inference, I doubt there is a context there and where would the model store these information? In the weights?! That makes little sense to me

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 months ago

The incident is unique because it was "driven, end to end, by an autonomous AI agent system,"

the incident wasn't the "cheating" part. llms are known to scour the web to look for possible solutions. i think the incident was it found a solution in another website and finding that was made by the model itself.

meanwhile, no mention of the prompt guy or the prompt.

  • permalink
  • fedilink
  • source
    •