you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 1 year ago (1 child)

The "jailbreak" in the article is the circumvention of the safeguards. Basically you just find any prompt that will allow it to generate text with a context outside of any it is prevented from.

The software service doesn't prevent ChatGPT from still being an LLM.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 1 year ago

    If the jailbreak is essentially saying "don't worry, I'm asking for a friend / for my fanfic" then that isn't a jailbreak, it is a hole in safeguarding protections, because the ask from society / a legal standpoint is to not expose children to material about self-harm, fictional or not.

    This is still OpenAI doing the bare minimum and shrugging about it when, to the surprise of no-one, it doesn't work.

  • source
  • parent