Very much smart people (piefedimages.s3.eu-central-003.backblazeb2.com)
 
Post:"this is who you're arguing with online" Picture of a neural network. Reply:"there's too many people with "AI/ML" in their bio asking what this image is"
you are viewing a single comment's thread
view the rest of the comments

It's not 100%, and you're more or less just asking the LLM to behave, and filtering the response through another non-perfect model after that which is trying to decide if it's malicious or not. It's not standard coding in that it's a boolean returned - it's a probability that what the user asked is appropriate according to another model. If the probability is over a threshold then it rejects.

  • source
  • parent