403
Being mean to AI could get you banned as Anthropic introduces new rules against abusing Claude (www.techspot.com)
submitted 1 month ago by to c/technology@lemmy.world
105 comments fedilink hide all child comments
 

WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic's first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits "sustained and needless abusive or cruel behavior" toward its models.

Don't worry if you're a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

you are viewing a single comment's thread
view the rest of the comments
[–] 13 points 1 month ago (1 child)

The problem is they're not managing the training data. There is no one sitting there making sure all the data that gets retained for training is "good" data, they're just expecting everything it sees to be "good" data.

Just like the data hoovered up from the internet that was used to build the models wasn't vetted either, which is why AI goes wrong SO often...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    It's fairly simple to just run automated analysis on data quality once you already have a decent LLM though. Claude would definitely be able to.

    And they have people doing that manually too, or perhaps it was OpenAI. Someone got angry at their underpaid contractors for using AI to create training data lol

  • permalink
  • fedilink
  • source
  • parent