403
Being mean to AI could get you banned as Anthropic introduces new rules against abusing Claude (www.techspot.com)
submitted 1 month ago by to c/technology@lemmy.world
105 comments fedilink hide all child comments
 

WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic's first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits "sustained and needless abusive or cruel behavior" toward its models.

Don't worry if you're a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 1 month ago (2 children)

The model doesn't change with prompts. It saves text files about your chat sessions it calls memories, that it can retrieve in the future. But it doesn't change the model for other users.

They have to actually include your conversations in the training data of future model iterations for it to "learn from" you, so that would involve them knowingly including abusive chats.

This is probably just marketing because they want people to think their AI is sentient.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 month ago

    Oh buddy, these companies are running out of authentically human inputs, you better believe they need to harvest their subscribers for rounding out their datasets, regardless of what their privacy policy alleges.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 month ago

    Don't they? That was the whole controversy recently with the Navier-Stokes Millennium Prize. OpenAI claimed an internal, unreleased AI model had solved it, but some mathematicians were working in the same direction and had used AI tools in their research. No one could verify whether or not OpenAI had trained their model on the unpublished research in the guy's Codex files.

  • permalink
  • fedilink
  • source
  • parent