Reddit’s conversational AI product, Reddit Answers, suggested users who are interested in pain management try heroin and kratom, showing yet another extreme example of dangerous advice provided by a chatbot, even one that’s trained on Reddit’s highly coveted trove of user-generated data.

https://en.wikipedia.org/wiki/Bromism

However, a man was poisoned in 2025, after a suggestion of ChatGPT to replace sodium chloride in his diet with sodium bromide; sodium bromide is a safe replacement only for non-nutritional purposes, i.e., cleaning.[3][4][5]

other discussions
 

AI-generated Reddit Answers are giving bad advice in medical subreddits and moderators can’t opt out.

Archived version: https://archive.is/20251016174721/https://www.404media.co/reddit-answers-ai-suggests-users-try-heroin/