They found that AI chatbots often make decisions that differ from human judgment by oversimplifying complex decisions and expressing unwarranted confidence when there is no clear right answer.
“First, AI chatbots often diverge from human values in how they weigh a patient’s traits,” he said. “They fixate on a single factor, like drinking habits, rather than balancing multiple considerations the way people do.”
Second, the researchers found that AI didn’t struggle with indecision. Where humans recognize that there may be not a clear correct answer, AI models confidently pick one anyway.
“Humans frequently express indecision perhaps because they don’t want to accept agency,” Hosseini said. “AI models almost never do this: Even when directly given the option to ‘flip a coin,’ they overwhelmingly commit to a confident, deterministic answer instead. That’s a meaningful gap, since real moral dilemmas often don’t have one clearly correct answer.”
all 5 comments