Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study.

While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

The report uncovered a strong tendency for AI models to be sycophantic, meaning the model is more interested in pleasing the user than standing by facts – an issue identified when people turn to AI chatbots for personal advice.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 day ago* (last edited 20 hours ago) (1 child)

This is unsurprising - but probably important.

It's unsurprising because there is a huge amount of climate misinformation on the internet. There have been decades of deliberate organised campaigns to discredit climate science. The volume of that stuff is larger than the volume of actual research. AI models may try to take into account the credibility of sources in their training, but it's pretty difficult when there are sources that should be credible but are are not - such as the US government. So yeah... I'm not surprised that there are some confused messages coming from the AI. And that's not even taking into account possible deliberate bias added by the people/companies that control the AI.

And I think it's important because a lot of people do now turn very quickly to AI for answers - and they trust those answers. I have noticed the trend in many people around me, including some people I respect. So if people are trusting AI for explanations and facts (and ideas and recommendations and predictions etc.) then... well I guess we're kind of stuffed regardless of whether the AI is right or wrong, because we're no longer doing our own thinking. But obviously it is made worse when the outsourced thinking is also wrong in dangerous ways!

  • source
  • hideshow 1 child comment
  • [–] [S] 2 points 1 day ago

    Absolutely. Imo what you are saying should be discussed more so that people wake up a bit and realise that they are succumbing to the devil's trick: convenience. If we look at what a double-edged sword 'convenience' is and how it's harmed our society even before AI became such an everyday commodity we would be a lot more careful and protect what is truly important, our own ability to think as you say, and our integrity.

  • source
  • parent