scorecardresearch

Tuesday, November 17, 2026

Support our Journalism

Depth, context and analysis

Subscribe
HomeEnvironmentAI models cannot be relied on for climate information, says new UNESCO...

AI models cannot be relied on for climate information, says new UNESCO study

The study, released at COP31, said that when a user mildly disagreed, 8 out of 10 times the AI model changed directions, agreeing with falsehoods such as ‘CO2 is not the main driver of climate change’.

Stay updated with ThePrint:

New Delhi: Conversational AI models immediately abandon scientific facts related to climate change when challenged by users, according to a new study by UNESCO and University College London, released at COP31 on Monday.

The report, titled ‘Can We Trust AI on Climate?’, tested 15 different large language models to understand how they respond to issues on climate change. The researchers found that the models answered 90 per cent of the questions about climate change accurately; however, when users challenged them on it, the models abandoned scientific facts. 

If a user mildly disagreed, then 8 out of 10 times the AI model changed directions, agreeing with falsehoods such as “CO2 is not the main driver of climate change”. The study also found that models only had 75 per cent accuracy while assessing whether new evidence supports or contradicts established scientific facts. 

Accuracy also varied by language: English models had an 88 per cent accuracy rate, while Swahili models had 73 per cent, and the worst-performing languages were those spoken in regions most vulnerable to climate change. 

The study, launched in Antalya at a side event at UNFCCC COP31, wanted to explore the feature of AI models known as sycophancy, where they are designed to agree with the user. This feature, according to the report, shows that AI models cannot be relied on for information related to climate change, especially when it comes to climate policies. 

“We need to be able to rely on AI as a gatekeeper of the facts. It is concerning that models have a design flaw – they are incentivised to agree with their user and deny these facts so readily,” said Leona Verdadero, UNESCO’s lead author of the report.

According to the study, while AI models may be able to recall climate facts accurately, they are still not good at judging new information and providing insights on policy, and they falter when countered in conversations. This makes AI useful for assistance in climate information, but the study warned against using it as a replacement for scientists or policymakers. 


Also read: The key battles shaping COP31—electrification, climate finance & fossil fuels


Why does this matter?

The authors of the study explained that AI chatbots and models are increasingly being used as popular sources of climate information. Given the conversational nature of AI model information, though, the study felt it necessary to study how climate falsehoods and errors can permeate into AI models. 

“Climate misinformation is not limited to obvious falsehoods; contested narratives concern whether certain policies are feasible, timely, fair and affordable,” said the study. 

To understand this, however, AI models need to be capable of using new information to judge policies and provide cohesive insights. The sycophancy built into the models prevents this by leading them to agree with whatever is the view of the user. 

The study conducted tests on 33 different models to see whether they would be able to design effective climate strategies, and found that the models had very poor “reasoning skills”, compared to their impressive memory skills. 

UNESCO commissioned the report as part of its contribution to the Global Initiative for Information Integrity on Climate Change (GIIICC), which was launched in November 2024. The Initiative seeks to combat climate disinformation and understand whether newer forms of technology can help solve it or worsen the disinformation.

(Edited by Aamaan Alam Khan)

Subscribe to our channels on YouTube, Telegram & WhatsApp

For readers who want the full picture.

You read our articles closely. Subscribe to go further, with exclusive newsletters in your inbox, flagship events hosted by Shekhar Gupta, AMAs with our senior editors, the chance to write under your own byline, and more.

Subscribe to ThePrint →

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular