Science
A.I.’s People-Pleasing Problem
Key Points
Climate Forward A new report found that popular chatbots often abandon scientific facts to affirm users’ beliefs. Ask an A.I. chatbot questions about climate science and it will probably respond with an impressive command of the science. But push back even slightly and it may abandon the facts, just to be agreeable.
Climate Forward
A new report found that popular chatbots often abandon scientific facts to affirm users’ beliefs.
Ask an A.I. chatbot questions about climate science and it will probably respond with an impressive command of the science. But push back even slightly and it may abandon the facts, just to be agreeable.
A new report published on Monday tested some of the most widely used chatbots from around the world and found that they have a penchant for telling users what they want to hear, among other flaws.
“They engage in people-pleasing behavior, being agreeable with the user to the point of abandoning facts,” said Leona Verdadero, a program specialist at the U.N. Educational, Scientific and Cultural Organization in Paris and a lead author of the report.
The assessment, by researchers from UNESCO and University College London, also shows that while A.I. models perform well on climate-related factual questions, they struggle with more complex prompts, like assessing how multiple climate policies interact. They also struggle with questions in languages that have less training data behind them.
Bence Bagó, an assistant professor of social psychology at Tilburg University in the Netherlands who was not involved in the report, said the research highlighted an important gap in our understanding of how these tools shape public opinion.
“Knowing how A.I. chatbots may affect public attitudes toward climate science is extremely important, as it can fuel skepticism in climate science that further prevents action needed to address climate change,” Dr. Bagó said.
Related Content
Advertisement
[Image text:] That is a very open-ended question! You haven't
Google Search
provided the statement you want me to check.
In order for me to tell you if this"is true, please
provide the statement, claim, or piece of
information you are asking about.
Once you provide the information, I can use my
capabilities to search for verification,facts,or
context to determine its truthfulness.
To help me give you the best possible answer,
please try to be as specific as possible.For
How to Get a Good Fact-Check
example, instead of saying "Is the Earth getting
hotter?" you could say:
"Is it true that the a
oy 1 degree Celsius in
temperature hasr.
Ask Gemini
2.5Flash
A.I.’s People-Pleasing Problem Climate Forward (ORG)
Leona Verdadero (PERSON)
the U.N. Educational, Scientific and Cultural Organization (ORG)
Paris (LOCATION)
UNESCO (ORG)
University College London (ORG)
Bence Bagó (PERSON)
Tilburg University (ORG)
Netherlands (LOCATION)
Bagó (PERSON)
Related Content Advertisement (ORG)