Getting Better at Telling Misinformation from Reliable Expert Consensus

“It’s problematic because if people hear a single person’s false or misleading statements repeated through different channels, they might feel the statement is more valid than it is.”

Dr Connor Desai says an example of this is multiple independent experts agreeing that Ivermectin should not be used to treat COVID-19 (true consensus), versus a single group or individual saying that people should use it as an anti-viral drug (false consensus).

How the Study Was Conducted
he aim of the UNSW study was to understand why people believe false information when it’s repeated.  

“Our main goal was to establish whether one reason that people are equally convinced by true and false consensus is that they assume that different sources share data or methodologies,” Dr Connor Desai says.

“Do they understand there is potentially more evidence when you have multiple experts saying the same thing?”

The UNSW researchers conducted several experiments.

The first experiment replicated the 2019 Yale study, which saw participants given a variety of articles about a fictional tax policy which took positive, negative, or neutral stances, and then asked to what extent they agreed the proposal would improve the economy.

It replicated the “illusion of consensus” where people are equally convinced by one piece of evidence as they are by many pieces of evidence but added a new condition where they told people who saw a “true consensus” that the sources had used different data and methods to arrive at their conclusions.

The result was a reduction in the illusion of consensus.

“People were more convinced by true consensus than false consensus.”

In another experiment, 200 participants were given information about an election in a fictional foreign democratic country.

They were shown fictional Twitter posts from news outlets that said which candidates would get more votes in the election: some sourced the same or different pollsters to predict a candidate would win, while another tweet said a different contender would win.

But in the true consensus Twitter posts, they gave people a scenario in which it was clear that different primary sources worked independently and used different data to arrive at their conclusions.

“We expected that many people would be more familiar with such polls and would realise that looking at multiple different polls would be a better way of predicting the election result than just seeing a single poll multiple times,” Dr Connor Desai says.

After reading the tweets, participants rated which candidate would win based on the polling predictions.

“It seemed that people were more convinced by a true consensus than a false consensus when they understood the pollsters had gathered evidence independently of one another,” Professor of Cognitive Psychology in the School of Psychology, Brett Hayes says.

“Our results suggest that people do see claims endorsed by multiple sources as stronger when they believe these sources really are independent of one another.”

The researchers later replicated and extended the tweet study with 365 more participants.

“This time we had a condition where the tweets came from individual people who showed their endorsement of the polls using emojis,” Dr Connor Desai says.

“Regardless of whether the tweets came from news outlets, or individual tweeters, people were more convinced by true than false consensus when the relationship between sources was unambiguous.”

False Consensus Not Completely Discounted
But the researchers also found the participants didn’t completely discount false consensus.

“There are at least two possible explanations for this effect,” Dr Connor Desai said.

“The first is that such repetition simply increases the familiarity of the claim – enhancing its memory representation, and this is sufficient to increase confidence.

“The second is that people may make inferences about why a claim is repeated because the source believed it was the most reputable or provided the strongest evidence.

“For instance, if different news channels all cite the same expert you might think that they’re citing the same person because they are the most qualified to talk about whatever it is they’re talking about.”

Dr Connor Desai plans to next look at why some communication strategies are more effective than others, and if repeating information is always effective.

“Is there a point where there’s too much consensus, and people become suspicious?” she says.

“Can you correct a ‘false consensus’ by pointing out that it’s often better to get information from multiple independent sources? These are the kinds of strategies we wish to look into.”

Diane Nazaroff is News and Content Coordinator, Science faculty at UNSW.