Perverse Downstream Consequences of Debunking: Being Corrected by Another User for Posting False Political News Increases Subsequent Sharing of Low Quality, Partisan, and Toxic Content in a Twitter Field Experiment

A prominent approach to combating online misinformation is to debunk false content. Here we investigate downstream consequences of social corrections on users’ subsequent sharing of other content. Being corrected might make users more attentive to accuracy, thus improving their subsequent sharing. Alternatively, corrections might not improve subsequent sharing - or even backfire - by making users feel defensive, or by shifting their attention away from accuracy (e.g., towards various social factors). We identified N=2,000 users who shared false political news on Twitter, and replied to their false tweets with links to fact-checking websites. We find causal evidence that being corrected decreases the quality, and increases the partisan slant and language toxicity, of the users’ subsequent retweets (but has no significant effect on primary tweets). This suggests that being publicly corrected by another user shifts one's attention away from accuracy - presenting an important challenge for social correction approaches.

[1]  David G. Rand,et al.  Shifting attention to accuracy can reduce misinformation online , 2021, Nature.

[2]  Jeffrey T. Hancock,et al.  Fake News in the News: An Analysis of Partisan Coverage of the Fake News Phenomenon , 2018, CSCW Companion.

[3]  Joshua A. Tucker,et al.  Less than you think: Prevalence and predictors of fake news dissemination on Facebook , 2019, Science Advances.

[4]  Joshua B. Plotkin,et al.  Information gerrymandering and undemocratic decisions , 2019, Nature.

[5]  D. Lazer,et al.  Public Health and Online Misinformation: Challenges and Recommendations. , 2019, Annual review of public health.

[6]  Self-reported willingness to share political news articles in online surveys correlates with actual sharing on Twitter , 2020, PloS one.

[7]  You’re Definitely Wrong, Maybe: Correction Style Has Minimal Effect on Corrections of Misinformation Online , 2021 .

[8]  Ullrich K. H. Ecker,et al.  Misinformation and Its Correction , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[9]  Teresa Correa,et al.  Who interacts on the Web?: The intersection of users' personality and social media use , 2010, Comput. Hum. Behav..

[10]  Nasir Memon,et al.  Effects of Credibility Indicators on Social Media News Sharing Intent , 2020, CHI.

[11]  Johan Bollen,et al.  Computational Fact Checking from Knowledge Networks , 2015, PloS one.

[12]  Ullrich K. H. Ecker,et al.  They Might Be a Liar But They’re My Liar: Source Evaluation and the Prevalence of Misinformation , 2019, Political Psychology.

[13]  Yejin Choi,et al.  Syntactic Stylometry for Deception Detection , 2012, ACL.

[14]  “If This account is True, It is Most Enormously Wonderful”: Interestingness-If-True and the Sharing of True and False News , 2021, Digital Journalism.

[15]  Kai Shu Beyond News Contents: The Role of Social Context for Fake News Detection , 2018 .

[16]  Dolores Albarracín,et al.  Debunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation , 2017, Psychological science.

[17]  Anca M. Miron,et al.  Reactance Theory - 40 Years Later , 2006 .

[18]  Sei-Ching Joanna Sin,et al.  Why Students Share Misinformation on Social Media: Motivation, Gender, and Study-level Differences , 2015 .

[19]  Emily K. Vraga,et al.  Using Expert Sources to Correct Health Misinformation in Social Media , 2017 .

[20]  Naeemul Hassan,et al.  The Quest to Automate Fact-Checking , 2015 .

[21]  Bernhard Schölkopf,et al.  Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation , 2017, WSDM.

[22]  David G. Rand,et al.  Shared partisanship dramatically increases social tie formation in a Twitter field experiment , 2020, Proceedings of the National Academy of Sciences.

[23]  D. Lazer,et al.  Fake news on Twitter during the 2016 U.S. presidential election , 2019, Science.

[24]  David G. Rand,et al.  Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention , 2020, Psychological science.

[25]  David G. Rand,et al.  Prior Exposure Increases Perceived Accuracy of Fake News , 2018, Journal of experimental psychology. General.

[26]  Xuezhi Wang,et al.  Relevant Document Discovery for Fact-Checking Articles , 2018, WWW.

[27]  B. Nyhan,et al.  Taking Fact-Checks Literally But Not Seriously? The Effects of Journalistic Fact-Checking on Factual Beliefs and Candidate Favorability , 2017, Political Behavior.

[28]  David G. Rand,et al.  Will the Crowd Game the Algorithm?: Using Layperson Judgments to Combat Misinformation on Social Media by Downranking Distrusted Sources , 2020, CHI.

[29]  Miriam J. Metzger,et al.  The science of fake news , 2018, Science.

[30]  Deen Freelon,et al.  Black Trolls Matter: Racial and Ideological Asymmetries in Social Media Disinformation , 2020, Social Science Computer Review.

[31]  Justin Cheng,et al.  Rumor Cascades , 2014, ICWSM.

[32]  David G. Rand,et al.  The online laboratory: conducting experiments in a real labor market , 2010, ArXiv.

[33]  David G. Rand,et al.  Cognitive reflection correlates with behavior on Twitter , 2019, Nature Communications.

[34]  J. Jost,et al.  An ideological asymmetry in the diffusion of moralized content on social media among political leaders. , 2019, Journal of experimental psychology. General.

[35]  D. Kahan The Psychology of Fake News , 2017 .

[36]  B. Nyhan,et al.  When Corrections Fail: The Persistence of Political Misperceptions , 2010 .

[37]  J. Dillard,et al.  On the Nature of Reactance and its Role in Persuasive Health Communication , 2005 .

[38]  Joshua A. Tucker,et al.  Emotion shapes the diffusion of moralized content in social networks , 2017, Proceedings of the National Academy of Sciences.

[39]  Krishna P. Gummadi,et al.  Who Makes Trends? Understanding Demographic Biases in Crowdsourced Recommendations , 2017, ICWSM.

[40]  David G. Rand,et al.  Fighting misinformation on social media using crowdsourced judgments of news source quality , 2018, Proceedings of the National Academy of Sciences.

[41]  L. Scruggs,et al.  Correcting misinformation about climate change: the impact of partisanship in an experimental setting , 2018, Climatic Change.

[42]  J. Brehm A theory of psychological reactance. , 1981 .

[43]  Benno Stein,et al.  A Stylometric Inquiry into Hyperpartisan and Fake News , 2017, ACL.

[44]  Katherine L. Milkman,et al.  What Makes Online Content Viral? , 2012 .

[45]  Emily K. Vraga,et al.  Do the right thing: Tone may not affect correction of misinformation on social media , 2020, Harvard Kennedy School Misinformation Review.

[46]  Suhang Wang,et al.  SAME: Sentiment-Aware Multi-Modal Embedding for Detecting Fake News , 2019, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[47]  L. Bode,et al.  See Something, Say Something: Correction of Global Health Misinformation on Social Media , 2018, Health communication.

[48]  Ingmar Weber,et al.  Political Fact-Checking on Twitter: When Do Corrections Have an Effect? , 2018 .

[49]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[50]  Arnold K. Ho,et al.  Political ideology shapes the amplification of the accomplishments of disadvantaged vs. advantaged group members , 2019, Proceedings of the National Academy of Sciences.

[51]  Kevin Munger Tweetment Effects on the Tweeted: Experimentally Reducing Racist Harassment , 2017 .

[52]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[53]  Tim Weninger,et al.  Fact Checking in Heterogeneous Information Networks , 2016, WWW.

[54]  Eunsol Choi,et al.  Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking , 2017, EMNLP.

[55]  David G. Rand,et al.  The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings , 2019, Manag. Sci..