Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Media

When users on social media share content without considering its veracity, they may unwittingly be spreading misinformation. In this work, we investigate the design of lightweight interventions that nudge users to assess the accuracy of information as they share it. Such assessment may deter users from posting misinformation in the first place, and their assessments may also provide useful guidance to friends aiming to assess those posts themselves. In support of lightweight assessment, we first develop a taxonomy of the reasons why people believe a news claim is or is not true; this taxonomy yields a checklist that can be used at posting time. We conduct evaluations to demonstrate that the checklist is an accurate and comprehensive encapsulation of people's free-response rationales. In a second experiment, we study the effects of three behavioral nudges---1) checkboxes indicating whether headings are accurate, 2) tagging reasons (from our taxonomy) that a post is accurate via a checklist and 3) providing free-text rationales for why a headline is or is not accurate---on people's intention of sharing the headline on social media. From an experiment with 1668 participants, we find that both providing accuracy assessment and rationale reduce the sharing of false content. They also reduce the sharing of true content, but to a lesser degree that yields an overall decrease in the fraction of shared content that is false. Our findings have implications for designing social media and news sharing platforms that draw from richer signals of content credibility contributed by users. In addition, our validated taxonomy can be used by platforms and researchers as a way to gather rationales in an easier fashion than free-response.

[1]  Christine Geeng,et al.  Fake News on Facebook and Twitter: Investigating How People (Don't) Investigate , 2020, CHI.

[2]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[3]  T. Haigh,et al.  Information Literacy vs. Fake News: The Case of Ukraine , 2019, Open Information Science.

[4]  D. Lazer,et al.  Fake news on Twitter during the 2016 U.S. presidential election , 2019, Science.

[5]  Kevin Driscoll,et al.  Political rumoring on Twitter during the 2012 US presidential election: Rumor diffusion and correction , 2017, New Media Soc..

[6]  Self-reported willingness to share political news articles in online surveys correlates with actual sharing on Twitter , 2020, PloS one.

[7]  Isaac Cho,et al.  Vulnerable to misinformation?: Verifi! , 2018, IUI.

[8]  Sheila O'Riordan,et al.  Do you have a source for that?: understanding the challenges of collaborative evidence-based journalism , 2019, OpenSym.

[9]  Bernhard Schölkopf,et al.  Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation , 2017, WSDM.

[10]  Emily K. Vraga,et al.  Using Expert Sources to Correct Health Misinformation in Social Media , 2017 .

[11]  Giovanni Luca Ciampaglia,et al.  The spread of low-credibility content by social bots , 2017, Nature Communications.

[12]  David G. Rand,et al.  Cognitive reflection correlates with behavior on Twitter , 2019, Nature Communications.

[13]  David G. Rand,et al.  Emphasizing publishers does not effectively reduce susceptibility to misinformation on social media , 2020, Harvard Kennedy School Misinformation Review.

[14]  Alan Borning,et al.  Integrating on-demand fact-checking with public dialogue , 2014, CSCW.

[15]  Kate Starbird,et al.  Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter after the 2013 Boston Marathon Bombing , 2014 .

[16]  Alice E. Marwick Why do people share fake news? A sociotechnical model of media effects , 2018 .

[17]  S. Frederick Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[18]  Barbara Poblete,et al.  Information credibility on twitter , 2011, WWW.

[19]  Huan Liu,et al.  Gleaning Wisdom from the Past: Early Detection of Emerging Rumors in Social Media , 2017, SDM.

[20]  Dean Eckles,et al.  Perverse Downstream Consequences of Debunking: Being Corrected by Another User for Posting False Political News Increases Subsequent Sharing of Low Quality, Partisan, and Toxic Content in a Twitter Field Experiment , 2021, CHI.

[21]  Sam Wineburg,et al.  Lateral Reading: Reading Less and Learning More When Evaluating Digital Information , 2017 .

[22]  David G. Rand,et al.  Scaling up fact-checking using the wisdom of crowds , 2020, Science advances.

[23]  Jennifer Grygiel,et al.  Are social media companies motivated to be good corporate citizens? Examination of the connection between corporate social responsibility and social media safety , 2019, Telecommunications Policy.

[24]  Mor Naaman,et al.  Understanding Feedback Expectations on Facebook , 2017, CSCW.

[25]  D. Elbourne,et al.  Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects☆ , 2014, Journal of clinical epidemiology.

[26]  Dan Cosley,et al.  Social Sharing of Emotions on Facebook: Channel Differences, Satisfaction, and Replies , 2015, CSCW.

[27]  L. Bode,et al.  See Something, Say Something: Correction of Global Health Misinformation on Social Media , 2018, Health communication.

[28]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[29]  Anselm L. Strauss,et al.  Qualitative Analysis For Social Scientists , 1987 .

[30]  Matthias Hagen,et al.  Clickbait Detection , 2016, ECIR.

[31]  David G. Rand,et al.  Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning , 2019, Cognition.

[32]  David G. Rand,et al.  Shared partisanship dramatically increases social tie formation in a Twitter field experiment , 2020, Proceedings of the National Academy of Sciences.

[33]  Antonio Scala,et al.  Polarization of the Vaccination Debate on Facebook , 2018, Vaccine.

[34]  Kate Starbird,et al.  Ecosystem or Echo-System? Exploring Content Sharing across Alternative Media Domains , 2018, ICWSM.

[35]  David G. Rand,et al.  Will the Crowd Game the Algorithm?: Using Layperson Judgments to Combat Misinformation on Social Media by Downranking Distrusted Sources , 2020, CHI.

[36]  Neha Gupta,et al.  Falling for Fake News: Investigating the Consumption of News via Social Media , 2018, CHI.

[37]  David G. Rand,et al.  Fighting misinformation on social media using crowdsourced judgments of news source quality , 2018, Proceedings of the National Academy of Sciences.

[38]  David G. Rand,et al.  Prior Exposure Increases Perceived Accuracy of Fake News , 2018, Journal of experimental psychology. General.

[39]  Joshua A. Tucker,et al.  Less than you think: Prevalence and predictors of fake news dissemination on Facebook , 2019, Science Advances.

[40]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[41]  Nasir Memon,et al.  Effects of Credibility Indicators on Social Media News Sharing Intent , 2020, CHI.

[42]  Edward T. Cokely,et al.  Measuring Risk Literacy: The Berlin Numeracy Test , 2012, Judgment and Decision Making.

[43]  Kate Starbird,et al.  Engage Early, Correct More: How Journalists Participate in False Rumors Online during Crisis Events , 2018, CHI.

[44]  David G. Rand,et al.  Shifting attention to accuracy can reduce misinformation online , 2021, Nature.

[45]  David G. Rand,et al.  The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings , 2019, Manag. Sci..

[46]  Y. Ibrahim Facebook and the Napalm Girl: Reframing the Iconic as Pornographic , 2017 .

[47]  S. Sundar,et al.  Effect of Source Attribution on Perception of Online News Stories , 1998 .

[48]  David G. Rand,et al.  Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention , 2020, Psychological science.

[49]  G. Caldarelli,et al.  The spreading of misinformation online , 2016, Proceedings of the National Academy of Sciences.

[50]  Matthew L. Stanley,et al.  "I've said it before and I will say it again": Repeating statements made by Donald Trump increases perceived truthfulness for individuals across the political spectrum , 2020 .

[51]  David R. Karger,et al.  A Structured Response to Misinformation: Defining and Annotating Credibility Indicators in News Articles , 2018, WWW.

[52]  You’re Definitely Wrong, Maybe: Correction Style Has Minimal Effect on Corrections of Misinformation Online , 2021 .

[53]  David Coyle,et al.  Competing or aiming to be average?: normification as a means of engaging digital volunteers , 2014, CSCW.

[54]  Kjerstin Thorson,et al.  Partisan Selective Sharing: The Biased Diffusion of Fact-Checking Messages on Social Media , 2017 .

[55]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[56]  Scott Counts,et al.  Tweeting is believing?: understanding microblog credibility perceptions , 2012, CSCW.

[57]  Rachel E. Moran Deciding what’s true: The rise of political fact-checking in American journalism , 2018, New Media Soc..

[58]  Kyounghee Hazel Kwon,et al.  An Exploration of Social Media in Extreme Events: Rumor Theory and Twitter during the Haiti Earthquake 2010 , 2010, ICIS.

[59]  Arkaitz Zubiaga,et al.  Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads , 2015, PloS one.

[60]  Hernán A. Makse,et al.  CUNY Academic Works , 2022 .

[61]  Amy X. Zhang,et al.  Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria , 2020 .

[62]  L. Bode,et al.  Defining Misinformation and Understanding its Bounded Nature: Using Expertise and Evidence for Describing Misinformation , 2020, Political Communication.

[63]  Ingmar Weber,et al.  Political Fact-Checking on Twitter: When Do Corrections Have an Effect? , 2018 .

[64]  Ingmar Weber,et al.  Get Back! You Don't Know Me Like That: The Social Mediation of Fact Checking Interventions in Twitter Conversations , 2014, ICWSM.

[65]  Walter Quattrociocchi,et al.  Echo Chambers on Facebook , 2016 .