Debunking in a world of tribes

Social media aggregate people around common interests eliciting collective framing of narratives and worldviews. However, in such a disintermediated environment misinformation is pervasive and attempts to debunk are often undertaken to contrast this trend. In this work, we examine the effectiveness of debunking on Facebook through a quantitative analysis of 54 million users over a time span of five years (Jan 2010, Dec 2014). In particular, we compare how users usually consuming proven (scientific) and unsubstantiated (conspiracy-like) information on Facebook US interact with specific debunking posts. Our findings confirm the existence of echo chambers where users interact primarily with either conspiracy-like or scientific pages. However, both groups interact similarly with the information within their echo chamber. Then, we measure how users from both echo chambers interacted with 50,220 debunking posts accounting for both users consumption patterns and the sentiment expressed in their comments. Sentiment analysis reveals a dominant negativity in the comments to debunking posts. Furthermore, such posts remain mainly confined to the scientific echo chamber. Only few conspiracy users engage with corrections and their liking and commenting rates on conspiracy posts increases after the interaction.

[1]  Guido Caldarelli,et al.  Science vs Conspiracy: Collective Narratives in the Age of Misinformation , 2014, PloS one.

[2]  Antonio Scala,et al.  The economy of attention in the age of (mis)information , 2014, Journal of Trust Management.

[3]  Jacob Ratkiewicz,et al.  Detecting and Tracking Political Abuse in Social Media , 2011, ICWSM.

[4]  Guido Caldarelli,et al.  Opinion dynamics on interacting networks: media competition and social influence , 2014, Scientific Reports.

[5]  C. Sunstein,et al.  Conspiracy Theories: Causes and Cures* , 2009 .

[6]  G. Caldarelli,et al.  The spreading of misinformation online , 2016, Proceedings of the National Academy of Sciences.

[7]  N. Lee,et al.  Word of mouth communication within online communities: Conceptualizing the online social network , 2007 .

[8]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[9]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[10]  Luis Mateus Rocha,et al.  Correction: Computational Fact Checking from Knowledge Networks , 2015, PloS one.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Cliff Lampe,et al.  The Benefits of Facebook "Friends: " Social Capital and College Students' Use of Online Social Network Sites , 2007, J. Comput. Mediat. Commun..

[13]  B. Nyhan,et al.  Effective Messages in Vaccine Promotion: A Randomized Trial , 2014, Pediatrics.

[14]  Stephen Marsh,et al.  Editorial: Journal of Trust Management , 2014, Journal of Trust Management.

[15]  Douglas Kellner,et al.  New Media and Internet Activism: From the ‘Battle of Seattle’ to Blogging , 2004, New Media Soc..

[16]  Q. Vuong Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses , 1989 .

[17]  Michela Del Vicario,et al.  Viral Misinformation: The Role of Homophily and Polarization , 2014, WWW.

[18]  Harry Eugene Stanley,et al.  Echo chambers in the age of misinformation , 2015, ArXiv.

[19]  A. L. Schmidt,et al.  Anatomy of news consumption on Facebook , 2017, Proceedings of the National Academy of Sciences.

[20]  Walter Quattrociocchi,et al.  Opinions Manipulation: Media, Power and Gossip , 2011, Adv. Complex Syst..

[21]  Ponnurangam Kumaraguru,et al.  TweetCred: Real-Time Credibility Assessment of Content on Twitter , 2014, SocInfo.

[22]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[23]  Walter Quattrociocchi,et al.  Echo Chambers on Facebook , 2016 .

[24]  G. Fine,et al.  Rumor Mills: The Social Impact of Rumor and Legend , 2017 .

[25]  Amal Abdullah AlMansour,et al.  A MODEL FOR RECALIBRATING CREDIBILITY IN DIFFERENT CONTEXTS AND LANGUAGES - A TWITTER CASE STUDY , 2014 .

[26]  Johan Bollen,et al.  Computational Fact Checking from Knowledge Networks , 2015, PloS one.

[27]  D.,et al.  Regression Models and Life-Tables , 2022 .

[28]  Wei Zhang,et al.  Knowledge-Based Trust: Estimating the Trustworthiness of Web Sources , 2015, Proc. VLDB Endow..

[29]  Guido Caldarelli,et al.  Trend of Narratives in the Age of Misinformation , 2015, PloS one.

[30]  C. Betsch,et al.  Debunking vaccination myths: strong risk negations can increase perceived vaccination risks. , 2013, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[31]  J. Byford Conspiracy Theories: A Critical Introduction , 2011 .

[32]  Guido Caldarelli,et al.  Emotional Dynamics in the Age of Misinformation , 2015, PloS one.

[33]  Qian Zhang,et al.  Collective attention in the age of (mis)information , 2014, Comput. Hum. Behav..

[34]  Saif Mohammad,et al.  Sentiment Analysis of Short Informal Texts , 2014, J. Artif. Intell. Res..

[35]  Misako Takayasu,et al.  Rumor Diffusion and Convergence during the 3.11 Earthquake: A Twitter Case Study , 2015, PloS one.

[36]  Igor Mozetic,et al.  Multilingual Twitter Sentiment Classification: The Role of Human Annotators , 2016, PloS one.

[37]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[38]  Nathalie Japkowicz,et al.  Evaluation Methods for Ordinal Classification , 2009, Canadian Conference on AI.

[39]  Dragomir R. Radev,et al.  Rumor has it: Identifying Misinformation in Microblogs , 2011, EMNLP.

[40]  Marta Estrada,et al.  Phytoplankton across Tropical and Subtropical Regions of the Atlantic, Indian and Pacific Oceans , 2016, PloS one.

[41]  R. Rich,et al.  Misinformation and the Currency of Democratic Citizenship , 2000, The Journal of Politics.

[42]  P. Resnick,et al.  RumorLens: A System for Analyzing the Impact of Rumors and Corrections in Social Media , 2014 .

[43]  William J. McGuire,et al.  The Effectiveness of Supportive and Refutational Defenses in Immunizing and Restoring Beliefs Against Persuasion , 1961 .

[44]  Alessandro Bessi,et al.  Two samples test for discrete power-law distributions , 2015, 1503.00643.

[45]  Ravi Kumar,et al.  Dynamics of conversations , 2010, KDD.

[46]  M. Hogg,et al.  Extremism and the psychology of uncertainty. , 2012 .

[47]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[48]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[49]  J. Peto,et al.  Asymptotically Efficient Rank Invariant Test Procedures , 1972 .

[50]  Janet L. Langlois Fine, Gary Alan; Campion-Vincent, Véronique; Heath, Chip (Eds.). Rumor Mills: The Social Impact of Rumor and Legend. Aldine Transaction, Nuevo Brunswick/Londres: 2005 , 2009 .