A Picture Paints a Thousand Lies? The Effects and Mechanisms of Multimodal Disinformation and Rebuttals Disseminated via Social Media

Today’s fragmented and digital media environment may create a fertile breeding ground for the uncontrolled spread of disinformation. Although previous research has investigated the effects of misinformation and corrective efforts, we know too little about the role of visuals in disinformation and fact checking. Against this backdrop, we conducted an online experiment with a diverse sample of U.S. citizens (N = 1,404) to investigate the credibility of textual versus multimodal (text-plus-visual) disinformation, and the effects of textual and multimodal fact checkers in refuting disinformation on school shootings and refugees. Our findings indicate that, irrespective of the source, multimodal disinformation is considered slightly more credible than textual disinformation. Fact checkers can help to overcome the potential harmful consequences of disinformation. We also found that fact checkers can overcome partisan and attitudinal filters – which points to the relevance of fact checking as a journalistic discipline.

[1]  M. Grabe,et al.  Image Bite Politics , 2009 .

[2]  Edson C. Tandoc,et al.  Defining “Fake News” , 2018 .

[3]  Ullrich K. H. Ecker,et al.  Misinformation and Its Correction , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[4]  Thomas E. Powell,et al.  Algorithms in the newsroom? News readers’ perceived credibility and selection of automated journalism , 2018 .

[5]  Silvio Waisbord,et al.  Populist communication by digital means: presidential Twitter in Latin America , 2017 .

[6]  J. Cacioppo,et al.  Communication and persuasion , 1986 .

[7]  Franziska Marquart,et al.  Communication and persuasion : central and peripheral routes to attitude change , 1988 .

[8]  Chris Roberts,et al.  Correlations Among Variables in Message and Messenger Credibility Scales , 2010 .

[9]  Claes H. de Vreese,et al.  Political communication in a high-choice media environment: a challenge for democracy? , 2017 .

[10]  Robert M. Entman,et al.  Framing: Toward Clarification of a Fractured Paradigm , 1993 .

[11]  Sanne Kruikemeier,et al.  Re-evaluating journalistic routines in a digital age: A review of research on the use of online sources , 2016, New Media Soc..

[12]  Charles S. Taber,et al.  Motivated Skepticism in the Evaluation of Political Beliefs , 2006 .

[13]  W. Nuland,et al.  Information operations and Facebook , 2017 .

[14]  Laurie J Ouellette,et al.  Special Issue: Media and the Extreme RightEditor’s Introduction , 2018 .

[15]  Taking Fact-Checks Literally But Not Seriously? The Effects of Journalistic Fact-Checking on Factual Beliefs and Candidate Favorability , 2020, Political Behavior.

[16]  Anders Olof Larsson,et al.  Populist online communication: introduction to the special issue , 2017 .

[17]  Ethan Porter,et al.  The Elusive Backfire Effect: Mass Attitudes’ Steadfast Factual Adherence , 2019 .

[18]  Thomas E. Powell,et al.  A Clearer Picture: The Contribution of Visuals and Text to Framing Effects , 2015 .

[19]  B. Nyhan,et al.  When Corrections Fail: The Persistence of Political Misperceptions , 2010 .

[20]  P. Messaris,et al.  The Role of Images in Framing News Stories , 2001 .

[21]  John Gastil,et al.  How Voters Become Misinformed: An Investigation of the Emergence and Consequences of False Factual Beliefs* , 2014 .

[22]  Stephanie Lee Sargent,et al.  Effects of Photographs in News-Magazine Reports on issue Perception , 1999 .

[23]  Teresa Correa,et al.  Ties, Likes, and Tweets: Using Strong and Weak Ties to Explain Differences in Protest Participation Across Facebook and Twitter Use , 2018, Studying Politics Across Media.

[24]  Emily A. Thorson Belief Echoes: The Persistent Effects of Corrected Misinformation , 2016 .

[25]  T. G. van der Meer,et al.  Misinformation and Polarization in a High-Choice Media Environment: How Effective Are Political Fact-Checkers? , 2019, Communication Research.

[26]  M. Grabe,et al.  Image Bite Politics: News and the Visual Framing of Elections , 2009 .

[27]  T. Harcup,et al.  What is News? , 2017, The Universal Journalist.

[28]  Dolores Albarracín,et al.  Debunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation , 2017, Psychological science.

[29]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[30]  Doris A. Graber,et al.  Seeing is remembering: How visuals contribute to learning from television news , 1990 .

[31]  C. D. Vreese,et al.  News framing: Theory and typology , 2005 .

[32]  Hajo G. Boomgaarden,et al.  Framing fast and slow: a dual processing account of multimodal framing effects , 2018, Media Psychology.

[33]  Ashley Muddiman,et al.  Correcting Political and Consumer Misperceptions: The Effectiveness and Effects of Rating Scale Versus Contextual Correction Formats , 2018 .

[34]  Alice E. Marwick,et al.  Media Manipulation and Disinformation Online , 2017 .

[35]  G. Mazzoleni Populism and the Media , 2008 .

[36]  David Bagchi Printing, Propaganda, and Public Opinion in the Age of Martin Luther , 2016 .

[37]  Kim L. Fridkin,et al.  Liar, Liar, Pants on Fire: How Fact-Checking Influences Citizens’ Reactions to Negative Advertising , 2015 .