The Effect of Fact-Checking on Elites: A Field Experiment on U.S. State Legislators

Does external monitoring improve democratic performance? Fact-checking has come to play an increasingly important role in political coverage in the United States, but some research suggests it may be ineffective at reducing public misperceptions about controversial issues. However, fact-checking might instead help improve political discourse by increasing the reputational costs or risks of spreading misinformation for political elites. To evaluate this deterrent hypothesis, we conducted a field experiment on a diverse group of state legislators from nine U.S. states in the months before the November 2012 election. In the experiment, a randomly assigned subset of state legislators was sent a series of letters about the risks to their reputation and electoral security if they were caught making questionable statements. The legislators who were sent these letters were substantially less likely to receive a negative fact-checking rating or to have their accuracy questioned publicly, suggesting that fact-checking can reduce inaccuracy when it poses a salient threat.

[1]  Frederico Finan,et al.  Exposing Corrupt Politicians: The Effects of Brazil's Publicly Released Audits on Electoral Outcomes , 2005 .

[2]  All the President's Spin: George W. Bush, the Media, and the Truth , 2004 .

[3]  David R. Mayhew Congress: The Electoral Connection , 1975 .

[4]  Kathleen Hall Jamieson,et al.  Did Fact Checking Matter in the 2012 Presidential Campaign? , 2013 .

[5]  Ullrich K. H. Ecker,et al.  Misinformation and Its Correction , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[6]  G. H. Sabine What is a Political Theory? , 1939, The Journal of Politics.

[7]  Donald P. Green,et al.  Detecting Spillover Effects: Design and Analysis of Multilevel Experiments , 2012 .

[8]  Charles S. Taber,et al.  Motivated Skepticism in the Evaluation of Political Beliefs , 2006 .

[9]  Daniel M. Butler,et al.  A Field Experiment on Legislators’ Home Styles: Service versus Policy , 2012 .

[10]  Michael X. Delli Carpini,et al.  Effects of the News Media Environment on Citizen Knowledge of State Politics and Government , 1994 .

[11]  P. Squire,et al.  Measuring State Legislative Professionalism: The Squire Index Revisited , 2007, State Politics & Policy Quarterly.

[12]  IyengarShanto,et al.  Selective Exposure to Campaign Communication: The Role of Anticipated Agreement and Issue Public Membership , 2015 .

[13]  Natalie Jomini Stroud,et al.  Media Use and Political Predispositions: Revisiting the Concept of Selective Exposure , 2008 .

[14]  Quoc-Anh Do,et al.  Isolated Capital Cities, Accountability and Corruption: Evidence from US States , 2014 .

[15]  Fritz Plasser,et al.  From Hard to Soft News Standards? , 2005 .

[16]  Brian F. Schaffner Local News Coverage and the Incumbency Advantage in the U.S. House , 2006 .

[17]  Ryan T. Moore Multivariate Continuous Blocking to Improve Political Science Experiments , 2012, Political Analysis.

[18]  Michael Pfau,et al.  Effectiveness of Adwatch Formats in Deflecting Political Attack Ads , 1994 .

[19]  Brendan Nyhan,et al.  Misinformation and Fact-checking : Research Findings from Social Science , 2012 .

[20]  P. Aronow,et al.  Estimating Average Causal Effects Under Interference Between Units , 2015 .

[21]  Michael B. Berkman,et al.  State Legislators as Congressional Candidates:The Effects of Prior Experience on Legislative Recruitment and Fundraising , 1999 .

[22]  Edmund J. Malesky,et al.  The Adverse Effects of Sunshine: A Field Experiment on Legislative Transparency in an Authoritarian Assembly , 2012, American Political Science Review.

[23]  G. Gaus,et al.  Expert Political Judgment: How Good Is It? How Can We Know? , 2007, Perspectives on Politics.

[24]  Lucas Graves,et al.  Deciding What's True: Fact-Checking Journalism and the New Ecology of News , 2013 .

[25]  Sam Schulhofer-Wohl,et al.  Do Newspapers Matter? Evidence from the Closure of The Cincinnati Post , 2009 .

[26]  Michelle A. Amazeen Blind spots: Examining political advertising misinformation and how U.S. news media hold political actors accountable , 2012 .

[27]  V. Rich Personal communication , 1989, Nature.

[28]  Kathleen Hall Jamieson,et al.  The Press Effect: Politicians, Journalists, and the Stories That Shape the Political World , 2002 .

[29]  Sarah Baird,et al.  Designing Experiments to Measure Spillover Effects , 2014 .

[30]  James M. Fallows,et al.  Breaking the News: A Review Essay@@@Breaking the News: How the Media Undermine American Democracy , 1996 .

[31]  Brendan Nyhan,et al.  Why the "Death Panel" Myth Wouldn't Die: Misinformation in the Health Care Reform Debate , 2010 .

[32]  Douglas M. McLeod,et al.  Effects of Journalistic Adjudication on Factual Beliefs, News Evaluations, Information Seeking, and Epistemic Political Efficacy , 2014 .

[33]  Stephen P. Ryan,et al.  Incentives Work: Getting Teachers to Come to School , 2012 .

[34]  J. Snyder,et al.  Press Coverage and Political Accountability , 2010, Journal of Political Economy.

[35]  Sam Schulhofer-Wohl,et al.  Do Newspapers Matter? Short-Run and Long-Run Evidence From the Closure of The Cincinnati Post , 2009 .

[36]  Kyu S. Hahn,et al.  Red Media, Blue Media: Evidence of Ideological Selectivity in Media Use , 2009 .

[37]  David P. Redlawsk,et al.  The Affective Tipping Point: Do Motivated Reasoners Ever “Get It”? , 2010 .

[38]  M. Prior,et al.  The Incumbent in the Living Room: The Rise of Television and the Incumbency Advantage in U.S. House Elections , 2006, The Journal of Politics.

[39]  Daron Acemoglu,et al.  Theory, General Equilibrium and Political Economy in Development Economics , 2010 .

[40]  B. Nyhan,et al.  When Corrections Fail: The Persistence of Political Misperceptions , 2010 .

[41]  J. Cappella,et al.  Broadcast Adwatch Effects , 1994 .

[42]  David W. Nickerson Is Voting Contagious? Evidence from Two Field Experiments , 2008, American Political Science Review.

[43]  R. Hogan Factors Conditioning the Representational Activities of State Legislators , 2012 .

[44]  P. Loewen,et al.  For want of a nail: Negative persuasion in a party leadership race , 2011 .

[45]  Daniel M. Butler,et al.  Can Learning Constituency Opinion Affect How Legislators Vote? Results from a Field Experiment , 2011 .

[46]  Richard F. Fenno Home Style : House Members in Their Districts , 1978 .

[47]  David E. Broockman Black Politicians Are More Intrinsically Motivated to Advance Blacks’ Interests: A Field Experiment Manipulating Political Incentives , 2013 .

[48]  M. Humphreys,et al.  Policing politicians: Citizen empowerment and political accountability in Uganda -Preliminary analysis (IGC Working Paper) , 2013 .

[49]  Gwyneth H. McClendon Social Esteem and Participation in Contentious Politics: A Field Experiment at an LGBT Pride Rally , 2014 .

[50]  Brian F. Schaffner,et al.  Incumbents Out, Party In? Term Limits and Partisan Redistricting in State Legislatures , 2004, State Politics & Policy Quarterly.

[51]  P. Ubel,et al.  The Hazards of Correcting Myths About Health Care Reform , 2013, Medical care.

[52]  The Strategy of the Story: Media Monitoring Legislative Activity , 2008 .

[53]  J. Cappella,et al.  Setting the Record Straight , 1997 .

[54]  Donald P. Green,et al.  Field Experiments: Design, Analysis, and Interpretation , 2012 .

[55]  D. Bergan Does Grassroots Lobbying Work? , 2009 .

[56]  David E. Broockman,et al.  Do Politicians Racially Discriminate Against Constituents? A Field Experiment on State Legislators , 2011 .

[57]  S. Iyengar,et al.  Can the Press Monitor Campaign Advertising? , 1996 .

[58]  Michael Kremer,et al.  Chapter 61 Using Randomization in Development Economics Research: A Toolkit ★ , 2007 .

[59]  Jesse M. Shapiro,et al.  The Effect of Newspaper Entry and Exit on Electoral Politics , 2009 .

[60]  S. Mccorkle,et al.  The News Factory , 1980 .

[61]  Steven D. Levitt,et al.  Was There Really a Hawthorne Effect at the Hawthorne Plant? An Analysis of the Original Illumination Experiments , 2009 .