How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities

This paper investigates if research findings change political leaders’ beliefs and cause policy change. Collaborating with the National Confederation of Municipalities in Brazil, we work with 2,150 municipalities and the mayors who control their policies. We use experiments to measure mayors’ demand for research information and their response to learning research findings. In one experiment, we find that mayors and other municipal officials are willing to pay to learn the results of impact evaluations, and update their beliefs when informed of the findings. They value larger-sample studies more, while not distinguishing on average between studies conducted in rich and poor countries. In a second experiment, we find that informing mayors about research on a simple and effective policy (reminder letters for taxpayers) increases the probability that their municipality implements the policy by 10 percentage points. In sum, we provide direct evidence that providing research information to political leaders can lead to policy change. Information frictions may thus help explain failures to adopt effective policies.

[1]  J. List,et al.  The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance , 2017 .

[2]  E. Duflo,et al.  Truth-Telling by Third-Party Auditors and the Response of Polluting Firms: Experimental Evidence from India , 2013 .

[3]  Sendhil Mullainathan,et al.  Comparison Friction: Experimental Evidence from Medicare Drug Plans , 2011, The quarterly journal of economics.

[4]  R. Glennerster,et al.  Debates: Voting and Expenditure Responses to Political Communication , 2020, Journal of Political Economy.

[5]  Christopher Roth,et al.  Does Information Change Attitudes Towards Immigrants? Representative Evidence from Survey Experiments , 2016, SSRN Electronic Journal.

[6]  E. Masset,et al.  What is the impact of a policy brief? Results of an experiment in research dissemination , 2013 .

[7]  Monica Martinez-Bravo Replication data for: The Local Political Economy Effects of School Construction in Indonesia , 2019 .

[8]  Ethan Porter,et al.  The Elusive Backfire Effect: Mass Attitudes’ Steadfast Factual Adherence , 2019 .

[9]  Thomas Fujiwara,et al.  Can Informed Public Deliberation Overcome Clientelism? Experimental Evidence from Benin , 2013 .

[10]  B. Nyhan,et al.  When Corrections Fail: The Persistence of Political Misperceptions , 2010 .

[11]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[12]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[13]  Yang Yao,et al.  Subnational leaders and economic growth: evidence from Chinese cities , 2015 .

[14]  Nicholas Ryan,et al.  The Value of Regulatory Discretion: Estimates from Environmental Inspections in India , 2014 .

[15]  E. Duflo,et al.  The Value of Discretion in the Enforcement of Regulation: Experimental Evidence and Structural Estimates from Environmental Inspections in India∗ , 2014 .

[16]  Monica Martinez-Bravo,et al.  The Role of Local Officials in New Democracies: Evidence from Indonesia , 2014 .

[17]  Esther Duflo,et al.  WOMEN AS POLICY MAKERS: EVIDENCE FROM A RANDOMIZED POLICY EXPERIMENT IN INDIA , 2004 .

[18]  Deanna Kuhn,et al.  Effects of Evidence on Attitudes: Is Polarization the Norm? , 1996 .

[19]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[20]  John A. List,et al.  Journal of Economic Behavior & Organization , 1999 .

[21]  D. McKenzie,et al.  Does Management Matter? Evidence from India , 2011 .

[22]  Guo Xu The Costs of Patronage : Evidence from the British Empire , 2017 .

[23]  Rebecca Dizon-Ross Parents’ Beliefs about Their Children’s Academic Ability: Implications for Educational Investments , 2019, American Economic Review.

[24]  C. Belfield,et al.  Lifetime Effects: The High/Scope Perry Preschool Study Through Age 40 , 2005 .

[25]  Stephen Coleman,et al.  The Minnesota income tax compliance experiment: State tax results , 1996 .

[26]  D. Benjamin,et al.  Errors in Probabilistic Reasoning and Judgment Biases , 2018 .

[27]  W. Barnett Effectiveness of Early Educational Intervention , 2011, Science.

[28]  Christopher Roth,et al.  Labor Market Concerns and Support for Immigration , 2017, Journal of Public Economics.

[29]  Lucía Del Carpio Are the Neighbors Cheating? Evidence from a Social Norm Experiment on Property Taxes in Peru Job Market Paper , 2014 .

[30]  Matthew C Kiernan,et al.  What is impact? , 2011, Journal of Neurology, Neurosurgery & Psychiatry.

[31]  Dmitar Tasić Individuals and Organizations , 2020 .

[32]  E. Masset,et al.  What Difference does a Policy Brief Make , 2012 .

[33]  Frederico Finan,et al.  Chapter 6 – The Personnel Economics of the Developing State , 2017 .

[34]  S. Walker,et al.  Effects of early childhood psychosocial stimulation and nutritional supplementation on cognition and education in growth-stunted Jamaican children: prospective cohort study , 2005, The Lancet.

[35]  Ulrike Malmendier,et al.  The Making of Hawks and Doves: Inflation Experiences on the FOMC , 2017 .

[36]  J. Himes,et al.  Nutritional supplementation, psychosocial stimulation, and mental development of stunted children: the Jamaican Study , 1991, The Lancet.

[37]  Costas Meghir,et al.  Using the infrastructure of a conditional cash transfer program to deliver a scalable integrated early child development program in Colombia: cluster randomized controlled trial , 2014, BMJ : British Medical Journal.

[38]  Anusha Nath Bureaucrats and Politicians: How Does Electoral Competition Affect Bureaucratic Performance? , 2014 .

[39]  Stefano DellaVigna,et al.  Predicting Experimental Results: Who Knows What? , 2016, Journal of Political Economy.

[40]  Justin M. Rao,et al.  The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself , 2011 .

[41]  Carlos Scartascini,et al.  Tax Compliance and Enforcement in the Pampas: Evidence from a Field Experiment , 2013 .

[42]  Eva Vivalt How Do Policymakers Update? , 2018 .

[43]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[44]  Camilla A. Heid,et al.  Head Start Impact Study. Final Report. , 2010 .

[45]  Frederico Finan,et al.  Exposing Corrupt Politicians: The Effects of Brazil's Publicly Released Audits on Electoral Outcomes , 2005 .

[46]  Peggy A. Hite,et al.  Persuasive Communications: Tax Compliance Enforcement Strategies for Sole Proprietors* , 2007 .

[47]  Marianne Bertrand,et al.  The Glittering Prizes: Career Incentives and Bureaucrat Performance , 2019, The Review of Economic Studies.

[48]  Esther Duflo,et al.  Female Leadership Raises Aspirations and Educational Attainment for Girls: A Policy Experiment in India , 2012, Science.

[49]  Jonas Hjort,et al.  Individuals and Organizations as Sources of State Effectiveness , 2017, American Economic Review.

[50]  Benjamin F. Jones,et al.  Do Leaders Matter? National Leadership and Growth Since World War Ii , 2004 .

[51]  B. Olken,et al.  Making Moves Matter: Experimental Evidence on Incentivizing Bureaucrats Through Performance-Based Postings , 2018, American Economic Review.

[52]  B. Olken,et al.  Tax Farming Redux: Experimental Evidence on Performance Pay for Tax Collectors , 2014 .

[53]  D. Kahan The Politically Motivated Reasoning Paradigm, Part 1: What Politically Motivated Reasoning Is and How to Measure It , 2016 .

[54]  Robert T. Jensen,et al.  The (Perceived) Returns to Education and the Demand for Schooling , 2010 .

[55]  M. Mobius,et al.  Managing Self-Confidence: Theory and Experimental Evidence , 2011, Manag. Sci..

[56]  Vera Lucia Punzi Barcelos Capone,et al.  Análise e indexação da paisagem: o Arquivo Fotográfico Ilustrativo dos Trabalhos Geográficos de Campo do Instituto Brasileiro de Geografia e Estatística , 2016 .

[57]  Rupert Sausgruber,et al.  TESTING ENFORCEMENT STRATEGIES IN THE FIELD: THREAT, MORAL APPEAL AND SOCIAL INFORMATION , 2013 .

[58]  Imran Rasul,et al.  Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service , 2013 .

[59]  Daniel Rogger,et al.  Hierarchy and Information , 2018, AEA Randomized Controlled Trials.

[60]  Emmanuel Saez,et al.  Teaching the Tax Code: Earnings Responses to an Experiment with EITC Recipients , 2009 .

[61]  G. Tabellini,et al.  Political Economics: Explaining Economic Policy , 2000 .

[62]  叶茵 There Is No Place like Home , 2008 .

[63]  Sergio Firpo,et al.  Electoral Impacts of Uncovering Public School Quality: Evidence from Brazilian Municipalities , 2012, SSRN Electronic Journal.

[64]  Decision-Making Under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires , 2016 .

[65]  Rafael Terra,et al.  Accountability and yardstick competition in the public provision of education , 2017 .

[66]  L. Trucco,et al.  Political Turnover, Bureaucratic Turnover, and the Quality of Public Services , 2017, American Economic Review.

[67]  Martin Baekgaard,et al.  The Role of Evidence in Politics: Motivated Reasoning and Persuasion among Politicians , 2017, British Journal of Political Science.

[68]  T. Besley,et al.  Do Educated Leaders Matter? , 2011 .