Mechanism Experiments and Policy Evaluations

Randomized controlled trials are increasingly used to evaluate policies. How can we make these experiments as useful as possible for policy purposes? We argue greater use should be made of experiments that identify behavioral mechanisms that are central to clearly specified policy questions, what we call "mechanism experiments." These types of experiments can be of great policy value even if the intervention that is tested (or its setting) does not correspond exactly to any realistic policy option.

[1]  Paul J. Ferraro,et al.  Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment , 2013 .

[2]  Daniel S. Nagin,et al.  Deterrence in the Twenty-First Century , 2013, Crime and Justice.

[3]  Claudia N. Avellaneda.  Mayoral Decision-Making: Issue Salience, Decision Context, and Choice Constraint? An Experimental Study with 120 Latin American Mayors , 2013 .

[4]  Michael Woolcock,et al.  Using case studies to explore the external validity of ‘complex’ development interventions , 2013 .

[5]  D. Pomeranz,et al.  No Taxation Without Information: Deterrence and Self-Enforcement in the Value Added Tax , 2013 .

[6]  R. Muradian,et al.  Can big push interventions take small-scale farmers out of poverty? Insights from the Sauri Millennium Village in Kenya , 2013 .

[7]  Kosuke Imai,et al.  Experimental designs for identifying causal mechanisms , 2013 .

[8]  Robert Dur,et al.  Dynamic Incentive Effects of Relative Performance Pay: A Field Experiment , 2010, SSRN Electronic Journal.

[9]  P. Cook,et al.  Lessons from the Economics of Crime: What Reduces Offending? , 2013 .

[10]  C. Traxler,et al.  Nudges at the Dentist , 2012, SSRN Electronic Journal.

[11]  Frans L. Leeuw,et al.  Linking theory-based evaluation and contribution analysis: Three problems and a few solutions , 2012 .

[12]  Tanguy Bernard,et al.  Impact evaluations: a tool for accountability? Lessons from experience at Agence Française de Développement , 2012 .

[13]  Philip J. Cook,et al.  The Impact of Drug Market Pulling Levers Policing on Neighborhood Violence , 2012 .

[14]  P. Dolan,et al.  Influencing behaviour: The mindspace way , 2012 .

[15]  Frans L. Leeuw,et al.  Cyber society and digital policies: Challenges to evaluation? 1 , 2012 .

[16]  S. Mullainathan,et al.  External Validity and Partner Selection Bias , 2012 .

[17]  J. Ludwig,et al.  Crime policy and informal social control , 2011 .

[18]  K. Salvanes,et al.  Priceless: The Nonpecuniary Benefits of Schooling , 2011 .

[19]  Susan Clampet-Lundquist,et al.  Moving Teenagers Out of High-Risk Neighborhoods: How Girls Fare Better than Boys , 2011, American Journal of Sociology.

[20]  L. Sanbonmatsu,et al.  Child Health and Neighborhood Conditions: Results from a Randomized Housing Voucher Experiment , 2010 .

[21]  J. Ge,et al.  Effects of statin therapy on inflammatory markers in chronic heart failure: a meta-analysis of randomized controlled trials. , 2010, Archives of medical research.

[22]  S. Cole,et al.  Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. , 2010, American journal of epidemiology.

[23]  Saskia Levy Thompson,et al.  Transforming the High School Experience: How New York City’s New Small Schools are Boosting Student Achievement and Graduation Rates , 2010 .

[24]  Angus Deaton.  Instruments, Randomization, and Learning about Development , 2010 .

[25]  James J Heckman,et al.  Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy , 2010, Journal of economic literature.

[26]  James Macinko,et al.  The changing distribution and determinants of obesity in the neighborhoods of New York City, 2003-2007. , 2010, American journal of epidemiology.

[27]  Joshua D. Angrist,et al.  The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics , 2010, SSRN Electronic Journal.

[28]  Christopher Jepsen,et al.  Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size , 2012 .

[29]  A. Beatty.  Strengthening Benefit-Cost Analysis for Early Childhood Interventions: Workshop Summary , 2009 .

[30]  Philip Oreopoulos,et al.  How Large are Returns to Schooling? Hint: Money Isn't Everything , 2009 .

[31]  B. Sen,et al.  The Relationship between Neighborhood Quality and Obesity Among Children , 2009 .

[32]  G. Imbens,et al.  Better Late than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009) , 2009 .

[33]  Lawrence F. Katz,et al.  What Can We Learn about Neighborhood Effects from the Moving to Opportunity Experiment? , 2009 .

[34]  W. Elliott.  Reduction in Blood Pressure With Statins: Results From the UCSD Statin Study, a Randomized Trial , 2009 .

[35]  J. Angrist.  Mostly Harmless Econometrics , 2008 .

[36]  Linda Steg,et al.  The Spreading of Disorder , 2008, Science.

[37]  Justine S. Hastings,et al.  Financial Literacy, Information, and Demand Elasticity: Survey and Experimental Evidence from Mexico , 2008 .

[38]  J. Ludwig,et al.  The Effects of Housing Assistance on Labor Supply: Evidence from a Voucher Lottery , 2008 .

[39]  Abhijit Banerjee,et al.  The Experimental Approach to Development Economics , 2008 .

[40]  Joel E Dimsdale,et al.  Reduction in blood pressure with statins: results from the UCSD Statin Study, a randomized trial. , 2008, Archives of internal medicine.

[41]  Community health centers , 2007 .

[42]  Justine S. Hastings,et al.  Information, School Choice, and Academic Achievement: Evidence from Two Experiments , 2007 .

[43]  M. Lipsey,et al.  Effects of Cognitive-Behavioral Programs for Criminal Offenders: A Systematic Review , 2007 .

[44]  Kenneth I. Wolpin,et al.  Ex Ante Policy Evaluation, Structural Estimation and Model Selection , 2007 .

[45]  M. Lipsey,et al.  Effects of Cognitive Behavioral Programs for Criminal Offenders , 2007 .

[46]  M Alan Brookhart,et al.  Primary prevention of cardiovascular diseases with statin therapy: a meta-analysis of randomized controlled trials. , 2006, Archives of internal medicine.

[47]  Diane Whitmore Schanzenbach,et al.  What Have Researchers Learned from Project STAR? , 2006 .

[48]  Petra E. Todd,et al.  Ex Ante Evaluation of Social Programs , 2006 .

[49]  A. Malani.  Identifying Placebo Effects with Data from Clinical Trials , 2006, Journal of Political Economy.

[50]  Jeffrey R. Kling,et al.  Incarceration Length, Employment, and Earnings , 2006 .

[51]  Jeffrey R. Kling,et al.  Neighborhoods and Academic Achievement: Results from the Moving to Opportunity Experiment. NBER Working Paper No. 11909. , 2006 .

[52]  H. Bloom,et al.  Promoting Work in Public Housing. The Effectiveness of Jobs-Plus. Final Report. , 2005 .

[53]  V. J. Hotz,et al.  Predicting the efficacy of future training programs using past experiences at other locations , 2005 .

[54]  T. Wilt,et al.  Effectiveness of statin therapy in adults with coronary heart disease , 2004 .

[55]  Lawrence F. Katz,et al.  Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment , 2004 .

[56]  T. Wilt,et al.  Effectiveness of statin therapy in adults with coronary heart disease. , 2004, Archives of internal medicine.

[57]  G. Harrison,et al.  Field experiments , 1924, The Journal of Agricultural Science.

[58]  C. Leaf,et al.  Why we're losing the war on cancer (and how to win it). , 2004, Fortune.

[59]  Joel E Dimsdale,et al.  Conceptual foundations of the UCSD Statin Study: a randomized controlled trial assessing the impact of statins on cognition, behavior, and biochemistry. , 2004, Archives of internal medicine.

[60]  H. White,et al.  Conceptual Foundations of the UCSD Statin Study , 2004 .

[61]  A. Gotto.  Safety and statin therapy: reconsidering the risks and benefits. , 2003, Archives of internal medicine.

[62]  J. Ludwig,et al.  Policing Crime Guns , 2003 .

[63]  B. Carruthers,et al.  Social Economics: Market Behavior in a Social Environment , 2010 .

[64]  E. Duflo,et al.  The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment , 2002 .

[65]  Catherine P. Bradshaw,et al.  The use of propensity scores to assess the generalizability of results from randomized trials , 2011, Journal of the Royal Statistical Society. Series A,.

[66]  Richard Rosenfeld,et al.  Gun Violence: The Real Costs , 2001 .

[67]  F. Earls,et al.  Youth exposure to violence: prevalence, risks, and consequences. , 2001, The American journal of orthopsychiatry.

[68]  Lawrence F. Katz,et al.  Bullets Don't Got No Name: Consequences of Fear in the Ghetto , 2001 .

[69]  W. Freudenburg.  RESEARCH IN SOCIAL PROBLEMS AND PUBLIC POLICY , 1999 .

[70]  E. Lazear,et al.  Educational Production , 1999 .

[71]  S. Ross,et al.  Clinical outcomes in statin treatment trials: a meta-analysis. , 1999, Archives of internal medicine.

[72]  A. Krueger,et al.  Experimental Estimates of Education Production Functions , 1997 .

[73]  W. Wilson.  When Work Disappears: The World of the New Urban Poor , 1996 .

[74]  Bruce D. Meyer.  Natural and Quasi- Experiments in Economics , 1994 .

[75]  J. Newhouse.  Free for All?: Lessons from the RAND Health Insurance Experiment , 1993 .

[76]  H. London,et al.  Social experimentation , 1993 .

[77]  L. Pbert,et al.  Effectiveness of a meditation-based stress reduction program in the treatment of anxiety disorders. , 1992, The American journal of psychiatry.

[78]  James J. Heckman,et al.  Randomization and Social Policy Evaluation , 1991 .

[79]  H. James.  VARIETIES OF SELECTION BIAS , 1990 .

[80]  Joshua D. Angrist,et al.  Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records , 1990 .

[81]  W. Wilson,et al.  The Truly Disadvantaged: The Inner City, The Underclass, and Public Policy. , 1988 .

[82]  R. Gottlieb,et al.  The New Yorker , 1987 .

[83]  J. Harris.  Macro-Experiments Versus Micro-Experiments for Health Policy , 1981 .

[84]  P. Shrout.  Quasi-experimentation: Design and analysis issues for field settings: by Thomas D. Cook and Donald T. Campbell. Chicago: Rand McNally, 1979 , 1980 .

[85]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[86]  D. Commerce.  Statistical abstract of the United States , 1978 .

[87]  T. McErlean,et al.  Controlled study of child health supervision: behavioral results. , 1977, Pediatrics.

[88]  M. Carroll.  The Belknap Press of Harvard University Press , 1970 .

[89]  David Card,et al.  WORKING PAPER SERIES BETTER LATE THAN NOTHING : SOME COMMENTS ON DEATON ( 2009 ) AND HECKMAN AND URZUA , 2022 .