Designing Experiments to Measure Spillover Effects

This paper formalizes the design of experiments intended specifically to study spillover effects. By first randomizing the intensity of treatment within clusters and then randomly assigning individual treatment conditional on this cluster-level intensity, a novel set of treatment effects can be identified. We develop a formal framework for consistent estimation of these effects, and provide explicit expressions for power calculations. We show that the power to detect average treatment effects declines precisely with the quantity that identifies the novel treatment effects. A demonstration of the technique is provided using a cash transfer program in Malawi.

[1]  Betsy Sinclair.  Cambridge Handbook of Experimental Political Science: Design and Analysis of Experiments in Multilevel Populations , 2011 .

[2]  Esther Duflo,et al.  Participation and Investment Decisions in a Retirement Plan: The Influence of Colleagues' Choices , 2000 .

[3]  Rachel E. Kranton,et al.  Identity and Schooling: Some Lessons for the Economics of Education , 2002 .

[4]  E. Oster,et al.  DETERMINANTS OF TECHNOLOGY ADOPTION: PEER EFFECTS IN MENSTRUAL CUP TAKE-UP , 2012 .

[5]  Giacomo De Giorgi,et al.  The Price Effects of Cash versus In-Kind Transfers , 2011 .

[6]  J. I.  The Design of Experiments , 1936, Nature.

[7]  Howard S. Bloom,et al.  Minimum Detectable Effects , 1995 .

[8]  Frederico Finan,et al.  Neighborhood Peer Effects in Secondary School Enrollment Decisions , 2009, The Review of Economics and Statistics.

[9]  C. Manski.  Identification of Endogenous Social Effects: The Reflection Problem , 1993 .

[10]  J. Gignoux,et al.  Policy Evaluation in the Presence of Spatial Externalities: Reassessing the Progresa Program , 2014 .

[11]  Sarah Baird,et al.  Cash or Condition? Evidence from a Cash Transfer Experiment , 2010 .

[12]  M. Hudgens,et al.  Toward Causal Inference With Interference , 2008, Journal of the American Statistical Association.

[13]  Esther Duflo,et al.  Do Labor Market Policies Have Displacement Effects? Evidence from a Clustered Randomized Experiment , 2012 .

[14]  Kaivan Munshi.  Networks in the Modern Economy: Mexican Migrants in the U. S. Labor Market , 2003 .

[15]  Peter Kooreman,et al.  The Effects of Lottery Prizes on Winners and Their Neighbors: Evidence from the Dutch Postcode Lottery , 2010, SSRN Electronic Journal.

[16]  Winford H. Masanjala.  The poverty-HIV/AIDS nexus in Africa: a livelihood approach. , 2007, Social science & medicine.

[17]  Timothy G. Conley,et al.  Learning About a New Technology: Pineapple in Ghana , 2010 .

[18]  Imran Rasul,et al.  Family Networks and School Enrolment: Evidence from a Randomized Social Experiment , 2009, SSRN Electronic Journal.

[19]  Ann Swidler,et al.  Ties of dependence: AIDS and transactional sex in rural Malawi. , 2006, Studies in family planning.

[20]  Edward Miguel,et al.  Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities, Data User's Guide , 2014 .

[21]  Geert Ridder,et al.  Measuring the Effects of Segregation in the Presence of Social Spillovers: A Nonparametric Approach , 2010 .

[22]  S. P. Kachur,et al.  Preventing Childhood Malaria in Africa by Protecting Adults from Mosquitoes with Insecticide-Treated Nets , 2007, PLoS medicine.

[23]  Petra E. Todd,et al.  Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico , 2005, Economic Development and Cultural Change.

[24]  Edward K. Kao,et al.  Estimation of Causal Peer Influence Effects , 2013, ICML.

[25]  Donald P. Green,et al.  Detecting Spillover Effects: Design and Analysis of Multilevel Experiments , 2012 .

[26]  E. Duflo,et al.  The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment , 2002 .

[27]  Rafael Lalive,et al.  Social Interactions and Schooling Decisions , 2006, The Review of Economics and Statistics.

[28]  Karen Macours,et al.  Changing Households' Investments and Aspirations Through Social Interactions: Evidence from a Randomized Transfer Program , 2008 .

[29]  Tyler J VanderWeele,et al.  On causal inference in the presence of interference , 2012, Statistical methods in medical research.

[30]  Lori Beaman,et al.  Social Networks and the Dynamics of Labour Market Outcomes: Evidence from Refugees Resettled in the U.S , 2012 .

[31]  Arun G. Chandrasekhar,et al.  The Diffusion of Microfinance , 2012, Science.

[32]  Ghazala Mansuri,et al.  Together We Will: Experimental Evidence on Female Voting Behavior in Pakistan , 2011 .

[33]  Charles F. Manski,et al.  Identification of Treatment Response with Social Interactions , 2013 .

[34]  R. Moffitt.  Policy Interventions, Low-Level Equilibria, and So-cial Interactions , 1999 .

[35]  Dean Karlan,et al.  Adaptive Experimental Design Using the Propensity Score , 2009 .

[36]  Keisuke Hirano,et al.  Design of randomized experiments to measure social interaction effects , 2010 .

[37]  Esther Duflo,et al.  Can Institutions Be Reformed from within? Evidence from a Randomized Experiment with the Rajasthan Police , 2012 .

[38]  Katharine R. E. Sims,et al.  The Ecological Footprint of Poverty Alleviation: Evidence from Mexico's Oportunidades Program , 2010, Review of Economics and Statistics.

[39]  Leigh L. Linden,et al.  Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia † , 2011 .

[40]  John L. Hartman,et al.  Networks and Workouts: Treatment Size and Status Specific Peer Effects in a Randomized Field Experiment , 2010 .

[41]  M. Angelucci,et al.  Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption? , 2009 .