Reasoning About Interference between Units

If an experimental treatment is experienced by both treated and control group units, tests of hypotheses about causal effects may be difficult to conceptualize let alone execute. In this paper, we show how counterfactual causal models may be written and tested when theories suggest spillover or other network-based interference among experimental units. We show that the "no interference'' assumption need not constrain scholars who have interesting questions about interference. We offer researchers the ability to model theories about how treatment given to some units may come to influence outcomes for other units. We further show how to test hypotheses about these causal effects, and we provide tools to enable researchers to assess the operating characteristics of their tests given their own models, designs, test statistics, and data. The conceptual and methodological framework we develop here is particularly applicable to social networks, but may be usefully deployed whenever a researcher wonders about interference between units. Interference between units need not be an untestable assumption; instead, interference is an opportunity to ask meaningful questions about theoretically interesting phenomena.

[1]  R. Berger,et al.  P Values Maximized Over a Confidence Set for the Nuisance Parameter , 1994 .

[2]  Tyler J. VanderWeele,et al.  Marginal Structural Models for the Estimation of Direct and Indirect Effects , 2009, Epidemiology.

[3]  Mervyn J. Silvapulle,et al.  A Test in the Presence of Nuisance Parameters , 1996 .

[4]  Peter M. Aronow,et al.  Estimating Average Causal Effects Under General Interference , 2012 .

[5]  Erich L. Lehmann,et al.  Basic Concepts of Probability and Statistics , 1965 .

[6]  M. Hudgens,et al.  Toward Causal Inference With Interference , 2008, Journal of the American Statistical Association.

[7]  Michail Prodan,et al.  CHAPTER 17 – THE PLANNING OF EXPERIMENTS , 1968 .

[8]  T. Shakespeare,et al.  Observational Studies , 2003 .

[9]  I NICOLETTI,et al.  The Planning of Experiments , 1936, Rivista di clinica pediatrica.

[10]  D. Rubin.  [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .

[11]  Jake Bowers,et al.  Covariate balance in simple stratified and clustered comparative studies , 2008, 0808.3857.

[12]  T. VanderWeele.  Bias Formulas for Sensitivity Analysis for Direct and Indirect Effects , 2010, Epidemiology.

[13]  Tyler J. VanderWeele,et al.  Bounding the Infectiousness Effect in Vaccine Trials , 2011, Epidemiology.

[14]  David W. Nickerson.  Cambridge Handbook of Experimental Political Science: Social Networks and Political Context , 2011 .

[15]  C. Borror.  Nonparametric Statistical Methods, 2nd, Ed. , 2001 .

[16]  Michael R. Kosorok,et al.  The University of North Carolina at Chapel Hill Department of Biostatistics , 2012 .

[17]  P. Rosenbaum.  Hodges-Lehmann Point Estimates of Treatment Effect in Observational Studies , 1993 .

[18]  R. A. Fisher,et al.  Design of Experiments , 1936 .

[19]  Luke Keele,et al.  Statistical Inference For Experiments , 2008 .

[20]  Kevin A. Clarke,et al.  A Model Discipline , 2012 .

[21]  Edward Miguel,et al.  Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities, Guide to Replication of Miguel and Kremer (2004) , 2014 .

[22]  G. Barnard.  Significance tests for 2 X 2 tables. , 1947, Biometrika.

[23]  Corrine M. McConnaughy,et al.  Strengthening the Experimenter’s Toolbox: Statistical Estimation of Internal Validity , 2012 .

[24]  R J Little,et al.  Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches. , 2000, Annual review of public health.

[25]  Peter M. Aronow,et al.  On equivalencies between design-based and regression-based variance estimators for randomized experiments , 2012 .

[26]  David R. Cox,et al.  PRINCIPLES OF STATISTICAL INFERENCE , 2017 .

[27]  Henry E. Brady.  Causation and Explanation in Social Science , 2008 .

[28]  S. Raudenbush,et al.  Evaluating Kindergarten Retention Policy , 2006 .

[29]  J. L. Hodges,et al.  Estimates of Location Based on Rank Tests , 1963 .

[30]  D. Rubin.  Statistics and Causal Inference: Comment: Which Ifs Have Causal Answers , 1986 .

[31]  Jake Bowers,et al.  Attributing Effects to a Cluster-Randomized Get-Out-the-Vote Campaign , 2009 .

[32]  Michael Rosenblum,et al.  Using Regression Models to Analyze Randomized Trials: Asymptotically Valid Hypothesis Tests Despite Incorrectly Specified Models , 2009, Biometrics.

[33]  T. VanderWeele,et al.  Components of the indirect effect in vaccine trials: identification of contagion and infectiousness effects. , 2012, Epidemiology.

[34]  Michael G. Hudgens,et al.  Randomization-Based Inference Within Principal Strata , 2011, Journal of the American Statistical Association.

[35]  Christopher H. Achen.  Interpreting and Using Regression , 1982 .

[36]  P. Rosenbaum.  Interference Between Units in Randomized Experiments , 2007 .

[37]  Donald P. Green,et al.  Detecting Spillover Effects: Design and Analysis of Multilevel Experiments , 2012 .

[38]  W. Lin,et al.  Agnostic notes on regression adjustments to experimental data: Reexamining Freedman's critique , 2012, 1208.2301.

[39]  James M Robins,et al.  A mapping between interactions and interference: implications for vaccine trials. , 2012, Epidemiology.

[40]  D. Basu.  Randomization Analysis of Experimental Data: The Fisher Randomization Test , 1980 .

[41]  Paul R. Rosenbaum,et al.  Robust, accurate confidence intervals with a weak instrument: quarter of birth and education , 2005 .

[42]  P. Aronow.  A General Method for Detecting Interference Between Units in Randomized Experiments , 2010 .

[43]  Tyler J VanderWeele,et al.  On causal inference in the presence of interference , 2012, Statistical methods in medical research.

[44]  J. Sekhon.  The Neyman— Rubin Model of Causal Inference and Estimation Via Matching Methods , 2008 .

[45]  Christopher W. Larimer,et al.  Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment , 2008, American Political Science Review.

[46]  Tyler J VanderWeele,et al.  Causal inference under multiple versions of treatment , 2013, Journal of causal inference.

[47]  David A. Siegel.  Social Networks and Collective Action , 2009 .

[48]  Tyler J Vanderweele,et al.  Ignorability and stability assumptions in neighborhood effects research , 2008, Statistics in medicine.

[49]  T. VanderWeele.  Simple relations between principal stratification and direct and indirect effects , 2008 .

[50]  D. Rubin.  Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[51]  D. Rubin.  Causal Inference Using Potential Outcomes , 2005 .

[52]  Arthur Lupia,et al.  Cambridge Handbook of Experimental Political Science: Political Knowledge , 2011 .

[53]  David W. Nickerson.  Is Voting Contagious? Evidence from Two Field Experiments , 2008, American Political Science Review.

[54]  Nahomi Ichino,et al.  Deterring or Displacing Electoral Irregularities? Spillover Effects of Observers in a Randomized Field Experiment in Ghana , 2012, The Journal of Politics.

[55]  Michael E. Sobel,et al.  What Do Randomized Studies of Housing Mobility Demonstrate? , 2006 .

[56]  P. Holland.  Statistics and Causal Inference , 1985 .

[57]  Betsy Sinclair.  Cambridge Handbook of Experimental Political Science: Design and Analysis of Experiments in Multilevel Populations , 2011 .

[58]  Donald P. Green,et al.  Detecting Social Networks: Design and Analysis of Multilevel Experiments , 2010 .