Causal Inference With Interference and Noncompliance in Two-Stage Randomized Experiments

Abstract In many social science experiments, subjects often interact with each other and as a result one unit’s treatment influences the outcome of another unit. Over the last decade, a significant progress has been made toward causal inference in the presence of such interference between units. Researchers have shown that the two-stage randomization of treatment assignment enables the identification of average direct and spillover effects. However, much of the literature has assumed perfect compliance with treatment assignment. In this article, we establish the nonparametric identification of the complier average direct and spillover effects in two-stage randomized experiments with interference and noncompliance. In particular, we consider the spillover effect of the treatment assignment on the treatment receipt as well as the spillover effect of the treatment receipt on the outcome. We propose consistent estimators and derive their randomization-based variances under the stratified interference assumption. We also prove the exact relationships between the proposed randomization-based estimators and the popular two-stage least squares estimators. The proposed methodology is motivated by and applied to our own randomized evaluation of India’s National Health Insurance Program (RSBY), where we find some evidence of spillover effects. The proposed methods are implemented via an open-source software package. Supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.

[1]  Jin Tian,et al.  On the Identification of Causal Effects , 2015 .

[2]  The Crowding-Out Effect of Formal Insurance on Informal Risk Sharing: An Experimental Study , 2014 .

[3]  P. Aronow A General Method for Detecting Interference Between Units in Randomized Experiments , 2010 .

[4]  Peter M. Aronow,et al.  Estimating Average Causal Effects Under Interference Between Units , 2013, 1305.6156.

[5]  Edoardo M. Airoldi,et al.  Identification and Estimation of Treatment and Interference Effects in Observational Studies on Networks , 2016, Journal of the American Statistical Association.

[6]  Guanglei Hong Causality in a Social World: Moderation, Meditation and Spill-over , 2015 .

[7]  Frederick Mosteller,et al.  Identification and estimation. , 1955 .

[8]  M. Hudgens,et al.  Toward Causal Inference With Interference , 2008, Journal of the American Statistical Association.

[9]  G. Imbens,et al.  Exact p-Values for Network Interference , 2015, 1506.02084.

[10]  J. Aislinn Bohren,et al.  Optimal Design of Experiments in the Presence of Interference , 2017, Review of Economics and Statistics.

[11]  Daniel F. McCaffrey,et al.  Bias reduction in standard errors for linear regression with multi-stage samples , 2002 .

[12]  E. Lehmann Elements of large-sample theory , 1998 .

[13]  H. White,et al.  Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties☆ , 1985 .

[14]  P. Rosenbaum Interference Between Units in Randomized Experiments , 2007 .

[15]  M. Halloran,et al.  Causal Inference in Infectious Diseases , 1995, Epidemiology.

[16]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[17]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[18]  Zhuang Fengqing,et al.  Patients’ Responsibilities in Medical Ethics , 2016 .

[19]  Wanchuan Lin,et al.  The Crowding-Out Effect of Formal Insurance on Informal Risk Sharing: An Experimental Study , 2014, Games Econ. Behav..

[20]  Tyler J VanderWeele,et al.  On causal inference in the presence of interference , 2012, Statistical methods in medical research.

[21]  G. Imbens,et al.  Peer Encouragement Designs in Causal Inference with Partial Interference and Identification of Local Average Network Effects , 2016, 1609.04464.

[22]  Michael G. Hudgens,et al.  Large Sample Randomization Inference of Causal Effects in the Presence of Interference , 2014, Journal of the American Statistical Association.

[23]  P. Holland Statistics and Causal Inference , 1985 .

[24]  T. VanderWeele,et al.  Mediation and Spillover Effects in Group-Randomized Trials: A Case Study of the 4Rs Educational Intervention , 2013, Journal of the American Statistical Association.

[25]  Peter M. Aronow,et al.  Estimating Average Causal Effects Under General Interference , 2012 .

[26]  S. Raudenbush,et al.  Evaluating Kindergarten Retention Policy , 2006 .

[27]  J. I The Design of Experiments , 1936, Nature.

[28]  P. Ding,et al.  General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference , 2016, 1610.04821.

[29]  Michael E. Sobel,et al.  What Do Randomized Studies of Housing Mobility Demonstrate? , 2006 .

[30]  E. Ohlsson Asymptotic normality for two-stage sampling from a finite population , 1989 .

[31]  P. Berman,et al.  The impoverishing effect of healthcare payments in India: new methodology and findings. , 2010 .

[32]  K. Rao,et al.  Insured yet vulnerable: out-of-pocket payments and India's poor. , 2012, Health policy and planning.

[33]  Alex J. Chin,et al.  Central limit theorems via Stein's method for randomized experiments under interference , 2018, 1804.03105.

[34]  M. Jowett Do informal risk sharing networks crowd out public voluntary health insurance? Evidence from Vietnam , 2003 .

[35]  Avi Feller,et al.  Analyzing Two-Stage Experiments in the Presence of Interference , 2016, 1608.06805.

[36]  Fredrik Sävje,et al.  AVERAGE TREATMENT EFFECTS IN THE PRESENCE OF UNKNOWN INTERFERENCE. , 2017, Annals of statistics.

[37]  Ya-li Wu,et al.  [null]. , 2019, Zhongguo ying yong sheng li xue za zhi = Zhongguo yingyong shenglixue zazhi = Chinese journal of applied physiology.

[38]  D. Rubin [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .