Bounding treatment effects by pooling limited information across observations

We provide novel bounds on average treatment effects (on the treated) that are valid under an unconfoundedness assumption. Our bounds are designed to be robust in challenging situations, for example, when the conditioning variables take on a large number of different values in the observed sample, or when the overlap condition is violated. This robustness is achieved by only using limited “pooling” of information across observations. Namely, the bounds are constructed as sample averages over functions of the observed outcomes such that the contribution of each outcome only depends on the treatment status of a limited number of observations. No information pooling across observations leads to so-called “Manski bounds”, while unlimited information pooling leads to standard inverse propensity score weighting. We explore the intermediate range between these two extremes and provide corresponding inference methods. We show in Monte Carlo experiments and through an empirical application that our bounds are indeed robust and informative in practice.

[1]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[2]  Charles F. Manski,et al.  Confidence Intervals for Partially Identified Parameters , 2003 .

[3]  G. Imbens,et al.  Estimation of Causal Effects using Propensity Score Weighting: An Application to Data on Right Heart Catheterization , 2001, Health Services and Outcomes Research Methodology.

[4]  E. Vytlacil,et al.  Treatment Effect Bounds under Monotonicity Assumptions: An Application to Swan-Ganz Catheterization , 2008 .

[5]  Kari Lock Morgan,et al.  Balancing Covariates via Propensity Score Weighting , 2014, 1609.07494.

[6]  Alexander D'Amour,et al.  Overlap in observational studies with high-dimensional covariates , 2017, Journal of Econometrics.

[7]  Timothy B. Armstrong,et al.  Finite-Sample Optimal Estimation and Inference on Average Treatment Effects Under Unconfoundedness , 2017, Econometrica.

[8]  Yuya Sasaki,et al.  ESTIMATION AND INFERENCE FOR MOMENTS OF RATIOS WITH ROBUSTNESS AGAINST LARGE TRIMMING BIAS , 2017, Econometric Theory.

[9]  C. Manski Nonparametric Bounds on Treatment Effects , 1989 .

[10]  Richard K. Crump,et al.  Dealing with limited overlap in estimation of average treatment effects , 2009 .

[11]  Shakeeb Khan,et al.  Irregular Identification, Support Conditions, and Inverse Weight Estimation , 2010 .

[12]  Sokbae Lee,et al.  Intersection bounds: estimation and inference , 2009, 0907.3503.

[13]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .

[14]  Edward Vytlacil,et al.  Treatment Effect Bounds : An Application to Swan-Ganz Catheterization ∗ , 2011 .

[15]  C. Rothe Robust Confidence Intervals for Average Treatment Effects Under Limited Overlap , 2017, SSRN Electronic Journal.

[16]  S. Bonhomme,et al.  Discretizing Unobserved Heterogeneity , 2017, Econometrica.

[17]  Daniel Müllner,et al.  fastcluster: Fast Hierarchical, Agglomerative Clustering Routines for R and Python , 2013 .

[18]  Jörg Stoye,et al.  More on Confidence Intervals for Partially Identified Parameters , 2008 .

[19]  Michael P. Leung,et al.  Inference on Finite Population Treatment Effects Under Limited Overlap , 2019 .

[20]  A simple, short, but never-empty confidence interval for partially identified parameters , 2022 .

[21]  C. Manski Anatomy of the Selection Problem , 1989 .

[22]  Matías Busso,et al.  New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators , 2014, Review of Economics and Statistics.

[23]  P. Ding,et al.  Asymptotic inference of causal effects with observational studies trimmed by the estimated propensity scores , 2018 .

[24]  G. Imbens,et al.  On the Failure of the Bootstrap for Matching Estimators , 2006 .

[25]  Fabrizia Mealli,et al.  Estimating Population Average Causal Effects in the Presence of Non-Overlap: A Bayesian Approach , 2018, 1805.09736.

[26]  L. Goldman,et al.  The effectiveness of right heart catheterization in the initial care of critically ill patients. SUPPORT Investigators. , 1996, JAMA.

[27]  G. Imbens,et al.  Bias-Corrected Matching Estimators for Average Treatment Effects , 2002 .

[28]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .