Bias-Corrected Matching Estimators for Average Treatment Effects

In Abadie and Imbens (2006), it was shown that simple nearest-neighbor matching estimators include a conditional bias term that converges to zero at a rate that may be slower than N1/2. As a result, matching estimators are not N1/2-consistent in general. In this article, we propose a bias correction that renders matching estimators N1/2-consistent and asymptotically normal. To demonstrate the methods proposed in this article, we apply them to the National Supported Work (NSW) data, originally analyzed in Lalonde (1986). We also carry out a small simulation study based on the NSW example. In this simulation study, a simple implementation of the bias-corrected matching estimator performs well compared to both simple matching estimators and to regression estimators in terms of bias, root-mean-squared-error, and coverage rates. Software to compute the estimators proposed in this article is available on the authors’ web pages (http://www.economics.harvard.edu/faculty/imbens/software.html) and documented in Abadie et al. (2003).

[1]  G. Imbens,et al.  Implementing Matching Estimators for Average Treatment Effects in Stata , 2004 .

[2]  Zhong Zhao,et al.  Using Matching to Estimate Treatment Effects: Data Requirements, Matching Metrics, and Monte Carlo Evidence , 2004, Review of Economics and Statistics.

[3]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .

[4]  Markus Frlich,et al.  Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators , 2004, Review of Economics and Statistics.

[5]  G. W. Imbens.  Sensitivity to Exogeneity Assumptions in Program Evaluation , 2003 .

[6]  Alberto Abadie.  Semiparametric instrumental variable estimation of treatment response models , 2003 .

[7]  Sascha O. Becker,et al.  Estimation of Average Treatment Effects Based on Propensity Scores , 2002 .

[8]  P. Rosenbaum.  Covariance Adjustment in Randomized Experiments and Observational Studies , 2002 .

[9]  Howard S. Bloom,et al.  Can Nonexperimental Comparison Group Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs? , 2002 .

[10]  Michael Lechner,et al.  Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods , 2002 .

[11]  O. Linton,et al.  Asymptotic Expansions for Some Semiparametric Program Evaluation Estimators , 2001 .

[12]  Costas Meghir,et al.  Evaluating the Employment Impact of a Mandatory Job Search Assistance Program , 2001 .

[13]  Petra E. Todd,et al.  Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods , 2001 .

[14]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[15]  P. Rosenbaum,et al.  Substantial Gains in Bias Reduction from Matching with a Variable Number of Controls , 2000, Biometrics.

[16]  G. Imbens,et al.  Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score , 2000 .

[17]  G. Imbens,et al.  Estimating the Effect of Unearned Income on Labor Earnings , Savings , and Consumption : Evidence from a Survey of Lottery Players , 2008 .

[18]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[19]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[20]  J. Angrist,et al.  Empirical Strategies in Labor Economics , 1998 .

[21]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator , 1998 .

[22]  J. Hahn.  On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects , 1998 .

[23]  A. Yatchew,et al.  Nonparametric Regression Techniques in Economics , 1998 .

[24]  T. Shakespeare,et al.  Observational Studies , 2003 .

[25]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[26]  T. Mattfeldt.  Stochastic Geometry and Its Applications , 1996 .

[27]  P. R. Rosembaum,et al.  Identification of Causal Effects Using Instrumental Variables: Comment , 1996 .

[28]  D B Rubin,et al.  Matching using estimated propensity scores: relating theory to practice. , 1996, Biometrics.

[29]  J. Robins,et al.  Semiparametric regression estimation in the presence of dependent censoring , 1995 .

[30]  Philip K. Robins,et al.  Evaluating Program Evaluations: New Evidence on Commonly Used Nonexperimental Methods , 1995 .

[31]  J. Angrist,et al.  Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants , 1995 .

[32]  J. Robins,et al.  Analysis of semiparametric regression models for repeated outcomes in the presence of missing data , 1995 .

[33]  J. Robins,et al.  Semiparametric Efficiency in Multivariate Regression Models with Missing Data , 1995 .

[34]  M. Lechner.  Earnings and Employment Effects of Continuous Gff-the-Job Training in East Germany After Unification , 1995 .

[35]  J. Møller,et al.  Lectures on Random Voronoi Tessellations , 1994 .

[36]  M. Sobel,et al.  Identification Problems in the Social Sciences , 1996 .

[37]  Paul R. Rosenbaum,et al.  Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms , 1993 .

[38]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[39]  Whitney Newey.  Convergence Rates for Series Estimators , 1993 .

[40]  Donald B. Rubin,et al.  Characterizing the effect of matching using linear propensity score methods with normal distributions , 1992 .

[41]  Donald B. Rubin,et al.  Affinely Invariant Matching Methods with Ellipsoidal Distributions , 1992 .

[42]  Charles F. Manski,et al.  Alternative Estimates of the Effect of Family Structure during Adolescence on High School Graduation , 1992 .

[43]  Daniel W. Stroock,et al.  A concise introduction to the theory of integration , 1990 .

[44]  Paul R. Rosenbaum,et al.  Optimal Matching for Observational Studies , 1989 .

[45]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[46]  James J. Heckman,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training , 1989 .

[47]  C. Manski.  Nonparametric Bounds on Treatment Effects , 1989 .

[48]  David Card,et al.  Measuring the Effect of Subsidized Training Programs on Movements in Andout of Employment , 1987 .

[49]  J. Heckman,et al.  Longitudinal Analysis of Labor Market Data: Alternative methods for evaluating the impact of interventions , 1985 .

[50]  James J. Heckman,et al.  Alternative methods for evaluating the impact of interventions: An overview , 1985 .

[51]  James J. Heckman,et al.  Longitudinal Analysis of Labor Market Data , 1985 .

[52]  D. Rubin,et al.  Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score , 1985 .

[53]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[54]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[55]  P. Rosenbaum.  Conditional Permutation Tests and the Propensity Score in Observational Studies , 1984 .

[56]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[57]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[58]  D. Rubin,et al.  Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome , 1983 .

[59]  D. Quade,et al.  Nonparametric analysis of covariance by matching. , 1982, Biometrics.

[60]  Burt S. Barnow,et al.  Issues in the Analysis of Selectivity Bias. Discussion Papers. Revised. , 1980 .

[61]  D. Rubin,et al.  Using Multivariate Matched Sampling and Regression Adjustment to Control Bias in Observational Studies , 1978 .

[62]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[63]  D. Rubin.  Assignment to Treatment Group on the Basis of a Covariate , 1976 .

[64]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[65]  W. G. Cochran,et al.  Controlling Bias in Observational Studies: A Review. , 1974 .

[66]  F. Olver.  Asymptotics and Special Functions , 1974 .

[67]  D. Rubin.  Matched Sampling for Causal Effects: Matching to Remove Bias in Observational Studies , 1973 .

[68]  W. G. Cochran.  The effectiveness of adjustment by subclassification in removing bias in observational studies. , 1968, Biometrics.

[69]  R. Sheppard,et al.  RECENT DEVELOPMENTS IN THE , 1966 .

[70]  D. Horvitz,et al.  A Generalization of Sampling Without Replacement from a Finite Universe , 1952 .

[71]  D. F. Hays,et al.  Table of Integrals, Series, and Products , 1966 .