Matching With Multiple Control Groups With Adjustment for Group Differences

When estimating causal effects from observational data, it is desirable to approximate a randomized experiment as closely as possible. This goal can often be achieved by choosing a subsample from the original control group that matches the treatment group on the distribution of the observed covariates. However, sometimes the original control group cannot provide adequate matches for the treatment group. This article presents a method to obtain matches from multiple control groups. In addition to adjusting for differences in observed covariates between the groups, the method adjusts for a group effect that distinguishes between the control groups. This group effect captures the additional otherwise unobserved differences between the control groups, beyond that accounted for by the observed covariates. The method is illustrated and evaluated using data from an evaluation of a school drop-out prevention program that uses matches from both local and nonlocal control groups.

[1]  Donald B. Rubin,et al.  The Computerized Construction of a Matched Sample , 1970, American Journal of Sociology.

[2]  D. Rubin,et al.  Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates , 2000 .

[3]  Donald B. Rubin,et al.  Affinely invariant matching methods with discriminant mixtures of proportional ellipsoidally symmetric distributions , 2006, math/0611263.

[4]  A. Dempster,et al.  Combining Historical and Randomized Controls for Assessing Trends in Proportions , 1983 .

[5]  S G Baker,et al.  Rethinking historical controls. , 2001, Biostatistics.

[6]  Donald B. Rubin,et al.  Multivariate matching methods that are equal percent bias reducing , 1974 .

[7]  Vincent Mor,et al.  Principles for modeling propensity scores in medical research: a systematic literature review , 2004, Pharmacoepidemiology and drug safety.

[8]  S. Morgan,et al.  Matching Estimators of Causal Effects , 2006 .

[9]  Steven Glazerman,et al.  Nonexperimental Versus Experimental Estimates of Earnings Impacts , 2003 .

[10]  Paul R Rosenbaum,et al.  Optimal Pair Matching With Two Control Groups , 2004 .

[11]  Donald B. Rubin,et al.  Multivariate matching methods that are equal percent bias reducing , 1974 .

[12]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[13]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[14]  D B Rubin,et al.  Matching using estimated propensity scores: relating theory to practice. , 1996, Biometrics.

[15]  D. Rubin,et al.  Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score , 1985 .

[16]  S G Baker,et al.  The paired availability design: a proposal for evaluating epidural analgesia during labor. , 1994, Statistics in medicine.

[17]  Donald B. Rubin,et al.  Characterizing the effect of matching using linear propensity score methods with normal distributions , 1992 .

[18]  P. Gleason,et al.  Impacts of School Restructuring Initiatives , 1998 .

[19]  Donald B. Rubin,et al.  MULTIVARIATE MATCHING METHODS THAT ARE EQUAL PERCENT BIAS REDUCING, I: SOME EXAMPLES , 1974 .

[20]  Donald B. Rubin,et al.  Combining Panel Data Sets with Attrition and Refreshment Samples , 1998 .

[21]  Russell V. Lenth,et al.  Statistical Analysis With Missing Data (2nd ed.) (Book) , 2004 .

[22]  D. Rubin.  Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation , 2001, Health Services and Outcomes Research Methodology.

[23]  Donald B Rubin,et al.  On principles for modeling propensity scores in medical research , 2004, Pharmacoepidemiology and drug safety.

[24]  N. Christakis,et al.  The health impact of health care on families: a matched cohort study of hospice use by decedents and mortality outcomes in surviving, widowed spouses. , 2003, Social science & medicine.

[25]  D. Rubin,et al.  Using Multivariate Matched Sampling and Regression Adjustment to Control Bias in Observational Studies , 1978 .

[26]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[27]  D. Rubin.  Matched Sampling for Causal Effects: The Use of Matched Sampling and Regression Adjustment to Remove Bias in Observational Studies , 1973 .

[28]  D. Rubin.  Matched Sampling for Causal Effects: Matching to Remove Bias in Observational Studies , 1973 .

[29]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator , 1998 .

[30]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[31]  P. Rosenbaum.  The Role of a Second Control Group in an Observational Study , 1987 .

[32]  W. G. Cochran,et al.  Controlling Bias in Observational Studies: A Review. , 1974 .

[33]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[34]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[35]  Kosuke Imai,et al.  Causal Inference With General Treatment Regimes , 2004 .

[36]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[37]  Assessing Effects on Long-term Survival after Early Termination of Randomized Trials , 1999, Lifetime data analysis.

[38]  Roberto Agodini,et al.  Are Experiments the Only Option? A Look at Dropout Prevention Programs , 2004, Review of Economics and Statistics.

[39]  Herbert L. Smith.  6. Matching with Multiple Controls to Estimate Treatment Effects in Observational Studies , 1997 .

[40]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[41]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[42]  Kenneth Lange,et al.  Numerical analysis for statisticians , 1999 .