Another look at the regression discontinuity design

The attractiveness of the Regression Discontinuity Design (RDD) in its sharp formulation rests on close similarities with a formal experimental design. On the other hand, it is of limited applicability since rarely individuals are assigned to the treatment group on the basis of a pre-program measure observable to the analyst. Besides, it only allows to identify the mean impact of the program for a very specific sub-population of individuals. In this paper we show that the sharp RDD straightforwardly generalizes to the instances in which the eligibility for the program is established with respect to an observable pre-program measure with eligible individuals self-selecting into the treatment group according to an unknown process. This set-up also turns out very convenient to define a specification test on conventional non-experimental estimators of the program effect needed to identify the mean impact away from the threshold for eligibility. Data requirements are made explicit.

[1]  W. V. D. Klaauw,et al.  Estimating the Effect of Financial Aid Offers on College Enrollment: A Regression-Discontinuity Approach , 2002 .

[2]  P. Rosenbaum.  The Role of a Second Control Group in an Observational Study , 1987 .

[3]  J. Porter.  Asymptotic Bias and Optimal Convergence Rates for Semiparametric Kernel Estimators in the Regression Discontinuity Model , 2002 .

[4]  J. Heckman,et al.  Making the Most out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts , 1997 .

[5]  James J. Heckman,et al.  Randomization as an Instrumental Variable , 1995 .

[6]  D. Rubin,et al.  Estimating Outcome Distributions for Compliers in Instrumental Variables Models , 1997 .

[7]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[8]  Michael Lechner.  A Note on the Common Support Problem in Applied Evaluation Studies , 2000 .

[9]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[10]  Howard S. Bloom,et al.  Accounting for No-Shows in Experimental Evaluation Designs , 1984 .

[11]  Jeffrey A. Smith,et al.  Accounting for Dropouts in Evaluations of Social Experiments , 1994 .

[12]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[13]  James J. Heckman,et al.  Assessing the Case for Social Experiments , 1995 .

[14]  David H. Greenberg,et al.  Evaluating Government Training Programs for the Economically Disadvantaged , 1997 .

[15]  J. Heckman.  Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations. , 1997 .

[16]  J. Angrist,et al.  Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants , 1995 .

[17]  Donald T. Campbell,et al.  Reforms as Experiments , 1969 .

[18]  R. Little,et al.  Statistical Techniques for Analyzing Data from Prevention Trials: Treatment of No-Shows Using Rubin's Causal Model , 1998 .

[19]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[20]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[21]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[22]  D. Campbell,et al.  Regression-Discontinuity Analysis: An Alternative to the Ex-Post Facto Experiment , 1960 .

[23]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[24]  James J. Heckman,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training , 1989 .

[25]  William M. K. Trochim,et al.  Research Design for Program Evaluation: The Regression-Discontinuity Approach , 1984 .

[26]  P. Rosenbaum.  From Association to Causation in Observational Studies: The Role of Tests of Strongly Ignorable Treatment Assignment , 1984 .

[27]  James G. Mulligan,et al.  The Review of Economics and Statistics , 1998 .

[28]  D. Rubin.  ASSIGNMENT TO TREATMENT GROUP ON THE BASIS OF A COVARIATE , 1976 .

[29]  Enrico Rettore,et al.  Testing for programme effects in a regression discontinuity design with imperfect compliance , 2002 .

[30]  R. Blundell,et al.  Evaluation Methods for Non‐Experimental Data , 2005 .