Interpreting Regression Discontinuity Designs with Multiple Cutoffs

We consider a regression discontinuity (RD) design where the treatment is received if a score is above a cutoff, but the cutoff may vary for each unit in the sample instead of being equal for all units. This multi-cutoff regression discontinuity design is very common in empirical work, and researchers often normalize the score variable and use the zero cutoff on the normalized score for all observations to estimate a pooled RD treatment effect. We formally derive the form that this pooled parameter takes and discuss its interpretation under different assumptions. We show that this normalizing-and-pooling strategy so commonly employed in practice may not fully exploit all the information available in a multi-cutoff RD setup. We illustrate our methodological results with three empirical examples based on vote shares, population, and test scores.

[1]  V. J. Hotz,et al.  Predicting the efficacy of future training programs using past experiences at other locations , 2005 .

[2]  Jake Bowers,et al.  Reasoning About Interference between Units , 2012, 1208.0366.

[3]  Jake Bowers,et al.  Reasoning about Interference Between Units: A General Framework , 2013, Political Analysis.

[4]  Matias D. Cattaneo,et al.  Randomization Inference in the Regression Discontinuity Design: An Application to Party Advantages in the U.S. Senate , 2015 .

[5]  Donald P. Green,et al.  Detecting Spillover Effects: Design and Analysis of Multilevel Experiments , 2012 .

[6]  Arthur Lewbel,et al.  Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models , 2015, Review of Economics and Statistics.

[7]  David S. Lee Randomized experiments from non-random selection in U.S. House elections , 2005 .

[8]  Jasjeet S. Sekhon,et al.  Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008 , 2011, Political Analysis.

[9]  Matias D. Cattaneo,et al.  rdrobust: An R Package for Robust Nonparametric Inference in Regression-Discontinuity Designs , 2015, R J..

[10]  Matias D. Cattaneo,et al.  Optimal Data-Driven Regression Discontinuity Plots , 2015 .

[11]  K. Chay,et al.  The Central Role of Noise in Evaluating Interventions that Use Test Scores to Rank Schools , 2003 .

[12]  Max H. Farrell,et al.  On the Effect of Bias Estimation on Coverage Accuracy in Nonparametric Inference , 2015, Journal of the American Statistical Association.

[13]  David S. Lee,et al.  Economic Impacts of New Unionization on Private Sector Employers: 1984–2001 , 2004 .

[14]  Guido Imbens,et al.  Site Selection Bias in Program Evaluation , 2014 .

[15]  Richard J. Murnane,et al.  Extending the regression-discontinuity approach to multiple assignment variables , 2011 .

[16]  Matias D. Cattaneo,et al.  Robust Data-Driven Inference in the Regression-Discontinuity Design , 2014 .

[17]  Matias D Cattaneo,et al.  Comparing Inference Approaches for RD Designs: a Reexamination of the Effect of Head Start on Child Mortality. , 2017, Journal of policy analysis and management : [the journal of the Association for Public Policy Analysis and Management].

[18]  Matias D. Cattaneo,et al.  Inference in Regression Discontinuity Designs under Local Randomization , 2016 .

[19]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[20]  Kosuke Imai,et al.  Misunderstandings About the Regression Discontinuity Design in the Study of Close Elections , 2016 .

[21]  Jens Hainmueller,et al.  On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from over 40,000 Close Races , 2014 .

[22]  R. Titiunik,et al.  A Practical Guide to Regression Discontinuity Designs in Political Science , 2015 .

[23]  L. Keele,et al.  Geographic Boundaries as Regression Discontinuities , 2015, Political Analysis.

[24]  R. Titiunik,et al.  The Incumbency Curse: Weak Parties, Term Limits, and Unfulfilled Accountability , 2017, American Political Science Review.

[25]  R. Pieters,et al.  Working Paper , 1994 .

[26]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[27]  Sebastian Calonico,et al.  Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs , 2014 .

[28]  Vivian C. Wong,et al.  Analyzing Regression-Discontinuity Designs With Multiple Assignment Variables , 2013 .