Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models

Abstract Regression discontinuity models are commonly used to nonparametrically identify and estimate a local average treatment effect (LATE).We show that the derivative of the treatment effect with respect to the running variable at the cutoff, referred to as the treatment effect derivative (TED), is nonparametrically identified, easily estimated, and has implications for testing external validity and extrapolating the estimated LATE away from the cutoff. Given a local policy invariance assumption, we further show this TED equals the change in the treatment effect that would result from a marginal change in the threshold, which we call the marginal threshold treatment effect (MTTE). We apply these results to Goodman (2008), who estimates the effect of a scholarship program on college choice. MTTE in this case identifies how this treatment effect would change if the test score threshold to qualify for a scholarship were changed, even though no such change in threshold is actually observed.

[1]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[2]  D. Campbell,et al.  Regression-Discontinuity Analysis: An Alternative to the Ex-Post Facto Experiment , 1960 .

[3]  Edward Vytlacil,et al.  Evaluating Marginal Policy Changes and the Average Effect of Treatment for Individuals at the Margin , 2009, Econometrica : journal of the Econometric Society.

[4]  Douglas L. Miller,et al.  Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design , 2005, SSRN Electronic Journal.

[5]  Yingying Dong Jump or Kink? Identification of Binary Treatment Regression Discontinuity Design without the Discontinuity , 2014 .

[6]  David S. Lee Randomized experiments from non-random selection in U.S. House elections , 2005 .

[7]  Miikka Rokkanen,et al.  Wanna Get Away? Rd Identification Away from the Cutoff , 2012, SSRN Electronic Journal.

[8]  David Card,et al.  The Impact of Nearly Universal Insurance Coverage on Health Care Utilization: Evidence from Medicare. , 2008, The American economic review.

[9]  Marco Manacorda The Cost of Grade Retention , 2010, Review of Economics and Statistics.

[10]  J. Kmenta Mostly Harmless Econometrics: An Empiricist's Companion , 2010 .

[11]  Joshua Goodman,et al.  Who Merits Financial Aid?: Massachusetts' Adams Scholarship , 2008 .

[12]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[13]  J. Heckman,et al.  Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation , 2007 .

[14]  Angus Deaton,et al.  Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development , 2009 .

[15]  J. Angrist,et al.  The Elite Illusion: Achievement Effects at Boston and New York Exam Schools. NBER Working Paper No. 17264. , 2011 .

[16]  A. Deaton Instruments of Development: Randomization in the Tropics, and the Search for the Elusive Keys to Economic Development , 2009 .

[17]  G. Imbens,et al.  Better Late than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009) , 2009 .

[18]  David Card,et al.  Nonlinear Policy Rules and the Identification and Estimation of Causal Effects in a Generalized Regression Kink Design , 2012 .

[19]  Michael Greenstone,et al.  WELCOME Does Hazardous Waste Matter ? Evidence from the Housing Market and the Superfund Program * , 2005 .

[20]  Yingying Dong An Alternative Assumption to Identify LATE in Regression Discontinuity Designs , 2014 .

[21]  Yingying Dong,et al.  Jumpy or Kinky? Regression Discontinuity without the Discontinuity , 2010 .

[22]  G. Weber,et al.  The Retirement Consumption Puzzle: Evidence from a Regression Discontinuity Approach , 2007 .

[23]  James J Heckman,et al.  Comparing IV with Structural Models: What Simple IV Can and Cannot Identify , 2009, Journal of econometrics.

[24]  David S. Lee,et al.  Regression Discontinuity Designs in Economics , 2009 .

[25]  C. Kirabo Jackson,et al.  Do Students Benefit from Attending Better Schools? Evidence from Rule‐based Student Assignments in Trinidad and Tobago* , 2010 .

[26]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[27]  Parag A. Pathak,et al.  The Elite Illusion: Achievement Effects at Boston and New York Exam Schools , 2011, Social Science Research Network.

[28]  Guido W. Imbens,et al.  External Validity in Fuzzy Regression Discontinuity Designs , 2014, Journal of Business & Economic Statistics.

[29]  Coady Wing,et al.  STRENGTHENING THE REGRESSION DISCONTINUITY DESIGN USING ADDITIONAL DESIGN ELEMENTS: A WITHIN‐STUDY COMPARISON , 2013 .

[30]  James J Heckman,et al.  Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy , 2010, Journal of economic literature.

[31]  Jack Porter,et al.  Estimation in the Regression Discontinuity Model , 2003 .

[32]  Yingying Dong,et al.  Regression Discontinuity Applications with Rounding Errors in the Running Variable , 2015 .

[33]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .