Regression discontinuity designs are underutilized in medicine, epidemiology, and public health: a review of current and best practice.

OBJECTIVES Regression discontinuity (RD) designs allow for rigorous causal inference when patients receive a treatment based on scoring above or below a cutoff point on a continuously measured variable. We provide an introduction to the theory of RD and a systematic review and assessment of the RD literature in medicine, epidemiology, and public health. STUDY DESIGN AND SETTING We review the necessary conditions for valid RD results, provide a practical guide to RD implementation, compare RD to other methodologies, and conduct a systematic review of the RD literature in PubMed. RESULTS We describe five key elements of analysis all RD studies should report, including tests of validity conditions and robustness checks. Thirty two empirical RD studies in PubMed met our selection criteria. Most of the 32 RD articles analyzed the effectiveness of social policies or mental health interventions, with only two evaluating clinical interventions to improve physical health. Seven out of the 32 studies reported on all the five key elements. CONCLUSION Increased use of RD provides an exciting opportunity for obtaining unbiased causal effect estimates when experiments are not feasible or when we want to evaluate programs under "real-life" conditions. Although treatment eligibility in medicine, epidemiology, and public health is commonly determined by threshold rules, use of RD in these fields has been very limited until now.

[1]  David S. Lee The Electoral Advantage to Incumbency and Voters&Apos; Valuation of Politicians&Apos; Experience: A Regression Discontinuity Analysis of Elections to the U.S.. , 2001 .

[2]  H. Robbins,et al.  Clinical and prophylactic trials with assured new treatment for those at greater risk: I. A design proposal. , 1996, American journal of public health.

[3]  Richard A. Berk,et al.  Capitalizing on Nonrandom Assignment to Treatments: A Regression-Discontinuity Evaluation of a Crime-Control Program , 1983 .

[4]  P. Rothwell,et al.  External validity of randomised controlled trials: “To whom do the results of this trial apply?” , 2005, The Lancet.

[5]  Christine M. Wickens,et al.  Evidence from regression‐discontinuity analyses for beneficial effects of a criterion‐based increase in alcohol treatment , 2013, International journal of methods in psychiatric research.

[6]  T. Bärnighausen,et al.  Three approaches to causal inference in regression discontinuity designs. , 2015, Epidemiology.

[7]  Miriam Wüst,et al.  Can Caesarean section improve child and maternal health? The case of breech babies. , 2015, Journal of health economics.

[8]  William T. Gormley,et al.  Childhood Programs and Practices in the First Decade of Life: Small Miracles in Tulsa: The Effects of Universal Pre-K on Cognitive Development , 2010 .

[9]  Julia Andrea Behrman,et al.  The effect of increased primary schooling on adult women's HIV status in Malawi and Uganda: Universal Primary Education as a natural experiment. , 2015, Social science & medicine.

[10]  David S. Lee,et al.  Regression Discontinuity Designs in Economics , 2009 .

[11]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[12]  J. Arcand,et al.  Teacher training and HIV/AIDS prevention in West Africa: regression discontinuity design evidence from the Cameroon. , 2010, Health economics.

[13]  E. Conover,et al.  Health consequences of easier access to alcohol: New Zealand evidence. , 2013, Journal of health economics.

[14]  P. Jensen Implementation of CBT for youth affected by the World Trade Center disaster: matching need to treatment intensity and reducing trauma symptoms. , 2010, Journal of Traumatic Stress.

[15]  H Robbins,et al.  Clinical and prophylactic trials with assured new treatment for those at greater risk: II. Examples. , 1996, American journal of public health.

[16]  James K. Cunningham,et al.  Effects of the minimum legal drinking age on alcohol-related health service use in hospital settings in Ontario: a regression-discontinuity approach. , 2013, American journal of public health.

[17]  Vivian C. Wong,et al.  Empirical Tests of the Validity of the Regression Discontinuity Design (WP-07-02) , 2007 .

[18]  Mabel Andalón Oportunidades to reduce overweight and obesity in Mexico? , 2011, Health economics.

[19]  G. Imbens,et al.  Evaluating the Cost of Conscription in The Netherlands , 1995 .

[20]  Oshua,et al.  USING MAIMONIDES’ RULE TO ESTIMATE THE EFFECT OF CLASS SIZE ON SCHOLASTIC ACHIEVEMENT* , 2003 .

[21]  Victor Lavy,et al.  Using Maimonides' Rule to Estimate the Effect of Class Size on Student Achievement , 1999 .

[22]  T. Osler,et al.  Effectiveness of nonpublic report cards for reducing trauma mortality. , 2014, JAMA surgery.

[23]  Jay S Kaufman,et al.  Effect of human papillomavirus (HPV) vaccination on clinical indicators of sexual behaviour among adolescent girls: the Ontario Grade 8 HPV Vaccine Cohort Study , 2015, Canadian Medical Association Journal.

[24]  Jason M. Fletcher Enhancing the Gene-Environment Interaction Framework Through a Quasi-Experimental Research Design: Evidence from Differential Responses to September 11 , 2014, Biodemography and social biology.

[25]  N. Sood,et al.  Government health insurance for people below poverty line in India: quasi-experimental evaluation of insurance and health outcomes , 2014, BMJ : British Medical Journal.

[26]  M. Petticrew,et al.  Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions , 2009, Journal of Epidemiology & Community Health.

[27]  J. Banks,et al.  The Effect of Education on Old Age Cognitive Abilities: Evidence from a Regression Discontinuity Design , 2012, Economic journal.

[28]  R. Callaghan,et al.  Impacts of the minimum legal drinking age legislation on in-patient morbidity in Canada, 1997-2007: a regression-discontinuity approach. , 2013, Addiction.

[29]  H. Bang,et al.  Early versus standard antiretroviral therapy for HIV-infected adults in Haiti. , 2010, The New England journal of medicine.

[30]  Kristin F. Butcher,et al.  Is Being in School Better? the Impact of School on Children&Apos;S BMI When Starting Age is Endogenous , 2011, Journal of health economics.

[31]  M. Vera-Hernandez,et al.  Risk Protection, Service Use, and Health Outcomes Under Colombia&Apos;S Health Insurance Program for the Poor , 2009, American economic journal. Applied economics.

[32]  D. Rubin ASSIGNMENT TO TREATMENT GROUP ON THE BASIS OF A COVARIATE , 1976 .

[33]  Michael J Silverberg,et al.  Effect of early versus deferred antiretroviral therapy for HIV on survival. , 2009, The New England journal of medicine.

[34]  Thomas D. Cook,et al.  "Waiting for Life to Arrive": A history of the regression-discontinuity design in Psychology, Statistics and Economics , 2008 .

[35]  Stephen R Cole,et al.  Timing of initiation of antiretroviral therapy in AIDS-free HIV-1-infected patients: a collaborative analysis of 18 HIV cohort studies , 2009, The Lancet.

[36]  F. Mosteller The promise of risk-based allocation trials in assessing new treatments. , 1996, American journal of public health.

[37]  Till Bärnighausen,et al.  Regression Discontinuity Designs in Epidemiology: Causal Inference Without Randomized Trials , 2014 .

[38]  Michael S. Dahl,et al.  In Sickness and in Wealth , 2012, Personality & social psychology bulletin.

[39]  H. Hashimoto,et al.  Health benefits of reduced patient cost sharing in Japan. , 2012, Bulletin of the World Health Organization.

[40]  M. Greenstone,et al.  Evidence on the impact of sustained exposure to air pollution on life expectancy from China’s Huai River policy , 2013, Proceedings of the National Academy of Sciences.

[41]  Justin McCrary,et al.  Manipulation of the Running Variable in the Regression Discontinuity Design: A Density Test , 2007 .

[42]  L. Lequien,et al.  Does compulsory education lower mortality? , 2009, Journal of Health Economics.

[43]  D. Campbell,et al.  Regression-Discontinuity Analysis: An Alternative to the Ex-Post Facto Experiment , 1960 .

[44]  D. de la Mata,et al.  The effect of Medicaid eligibility on coverage, utilization, and children's health. , 2012, Health economics.

[45]  Wei Huang,et al.  Effects of education on cognition at older ages: evidence from China's Great Famine. , 2013, Social science & medicine.

[46]  Monica Deza,et al.  The Effects of Alcohol on the Consumption of Hard Drugs: Regression Discontinuity Evidence from the National Longitudinal Study of Youth, 1997 , 2015, Health economics.

[47]  David S. Lee Randomized experiments from non-random selection in U.S. House elections , 2005 .

[48]  Michael Rayment,et al.  Prevention of HIV-1 infection with early antiretroviral therapy , 2012, Journal of Family Planning and Reproductive Health Care.

[49]  J. Ragland,et al.  Clinical and Functional Outcomes After 2 Years in the Early Detection and Intervention for the Prevention of Psychosis Multisite Effectiveness Trial , 2014, Schizophrenia bulletin.

[50]  Heidi L. Williams,et al.  Estimating Marginal Returns to Medical Care: Evidence from At-Risk Newborns , 2008, The quarterly journal of economics.

[51]  The effects of universal pre-K on cognitive development. , 2005 .

[52]  T. Stockwell,et al.  Impacts of drinking-age laws on mortality in Canada, 1980-2009. , 2014, Drug and alcohol dependence.

[53]  Emmanuel Skoufias,et al.  An Evaluation of the Performance of Regression Discontinuity Design on Progresa , 2004 .

[54]  Christopher S. Carpenter,et al.  The minimum legal drinking age and public health. , 2011, The journal of economic perspectives : a journal of the American Economic Association.

[55]  Barış K. Yörük,et al.  The impact of drinking on psychological well-being: evidence from minimum drinking age laws in the United States. , 2012, Social science & medicine.

[56]  F. Sloan,et al.  The effects of technological advances on outcomes for elderly persons with exudative age-related macular degeneration. , 2014, JAMA ophthalmology.