Enhancing a geographic regression discontinuity design through matching to estimate the effect of ballot initiatives on voter turnout

Ballot initiatives allow the public to vote directly on public policy. The literature in political science has attempted to document whether the presence of an initiative can increase voter turnout. We study this question for an initiative that appeared on the ballot in 2008 in Milwaukee, Wisconsin, using a natural experiment based on geography. This form of natural experiment exploits variation in geography where units in one geographic area receive a treatment whereas units in another area do not. When assignment to treatment via geographic location creates as‐if random variation in treatment assignment, adjustment for baseline covariates is unnecessary. In many applications, however, some adjustment for baseline covariates may be necessary. As such, analysts may wish to combine identification strategies—using both spatial proximity and covariates. We propose a matching framework to incorporate information about both geographic proximity and observed covariates flexibly which allows us to minimize spatial distance while preserving balance on observed covariates. This framework is also applicable to regression discontinuity designs that are not based on geography. We find that the initiative on the ballot in Milwaukee does not appear to have increased turnout.

[1]  David B. Magleby Direct Legislation: Voting on Ballot Propositions in the United States , 1984 .

[2]  D. Campbell,et al.  Regression-Discontinuity Analysis: An Alternative to the Ex-Post Facto Experiment , 1960 .

[3]  W. V. D. Klaauw,et al.  Regression-Discontinuity Analysis: A Survey of Recent Developments in Economics , 2008 .

[4]  S. Malpezzi,et al.  Hedonic Pricing Models: A Selective and Applied Review , 2008 .

[5]  S. Kruger Design Of Observational Studies , 2016 .

[6]  J. L. Hodges,et al.  Estimates of Location Based on Rank Tests , 1963 .

[7]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[8]  Donald P. Green,et al.  Detecting Spillover Effects: Design and Analysis of Multilevel Experiments , 2012 .

[9]  David H. Everson The Effects of Initiatives On Voter Turnout: a Comparative State Analysis , 1981 .

[10]  Accounting for Limited Overlap in Estimation of Average Treatment Eects under Unconfoundedness , 2004 .

[11]  Paul R Rosenbaum,et al.  Attributing Effects to Treatment in Matched Observational Studies , 2002 .

[12]  Dylan S. Small,et al.  Split Samples and Design Sensitivity in Observational Studies , 2009 .

[13]  Dylan S. Small,et al.  Stronger instruments via integer programming in an observational study of late preterm birth outcomes , 2013, 1304.4066.

[14]  E. Lascher Educated by Initiative: The Effects of Direct Democracy on Citizens and Political Organizations in the American States , 2005, Perspectives on Politics.

[15]  Matias D. Cattaneo,et al.  Randomization Inference in the Regression Discontinuity Design: An Application to Party Advantages in the U.S. Senate , 2015 .

[16]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[17]  L. Keele,et al.  Geographic Boundaries as Regression Discontinuities , 2015, Political Analysis.

[18]  Dylan S. Small,et al.  Building a Stronger Instrument in an Observational Study of Perinatal Care for Premature Infants , 2010 .

[19]  Dylan S. Small,et al.  War and Wages : The Strength of Instrumental Variables and Their Sensitivity to Unobserved Biases , 2007 .

[20]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[21]  Stephen Sheppard,et al.  Hedonic analysis of housing markets , 1998 .

[22]  Luke Keele,et al.  Natural Experiments Based on Geography , 2015, Political Science Research and Methods.

[23]  D. Rubin Comment: Which Ifs Have Causal Answers , 1986 .

[24]  Randomization Inference in the Regression Discontinuity Design : Re-examining the empirical evidence on incumbency advantage in the U . S . House ∗ , 2012 .

[25]  P. Holland Statistics and Causal Inference , 1985 .

[26]  I NICOLETTI,et al.  The Planning of Experiments , 1936, Rivista di clinica pediatrica.

[27]  R. Lacey The Electoral Allure of Direct Democracy: The Effect of Initiative Salience on Voting, 1990-96 , 2005, State Politics & Policy Quarterly.

[28]  T. Shakespeare,et al.  Observational Studies , 2003 .

[29]  Adam Glynn,et al.  Why Process Matters for Causal Inference , 2011, Political Analysis.

[30]  David S. Lee,et al.  Regression Discontinuity Designs in Economics , 2009 .

[31]  David S. Lee Randomized experiments from non-random selection in U.S. House elections , 2005 .

[32]  Paul R. Rosenbaum,et al.  Optimal Matching of an Optimally Chosen Subset in Observational Studies , 2012 .

[33]  James M. Robins,et al.  Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models: Rejoinder , 1999 .

[34]  Richard K. Crump,et al.  Dealing with limited overlap in estimation of average treatment effects , 2009 .

[35]  Elizabeth A Stuart,et al.  Matching methods for causal inference: A review and a look forward. , 2010, Statistical science : a review journal of the Institute of Mathematical Statistics.

[36]  P. Rosenbaum,et al.  Minimum Distance Matched Sampling With Fine Balance in an Observational Study of Treatment for Ovarian Cancer , 2007 .

[37]  D. Schlozman,et al.  How Initiatives Don’t Always Make Citizens: Ballot Initiatives in the American States, 1978–2004 , 2008 .

[38]  Rachel R Kelz,et al.  Matching for Several Sparse Nominal Variables in a Case-Control Study of Readmission Following Surgery , 2011, The American statistician.

[39]  Victor Lavy From Forced Busing to Free Choice in Public Schools: Quasi-Experimental Evidence of Individual and General Effects , 2006 .

[40]  Donald P. Green,et al.  Detecting Spillover in Social Networks: Design and Analysis of Multilevel Experiments , 2008 .

[41]  Mark A Smith The Contingent Effects of Ballot Initiatives and Candidate Races on Turnout , 2001 .

[42]  Paul R. Rosenbaum,et al.  Optimal Matching for Observational Studies , 1989 .

[43]  Sebastian Calonico,et al.  Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs , 2014 .

[44]  Caroline J. Tolbert,et al.  The Effects of Ballot Initiatives on Voter Turnout in the American States , 2001 .

[45]  J. Zubizarreta Journal of the American Statistical Association Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure after Surgery Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure after Surgery , 2022 .

[46]  Jeffrey H Silber,et al.  Optimal multivariate matching before randomization. , 2004, Biostatistics.

[47]  M. Frölich Regression Discontinuity Design with Covariates , 2007, SSRN Electronic Journal.

[48]  Paul R. Rosenbaum,et al.  Sensitivity Analysis for Equivalence and Difference in an Observational Study of Neonatal Intensive Care Units , 2009 .

[49]  D. Rubin [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .