Regression Discontinuity Designs Based on Population Thresholds: Pitfalls and Solutions

In many countries, important features of municipal government (such as the electoral system, mayors' salaries, and the number of councillors) depend on whether the municipality is above or below arbitrary population thresholds. Several papers have used a regression discontinuity design (RDD) to measure the effects of these threshold-based policies on political and economic outcomes. Using evidence from France, Germany, and Italy, we highlight two common pitfalls that arise in exploiting population-based policies (confounded treatment and sorting) and we provide guidance for detecting and addressing these pitfalls. Even when these problems are present, population-threshold RDD may be the best available research design for studying the effects of certain policies and political institutions.

[1]  M. Mukherjee.  Do Better Roads Increase School Enrollment? Evidence from a Unique Road Policy in India , 2012 .

[2]  Thomas Fujiwara.  A Regression Discontinuity Test of Strategic Voting and Duverger's Law ∗ , 2011 .

[3]  Jordi Jofre-Monseny,et al.  ‘Hold that Ghost’: Using Notches to Identify Manipulation of Population-Based Grants , 2015, SSRN Electronic Journal.

[4]  Zareh Asatryan,et al.  The Effect of Direct Democracy on the Level and Structure of Local Taxes , 2014 .

[5]  Ke-Li Xu,et al.  Estimation and Inference of Discontinuity in Density , 2013 .

[6]  Voters are Rational , 2013 .

[7]  Justin McCrary,et al.  Manipulation of the Running Variable in the Regression Discontinuity Design: A Density Test , 2007 .

[8]  L. Keele,et al.  Geographic Boundaries as Regression Discontinuities , 2015, Political Analysis.

[9]  T. Baskaran.  The flypaper effect: evidence from a natural experiment in Hesse , 2012 .

[10]  Andrew C. Eggers.  Proportionality and Turnout , 2015 .

[11]  T. Nannicini,et al.  Do Fiscal Rules Matter , 2016 .

[12]  P. Egger,et al.  Government Spending and Legislative Organization: Quasi-experimental Evidence from Germany , 2010 .

[13]  Thomas Le Barbanchon,et al.  Regression Discontinuity Design with Continuous Measurement Error in the Running Variable , 2017, SSRN Electronic Journal.

[14]  M. D. Cattaneo,et al.  rddensity : Manipulation Testing Based on Density Discontinuity , 2017 .

[15]  Jens Hainmueller,et al.  On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from over 40,000 Close Races , 2014 .

[16]  Ronny Freier,et al.  Signature requirements and citizen initiatives: Quasi-experimental evidence from Germany , 2013 .

[17]  Brigitte Unger,et al.  Do Wages Affect Politicians' Performance? A regression discontinuity approach for Dutch municipalities , 2014 .

[18]  Guido de Blasio,et al.  Electoral Rules and Voter Turnout , 2011 .

[19]  Kevin M. Morrison,et al.  The Impact of Intergovernmental Transfers on Education Outcomes and Poverty Reduction , 2013 .

[20]  Albert Saiz,et al.  Women and Power: Unpopular, Unwilling, or Held Back? , 2015, Journal of Political Economy.

[21]  T. Nannicini,et al.  Do Better Paid Politicians Perform Better? Disentangling Incentives from Selection , 2010, SSRN Electronic Journal.

[22]  D. Hopkins.  Translating into Votes: The Electoral Impacts of Spanish-Language Ballots: TRANSLATING INTO VOTES , 2011 .

[23]  D. Hopkins.  Translating into Votes: The Electoral Impact of Spanish-Language Ballots , 2011 .

[24]  Tommaso Nannicini,et al.  Policy Responses to Fiscal Restraints: A Difference-in-Discontinuities Design , 2012, SSRN Electronic Journal.

[25]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[26]  G. Tabellini,et al.  Social Capital and Political Accountability , 2010 .

[27]  E. Wegner,et al.  Electoral Rules and Clientelistic Parties: A Regression Discontinuity Approach , 2013 .

[28]  Jasjeet S. Sekhon,et al.  Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008 , 2011, Political Analysis.

[29]  Sebastian Calonico,et al.  Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs , 2014 .

[30]  Alan Barreca,et al.  Saving babies? Revisiting the effect of very low birth weight classification. , 2011, The quarterly journal of economics.

[31]  S. Litschig,et al.  Government spending and re-election: Quasi-experimental evidence from Brazilian municipalities , 2012 .

[32]  Motivating Politicians: The Impacts of Monetary Incentives on Quality and Performance , 2008 .

[33]  Per Pettersson-Lidbom.  Does the Size of the Legislature Affect the Size of Government? Evidence from Two Natural Experiments , 2006 .

[34]  Pamela Campa.  Gender Quotas, Female Politicians and Public Expenditures: Quasi-Experimental Evidence , 2011 .

[35]  T. Baskaran,et al.  Electoral Competition and Endogenous Political Institutions: Quasi-Experimental Evidence from Germany , 2015 .

[36]  Matias D. Cattaneo,et al.  Simple Local Polynomial Density Estimators , 2018, Journal of the American Statistical Association.

[37]  Michael M. Ting,et al.  Barcelona Economics Working Paper Series Are Rules-based Government Programs Shielded from Special-interest Politics? Evidence from Revenue-sharing Transfers in Brazil Are Rules-based Government Programs Shielded from Special-interest Politics? Evidence from Revenue-sharing Transfers in Brazil , 2022 .

[38]  B. Geys,et al.  Strategic Housing Policy, Migration and Sorting Around Population Thresholds , 2015, SSRN Electronic Journal.

[39]  M. Hernán,et al.  Compound Treatments and Transportability of Causal Inference , 2011, Epidemiology.

[40]  Matias D. Cattaneo,et al.  Manipulation Testing Based on Density Discontinuity , 2018 .

[41]  M. Urquiola,et al.  Class-Size Caps, Sorting, and the Regression-Discontinuity Design , 2009 .

[42]  Andrew C. Eggers,et al.  On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from Over 40,000 Close Races: ON THE VALIDITY OF THE ELECTORAL REGRESSION DISCONTINUITY DESIGN , 2015 .

[43]  David S. Lee,et al.  Regression Discontinuity Designs in Economics , 2009 .

[44]  Zareh Asatryan,et al.  Direct Democracy and Local Public Finances Under Cooperative Federalism , 2017 .