On theoretical and empirical algorithmic analysis of the efficiency gap measure in partisan gerrymandering

Partisan gerrymandering is a major cause for voter disenfranchisement in United States. However, convincing US courts to adopt specific measures to quantify gerrymandering has been of limited success to date. Recently, Stephanopoulos and McGhee in several papers introduced a new measure of partisan gerrymandering via the so-called “efficiency gap” that computes the absolute difference of wasted votes between two political parties in a two-party system; from a legal point of view the measure was found legally convincing in a US appeals court in a case that claims that the legislative map of the state of Wisconsin was gerrymandered. The goal of this article is to formalize and provide theoretical and empirical algorithmic analyses of the computational problem of minimizing this measure. To this effect, we show the following: (a) On the theoretical side, we formalize the corresponding minimization problem and provide non-trivial mathematical and computational complexity properties of the problem of minimizing the efficiency gap measure. Specifically, we prove the following results for the formalized minimization problem: (i) We show that the efficiency gap measure attains only a finite discrete set of rational values. (observations of similar nature but using different arguments were also made independently by Cho and Wendy (Univ Pa Law Rev 166(1), Article 2, 2017). (ii) We show that, assuming P  $$\ne \textsf {NP}$$ ≠ NP , for general maps and arbitrary numeric electoral data the minimization problem does not admit any polynomial time algorithm with finite approximation ratio. Moreover, we show that the problem still remains $$\textsf {NP}$$ NP -complete even if the numeric electoral data is linear in the number of districts, provided the map is provided in the form of a planar graph (or, equivalently, a polygonal subdivision of the two-dimensional Euclidean plane). (iii) Notwithstanding the previous hardness results, we show that efficient exact or efficient approximation algorithms can be designed if one assumes some reasonable restrictions on the map and electoral data. Items (ii) and (iii) mentioned above are the first non-trivial computational complexity and algorithmic analyses of this measure of gerrymandering. (b) On the empirical side, we provide a simple and fast algorithm that can “un-gerrymander” the district maps for the states of Texas, Virginia, Wisconsin and Pennsylvania (based on the efficiency gap measure) by bring their efficiency gaps to acceptable levels from the current unacceptable levels. To the best of our knowledge, ours is the first publicly available implementation and its corresponding evaluation on real data for any algorithm for the efficiency gap measure. Our work thus shows that, notwithstanding the general worst-case approximation hardness of the efficiency gap measure as shown by us, finding district maps with acceptable levels of efficiency gaps could be a computationally tractable problem from a practical point of view . Based on these empirical results, we also provide some interesting insights into three practical issues related the efficiency gap measure.

[1]  Yan Y. Liu,et al.  Toward a Talismanic Redistricting Tool: A Computational Method for Identifying Extreme Redistricting Plans , 2016 .

[2]  Richard G. Niemi,et al.  A Theory of Political Districting , 1978, American Political Science Review.

[3]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[4]  T. Neumann Computers And Intractability A Guide To The Theory Of Np Completeness , 2016 .

[5]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[6]  Kosuke Imai,et al.  Automated Redistricting Simulation Using Markov Chain Monte Carlo , 2020, Journal of Computational and Graphical Statistics.

[7]  Jonathan Rodden,et al.  Cutting Through the Thicket : Redistricting Simulations and the Detection of Partisan Gerrymanders , 2015 .

[8]  Micah Altman,et al.  A Bayesian approach to detecting electoral manipulation , 2002 .

[9]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[10]  James E. Ryan,et al.  The Limited Influence of Social Science Evidence in Modern Desegregation Cases , 2002 .

[11]  Shawn Doyle A Graph Partitioning Model of Congressional Redistricting , 2015 .

[12]  Brenda S. Baker,et al.  Approximation algorithms for NP-complete problems on planar graphs , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[13]  Eric McGhee,et al.  Measuring Partisan Bias in Single-Member District Electoral Systems: Measuring Partisan Bias , 2014 .

[14]  José L. Balcázar,et al.  Structural Complexity I , 1995, Texts in Theoretical Computer Science An EATCS Series.

[15]  Simon Jackman,et al.  Measuring Electoral Bias: Australia, 1949–93 , 1994, British Journal of Political Science.

[16]  Kosuke Imai,et al.  A New Automated Redistricting Simulator Using Markov Chain , 2014 .

[17]  J. K. Lenstra,et al.  Local Search in Combinatorial Optimisation. , 1997 .

[18]  Shaowen Wang,et al.  PEAR: a massively parallel evolutionary computation approach for political redistricting optimization and analysis , 2016, Swarm Evol. Comput..

[19]  Nicholas Stephanopoulos,et al.  Partisan Gerrymandering and the Efficiency Gap , 2014 .

[20]  W. Fitch Toward Defining the Course of Evolution: Minimum Change for a Specific Tree Topology , 1971 .

[21]  L D Lutter,et al.  Ockham's Razor , 1999, Foot & ankle international.

[22]  Tam Cho,et al.  Measuring Partisan Fairness: How Well Does the Efficiency Gap Guard Against Sophisticated as well as Simple-Minded Modes of Partisan Discrimination? , 2017 .

[23]  B. Grofman,et al.  Measuring Compactness and the Role of a Compactness Standard in a Test for Partisan and Racial Gerrymandering , 1990, The Journal of Politics.

[24]  Jonathan C. Mattingly,et al.  Evaluating Partisan Gerrymandering in Wisconsin , 2017, 1709.01596.

[25]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[26]  Jie Liang,et al.  Models and Algorithms for Biomolecules and Molecular Networks , 2016 .

[27]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[28]  C. Cirincione,et al.  Assessing South Carolina's 1990s congressional districting , 2000 .

[29]  Eric McGhee,et al.  Measuring Partisan Bias in Single-Member District Electoral Systems , 2013 .

[30]  J D Thoreson,et al.  Computers in behavioral science. Legislative districting by computer simulation. , 1967, Behavioral science.

[31]  Gary King,et al.  A Unified Method of Evaluating Electoral Systems and Redistricting Plans , 1994 .

[32]  Y LiuYan,et al.  Toward a Talismanic Redistricting Tool: A Computational Method for Identifying Extreme Redistricting Plans , 2016 .

[33]  ChenJowei,et al.  Cutting Through the Thicket: Redistricting Simulations and the Detection of Partisan Gerrymanders , 2015 .

[34]  David L. Faigman To Have and Have Not: Assessing the Value of Social Science to the Law as Science and Policy , 1989 .

[35]  Rajeev Motwani,et al.  Randomized algorithms , 1996, CSUR.

[36]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..