Width-Independence Beyond Linear Objectives: Distributed Fair Packing and Covering Algorithms

Fair allocation of resources has deep roots in early philosophy, and has been broadly studied in political science, economic theory, operations research, and networking. Over the past decades, an axiomatic approach to fair resource allocation has led to the general acceptance of a class of $\alpha$-fair utility functions parametrized by a single inequality aversion parameter $\alpha \in [0, \infty]$. In theoretical computer science, the most well-studied examples are linear utilities ($\alpha = 0$), proportionally fair or Nash utilities ($\alpha = 1$), and max-min fair utilities ($\alpha \rightarrow \infty$). In this work, we consider general $\alpha$-fair resource allocation problems, defined as the maximization of $\alpha$-fair utility functions under packing constraints. We give improved distributed algorithms for constructing $\epsilon$-approximate solutions to such problems. Our algorithms are width-independent, that is, their running times depend only poly-logarithmically on the largest entry of the constraint matrix, and closely match the state-of-the-art guarantees for distributed algorithms for packing linear programs -- the case $\alpha = 0.$ Previously known width-independent algorithms for $\alpha$-fair resource allocation have convergence times with much worse dependence on $\epsilon$ and $\alpha$. Our analysis leverages the Approximate Duality Gap framework of Diakonikolas and Orecchia to obtain better algorithms with a more streamlined analysis. Finally, we introduce a natural counterpart of $\alpha$-fairness for minimization problems and motivate its usage in the context of fair task allocation. This generalization yields $\alpha$-fair covering problems, for which we provide the first width-independent nearly-linear-time approximate solvers by reducing their analysis to the $\alpha < 1$ case of the $\alpha$-fair packing problem.

[1]  J. Nash THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[2]  Steven Vajda,et al.  The Theory of Linear Economic Models , 1960 .

[3]  Nimrod Megiddo,et al.  Optimal flows in networks with multiple sources and sinks , 1974, Math. Program..

[4]  E. Kalai,et al.  OTHER SOLUTIONS TO NASH'S BARGAINING PROBLEM , 1975 .

[5]  Noam Nisan,et al.  A parallel approximation algorithm for positive linear programming , 1993, STOC.

[6]  Mihalis Yannakakis,et al.  Linear programming without the matrix , 1993, STOC.

[7]  Elena Yudovina,et al.  Stochastic networks , 1995, Physics Subject Headings (PhySH).

[8]  H. Hart,et al.  The Collected Works of Jeremy Bentham: An Introduction to the Principles of Morals and Legislation , 1996 .

[9]  Danny Raz,et al.  Global optimization using local information with applications to flow control , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[10]  Jean C. Walrand,et al.  Fair end-to-end window-based congestion control , 2000, TNET.

[11]  Yuval Rabani,et al.  Fairness in routing and load balancing , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[12]  Neal E. Young,et al.  Sequential and parallel algorithms for mixed packing and covering , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[13]  Fernando Paganini,et al.  Internet congestion control , 2002 .

[14]  F. Bourguignon On the Measurement of Inequality , 2003 .

[15]  Roger Wattenhofer,et al.  The price of being near-sighted , 2006, SODA '06.

[16]  Vijay V. Vazirani,et al.  Eisenberg-Gale markets: algorithms and structural properties , 2007, STOC '07.

[17]  Baruch Awerbuch,et al.  Stateless distributed gradient descent for positive linear programs , 2008, SIAM J. Comput..

[18]  Mung Chiang,et al.  Stochastic network utility maximisation - a tribute to Kelly's paper published in this journal a decade ago , 2008, Eur. Trans. Telecommun..

[19]  Nikhil R. Devanur,et al.  Market equilibrium via a primal--dual algorithm for a convex program , 2008, JACM.

[20]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Covering and Packing , 2009, Math. Oper. Res..

[21]  Ashutosh Sabharwal,et al.  An Axiomatic Theory of Fairness in Network Resource Allocation , 2009, 2010 Proceedings IEEE INFOCOM.

[22]  Panos M. Pardalos,et al.  Convex optimization theory , 2010, Optim. Methods Softw..

[23]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[24]  Dimitris Bertsimas,et al.  The Price of Fairness , 2011, Oper. Res..

[25]  Nisheeth K. Vishnoi,et al.  Approximating the exponential, the lanczos method and an Õ(m)-time spectral algorithm for balanced separator , 2011, STOC '12.

[26]  Dimitris Bertsimas,et al.  On the Efficiency-Fairness Trade-off , 2012, Manag. Sci..

[27]  Mung Chiang,et al.  Multiresource Allocation: Fairness–Efficiency Tradeoffs in a Unifying Framework , 2012, IEEE/ACM Transactions on Networking.

[28]  Nikhil R. Devanur,et al.  Tatonnement beyond gross substitutes?: gradient descent to the rescue , 2013, STOC '13.

[29]  Sem C. Borst,et al.  Network iso-elasticity and weighted α-fairness , 2012, Perform. Evaluation.

[30]  Peter Ashwood-Smith,et al.  Real time alpha-fairness based traffic engineering , 2014, HotSDN.

[31]  Thomas Bonald,et al.  Multi-Resource Fairness , 2014, SIGMETRICS.

[32]  Zeyuan Allen Zhu,et al.  Using Optimization to Break the Epsilon Barrier: A Faster and Simpler Width-Independent Algorithm for Solving Positive Linear Programs in Parallel , 2014, SODA.

[33]  Michael W. Mahoney,et al.  Approximating the Solution to Mixed Packing and Covering LPs in parallel Õ ( − 3 ) time , 2016 .

[34]  Gil Zussman,et al.  A Fast Distributed Stateless Algorithm for alpha-Fair Packing Problems , 2015, ICALP.

[35]  Maryam Fazel,et al.  Designing smoothing functions for improved worst-case competitive ratio in online optimization , 2016, NIPS.

[36]  Yossi Azar,et al.  Online Algorithms for Covering and Packing Problems with Convex Objectives , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[37]  Jelena Diakonikolas,et al.  Solving Packing and Covering LPs in $\tilde{O}(\frac{1}{\epsilon^2})$ Distributed Iterations with a Single Algorithm and Simpler Analysis , 2017 .

[38]  Dan W. Brockt,et al.  The Theory of Justice , 2017 .

[39]  Reuben Binns,et al.  Fairness in Machine Learning: Lessons from Political Philosophy , 2017, FAT.

[40]  Jelena Diakonikolas,et al.  The Approximate Duality Gap Technique: A Unified Theory of First-Order Methods , 2017, SIAM J. Optim..