First-order methods for large-scale market equilibrium computation

Market equilibrium is a solution concept with many applications such as digital ad markets, fair division, and resource sharing. For many classes of utility functions, equilibria are captured by convex programs. We develop simple first-order methods that are suitable for solving these programs for large-scale markets. We focus on three practically-relevant utility classes: linear, quasilinear, and Leontief utilities. Using structural properties of a market equilibrium under each utility class, we show that the corresponding convex programs can be reformulated as optimization of a structured smooth convex function over a polyhedral set, for which projected gradient achieves linear convergence. To do so, we utilize recent linear convergence results under weakened strong-convexity conditions, and further refine the relevant constants, both in general and for our specific setups. We then show that proximal gradient (a generalization of projected gradient) with a practical version of linesearch achieves linear convergence under the Proximal-PL condition. For quasilinear utilities, we show that Mirror Descent applied to a specific convex program achieves sublinear last-iterate convergence and recovers the Proportional Response dynamics, an elegant and efficient algorithm for computing market equilibrium under linear utilities. Numerical experiments show that proportional response is highly efficient for computing an approximate solution, while projected gradient with linesearch can be much faster when higher accuracy is required.

[1]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[2]  Vijay V. Vazirani Spending Constraint Utilities with Applications to the Adwords Market , 2010, Math. Oper. Res..

[3]  Asuman E. Ozdaglar,et al.  A fast distributed proximal-gradient method , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  V. Vazirani Algorithmic Game Theory: Combinatorial Algorithms for Market Equilibria , 2007 .

[5]  E. Eisenberg,et al.  CONSENSUS OF SUBJECTIVE PROBABILITIES: THE PARI-MUTUEL METHOD, , 1959 .

[6]  Paul R. Milgrom,et al.  Designing Random Allocation Mechanisms: Theory and Applications , 2013 .

[7]  Eric Budish,et al.  The Combinatorial Assignment Problem: Approximate Competitive Equilibrium from Equal Incomes , 2010, Journal of Political Economy.

[8]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[9]  Li Zhang,et al.  Proportional response dynamics in the Fisher market , 2009, Theor. Comput. Sci..

[10]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[11]  Nikhil R. Devanur,et al.  Convex Program Duality, Fisher Markets, and Nash Social Welfare , 2016, EC.

[12]  Aharon Ben-Tal,et al.  Lectures on modern convex optimization , 1987 .

[13]  Judd B. Kessler,et al.  Course Match: A Large-Scale Implementation of Approximate Competitive Equilibrium from Equal Incomes for Combinatorial Allocation , 2015, Oper. Res..

[14]  Mihai Anitescu,et al.  Degenerate Nonlinear Programming with a Quadratic Growth Condition , 1999, SIAM J. Optim..

[15]  Nikhil R. Devanur,et al.  Distributed algorithms via gradient descent for fisher markets , 2011, EC '11.

[16]  Sébastien Bubeck,et al.  Convex Optimization: Algorithms and Complexity , 2014, Found. Trends Mach. Learn..

[17]  Lasse Becker-Czarnetzki Report on DeepStack Expert-Level Artificial Intelligence in Heads-Up No-Limit Poker , 2019 .

[18]  Qing Ling,et al.  A Proximal Gradient Algorithm for Decentralized Composite Optimization , 2015, IEEE Transactions on Signal Processing.

[19]  Lin Xiao,et al.  An Accelerated Proximal Coordinate Gradient Method , 2014, NIPS.

[20]  Kenneth L. Clarkson,et al.  Coresets, sparse greedy approximation, and the Frank-Wolfe algorithm , 2008, SODA '08.

[21]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[22]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[23]  Convex Optimization in Signal Processing and Communications , 2010 .

[24]  Douglass J. Wilde,et al.  Foundations of Optimization. , 1967 .

[25]  Yinyu Ye,et al.  A homogeneous interior-point algorithm for nonsymmetric convex conic optimization , 2014, Mathematical Programming.

[26]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[27]  Vijay V. Vazirani,et al.  Eisenberg-Gale markets: Algorithms and game-theoretic properties , 2010, Games Econ. Behav..

[28]  Simina Brânzei,et al.  The Fisher Market Game: Equilibrium and Welfare , 2014, AAAI.

[29]  V. I. Shmyrev,et al.  An algorithm for finding equilibrium in the linear exchange model with fixed budgets , 2009 .

[30]  Mohammad Akbarpour,et al.  Approximate Random Allocation Mechanisms , 2019, The Review of Economic Studies.

[31]  Miguel Á. Carreira-Perpiñán,et al.  Projection onto the probability simplex: An efficient algorithm with a simple proof, and an application , 2013, ArXiv.

[32]  Chih-Jen Lin,et al.  Iteration complexity of feasible descent methods for convex optimization , 2014, J. Mach. Learn. Res..

[33]  Vincent Conitzer,et al.  Pacing Equilibrium in First-Price Auction Markets , 2018, EC.

[34]  Mark W. Schmidt,et al.  Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition , 2016, ECML/PKDD.

[35]  Amir Beck,et al.  First-Order Methods in Optimization , 2017 .

[36]  Erling D. Andersen,et al.  A primal-dual interior-point algorithm for nonsymmetric exponential-cone optimization , 2021, Mathematical Programming.

[37]  Panos M. Pardalos,et al.  An algorithm for a singly constrained class of quadratic programs subject to upper and lower bounds , 1990, Math. Program..

[38]  Nikhil R. Devanur,et al.  Market equilibrium via a primal-dual-type algorithm , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[39]  Dmitriy Drusvyatskiy,et al.  Error Bounds, Quadratic Growth, and Linear Convergence of Proximal Methods , 2016, Math. Oper. Res..

[40]  A. Hoffman On approximate solutions of systems of linear inequalities , 1952 .

[41]  Z.-Q. Luo,et al.  Error bounds and convergence analysis of feasible descent methods: a general approach , 1993, Ann. Oper. Res..

[42]  Jiawei Zhang,et al.  A Note on Equilibrium Pricing as Convex Optimization , 2007, WINE.

[43]  Noam Brown,et al.  Superhuman AI for heads-up no-limit poker: Libratus beats top professionals , 2018, Science.

[44]  Eric P. Xing,et al.  Parallel and Distributed Block-Coordinate Frank-Wolfe Algorithms , 2014, ICML.

[45]  Kevin Waugh,et al.  Faster algorithms for extensive-form game solving via improved smoothing functions , 2018, Mathematical Programming.

[46]  Martin Jaggi,et al.  On the Global Linear Convergence of Frank-Wolfe Optimization Variants , 2015, NIPS.

[47]  E. Eisenberg Aggregation of Utility Functions , 1961 .

[48]  Martin Hoefer,et al.  Ascending-Price Algorithms for Unknown Markets , 2015, EC.

[49]  Marc Teboulle,et al.  Mirror descent and nonlinear projected subgradient methods for convex optimization , 2003, Oper. Res. Lett..

[50]  Shimrit Shtern,et al.  Linearly convergent away-step conditional gradient for non-strongly convex functions , 2015, Mathematical Programming.

[51]  Alexander Peysakhovich,et al.  Scalable Fair Division for 'At Most One' Preferences , 2019, ArXiv.

[52]  Laurent Condat Fast projection onto the simplex and the l1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\pmb {l}_\mathbf {1}$$\end{ , 2015, Mathematical Programming.

[53]  Yunmei Chen,et al.  Projection Onto A Simplex , 2011, 1101.6081.

[54]  H. Varian Equity, Envy and Efficiency , 1974 .

[55]  P. Brucker Review of recent development: An O( n) algorithm for quadratic knapsack problems , 1984 .

[56]  Ariel D. Procaccia,et al.  The Unreasonable Fairness of Maximum Nash Welfare , 2016, EC.

[57]  Kevin Waugh,et al.  DeepStack: Expert-level artificial intelligence in heads-up no-limit poker , 2017, Science.

[58]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[59]  Paul Tseng,et al.  Approximation accuracy, gradient methods, and error bound for structured convex optimization , 2010, Math. Program..

[60]  Alexander Peysakhovich,et al.  Computing Large Market Equilibria using Abstractions , 2019, EC.

[61]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[62]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[63]  Ky Fan,et al.  Imbedding Conditions for Hermitian and Normal Matrices , 1957, Canadian Journal of Mathematics.

[64]  Ariel D. Procaccia,et al.  No agent left behind: dynamic fair division of multiple resources , 2013, AAMAS.

[65]  Luis Zuluaga,et al.  New characterizations of Hoffman constants for systems of linear constraints , 2019, Mathematical Programming.

[66]  J. Plesník Finding the orthogonal projection of a point onto an affine subspace , 2007 .