A fully-distributed proximal-point algorithm for Nash equilibrium seeking with linear convergence rate

We address the Nash equilibrium problem in a partial-decision information scenario, where each agent can only observe the actions of some neighbors, while its cost possibly depends on the strategies of other agents. Our main contribution is the design of a fully-distributed, single-layer, fixed-step algorithm, based on a proximal best-response augmented with consensus terms. To derive our algorithm, we follow an operator-theoretic approach. First, we recast the Nash equilibrium problem as that of finding a zero of a monotone operator. Then, we demonstrate that the resulting inclusion can be solved in a fully-distributed way via a proximal-point method, thanks to the use of a novel preconditioning matrix. Under strong monotonicity and Lipschitz continuity of the game mapping, we prove linear convergence of our algorithm to a Nash equilibrium. Furthermore, we show that our method outperforms the fastest known gradient-based schemes, both in terms of guaranteed convergence rate, via theoretical analysis, and in practice, via numerical simulations.

[1]  Kostas Bimpikis,et al.  Cournot competition in networked markets , 2014, EC.

[2]  Sergio Grammatico,et al.  Distributed averaging integral Nash equilibrium seeking on networks , 2018, Autom..

[3]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[4]  Lacra Pavel,et al.  Single-Timescale Distributed GNE Seeking for Aggregative Games Over Networks via Forward–Backward Operator Splitting , 2019, IEEE Transactions on Automatic Control.

[5]  Francisco Facchinei,et al.  Generalized Nash Equilibrium Problems , 2010, Ann. Oper. Res..

[6]  Mihaela van der Schaar,et al.  Distributed Learning for Stochastic Generalized Nash Equilibrium Problems , 2016, IEEE Transactions on Signal Processing.

[7]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[8]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[9]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[10]  Lacra Pavel,et al.  Distributed GNE Seeking Under Partial-Decision Information Over Networks via a Doubly-Augmented Operator Splitting Approach , 2018, IEEE Transactions on Automatic Control.

[11]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[12]  Sergio Grammatico Dynamic Control of Agents Playing Aggregative Games With Coupling Constraints , 2016, IEEE Transactions on Automatic Control.

[13]  Francisco Facchinei,et al.  Nash equilibria: the variational approach , 2010, Convex Optimization in Signal Processing and Communications.

[14]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[15]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[16]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[17]  Lacra Pavel,et al.  Distributed Generalized Nash Equilibria Computation of Monotone Games via Double-Layer Preconditioned Proximal-Point Algorithms , 2019, IEEE Transactions on Control of Network Systems.

[18]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[19]  Munther A. Dahleh,et al.  Demand Response Using Linear Supply Function Bidding , 2015, IEEE Transactions on Smart Grid.

[20]  Wei Shi,et al.  Distributed Nash equilibrium seeking under partial-decision information via the alternating direction method of multipliers , 2017, Autom..

[21]  Sergio Grammatico,et al.  Projected-gradient algorithms for Generalized Equilibrium seeking in Aggregative Games arepreconditioned Forward-Backward methods , 2018, 2018 European Control Conference (ECC).

[22]  Lacra Pavel,et al.  An operator splitting approach for distributed generalized Nash equilibria computation , 2019, Autom..

[23]  Sergio Grammatico,et al.  Fully Distributed Nash Equilibrium Seeking Over Time-Varying Communication Networks With Linear Convergence Rate , 2020, IEEE Control Systems Letters.

[24]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[25]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[26]  Uday V. Shanbhag,et al.  Linearly Convergent Variable Sample-Size Schemes for Stochastic Nash Games: Best-Response Schemes and Distributed Gradient-Response Schemes , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[27]  Wei Shi,et al.  Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking , 2018, IEEE Transactions on Automatic Control.

[28]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..

[29]  Wei Shi,et al.  Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[30]  Tatiana Tatarenko,et al.  Geometric convergence of distributed gradient play in games with unconstrained action sets , 2019, IFAC-PapersOnLine.