Fully Distributed Nash Equilibrium Seeking Over Time-Varying Communication Networks With Linear Convergence Rate

We design a distributed algorithm for learning Nash equilibria over time-varying communication networks in a partial-decision information scenario, where each agent can access its own cost function and local feasible set, but can only observe the actions of some neighbors. Our algorithm is based on projected pseudo-gradient dynamics, augmented with consensual terms. Under strong monotonicity and Lipschitz continuity of the game mapping, we provide a simple proof of linear convergence, based on a contractivity property of the iterates. Compared to similar solutions proposed in literature, we also allow for time-varying communication and derive tighter bounds on the step sizes that ensure convergence. In fact, in our numerical simulations, our algorithm outperforms the existing gradient-based methods, when the step sizes are set to their theoretical upper bounds. Finally, to relax the assumptions on the network structure, we propose a different pseudo-gradient algorithm, which is guaranteed to converge on time-varying balanced directed graphs.

[1]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[2]  Sergio Grammatico Dynamic Control of Agents Playing Aggregative Games With Coupling Constraints , 2016, IEEE Transactions on Automatic Control.

[3]  Sergio Grammatico,et al.  Distributed Generalized Nash Equilibrium Seeking in Aggregative Games on Time-Varying Networks , 2019, IEEE Transactions on Automatic Control.

[4]  Wei Shi,et al.  Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking , 2018, IEEE Transactions on Automatic Control.

[5]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[6]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[7]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[8]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[9]  Tatiana Tatarenko,et al.  Geometric convergence of distributed gradient play in games with unconstrained action sets , 2019, IFAC-PapersOnLine.

[10]  Farzad Salehisadaghiani,et al.  Nash Equilibrium Seeking with Non-doubly Stochastic Communication Weight Matrix , 2020, EAI Endorsed Trans. Collab. Comput..

[11]  Sergio Grammatico,et al.  Projected-gradient algorithms for Generalized Equilibrium seeking in Aggregative Games arepreconditioned Forward-Backward methods , 2018, 2018 European Control Conference (ECC).

[12]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[13]  Kostas Bimpikis,et al.  Cournot competition in networked markets , 2014, EC.

[14]  Francisco Facchinei,et al.  Nash equilibria: the variational approach , 2010, Convex Optimization in Signal Processing and Communications.

[15]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[16]  Munther A. Dahleh,et al.  Demand Response Using Linear Supply Function Bidding , 2015, IEEE Transactions on Smart Grid.

[17]  Jorge Cortés,et al.  Distributed Strategies for Generating Weight-Balanced and Doubly Stochastic Digraphs , 2009, Eur. J. Control.

[18]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[19]  Lacra Pavel,et al.  Distributed GNE Seeking Under Partial-Decision Information Over Networks via a Doubly-Augmented Operator Splitting Approach , 2018, IEEE Transactions on Automatic Control.

[20]  Wei Shi,et al.  Distributed Nash equilibrium seeking under partial-decision information via the alternating direction method of multipliers , 2017, Autom..

[21]  Sergio Grammatico,et al.  A continuous-time distributed generalized Nash equilibrium seeking algorithm over networks for double-integrator agents , 2019, 2020 European Control Conference (ECC).

[22]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[23]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[24]  Mihaela van der Schaar,et al.  Distributed Learning for Stochastic Generalized Nash Equilibrium Problems , 2016, IEEE Transactions on Signal Processing.

[25]  Wei Shi,et al.  Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking , 2018, 2018 IEEE Conference on Decision and Control (CDC).