Nash equilibrium seeking under partial-decision information over directed communication networks

We consider the Nash equilibrium problem in a partial-decision information scenario. Specifically, each agent can only receive information from some neighbors via a communication network, while its cost function depends on the strategies of possibly all agents. In particular, while the existing methods assume undirected or balanced communication, in this paper we allow for non-balanced, directed graphs. We propose a fully-distributed pseudo-gradient scheme, which is guaranteed to converge with linear rate to a Nash equilibrium, under strong monotonicity and Lipschitz continuity of the game mapping. Our algorithm requires global knowledge of the communication structure, namely of the Perron-Frobenius eigenvector of the adjacency matrix and of a certain constant related to the graph connectivity. Therefore, we adapt the procedure to setups where the network is not known in advance, by computing the eigenvector online and by means of vanishing step sizes.

[1]  Sergio Grammatico,et al.  Stochastic generalized Nash equilibrium seeking under partial-decision information , 2020, Autom..

[2]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[3]  Sergio Grammatico,et al.  Distributed Generalized Nash Equilibrium Seeking in Aggregative Games on Time-Varying Networks , 2019, IEEE Transactions on Automatic Control.

[4]  Munther A. Dahleh,et al.  Demand Response Using Linear Supply Function Bidding , 2015, IEEE Transactions on Smart Grid.

[5]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[6]  Sergio Grammatico,et al.  Asynchronous and Time-Varying Proximal Type Dynamics in Multiagent Network Games , 2019, IEEE Transactions on Automatic Control.

[7]  Sergio Grammatico,et al.  Fully Distributed Nash Equilibrium Seeking Over Time-Varying Communication Networks With Linear Convergence Rate , 2020, IEEE Control Systems Letters.

[8]  Sergio Grammatico,et al.  Distributed averaging integral Nash equilibrium seeking on networks , 2018, Autom..

[9]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[10]  Zhenhua Deng,et al.  Distributed Generalized Nash Equilibrium Seeking Algorithm Design for Aggregative Games Over Weight-Balanced Digraphs , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Soummya Kar,et al.  Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games , 2013, IEEE Transactions on Signal Processing.

[12]  Sergio Grammatico,et al.  A continuous-time distributed generalized Nash equilibrium seeking algorithm over networks for double-integrator agents , 2020, 2020 European Control Conference (ECC).

[13]  Lacra Pavel,et al.  Distributed GNE Seeking Under Partial-Decision Information Over Networks via a Doubly-Augmented Operator Splitting Approach , 2018, IEEE Transactions on Automatic Control.

[14]  Farzad Salehisadaghiani,et al.  Nash Equilibrium Seeking with Non-doubly Stochastic Communication Weight Matrix , 2020, EAI Endorsed Trans. Collab. Comput..

[15]  Van Sy Mai,et al.  Linear Convergence in Optimization Over Directed Graphs With Row-Stochastic Matrices , 2016, IEEE Transactions on Automatic Control.

[16]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[17]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[18]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[19]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[20]  Wei Shi,et al.  Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[21]  Jorge Barrera,et al.  Dynamic Incentives for Congestion Control , 2015, IEEE Transactions on Automatic Control.

[22]  Sergio Grammatico,et al.  Projected-gradient algorithms for Generalized Equilibrium seeking in Aggregative Games arepreconditioned Forward-Backward methods , 2018, 2018 European Control Conference (ECC).

[23]  Sergio Grammatico,et al.  Continuous-Time Integral Dynamics for a Class of Aggregative Games With Coupling Constraints , 2020, IEEE Transactions on Automatic Control.

[24]  Sergio Grammatico,et al.  Fast generalized Nash equilibrium seeking under partial-decision information , 2020, Automatica.