Geometric convergence of distributed gradient play in games with unconstrained action sets

We provide a distributed algorithm to learn a Nash equilibrium in a class of non-cooperative games with strongly monotone mappings and unconstrained action sets. Each player has access to her own smooth local cost function and can communicate to her neighbors in some undirected graph. We consider a distributed communication-based gradient algorithm. For this procedure, we prove geometric convergence to a Nash equilibrium. In contrast to our previous works [15], [16], where the proposed algorithms required two parameters to be set up and the analysis was based on a so called augmented game mapping, the procedure in this work corresponds to a standard distributed gradient play and, thus, only one constant step size parameter needs to be chosen appropriately to guarantee fast convergence to a game solution. Moreover, we provide a rigorous comparison between the convergence rate of the proposed distributed gradient play and the rate of the GRANE algorithm presented in [15]. It allows us to demonstrate that the distributed gradient play outperforms the GRANE in terms of convergence speed.

[1]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[2]  John Lygeros,et al.  On aggregative and mean field games with applications to electricity markets , 2016, 2016 European Control Conference (ECC).

[3]  Yurii Nesterov,et al.  Solving Strongly Monotone Variational and Quasi-Variational Inequalities , 2006 .

[4]  Wei Shi,et al.  Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking , 2018, IEEE Transactions on Automatic Control.

[5]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[6]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..

[7]  Tansu Alpcan,et al.  Distributed Algorithms for Nash Equilibria of Flow Control Games , 2005 .

[8]  Angelia Nedic,et al.  A gossip algorithm for aggregative games on graphs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[9]  J. Goodman Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[10]  Sergio Grammatico,et al.  A distributed proximal-point algorithm for Nash equilibrium seeking under partial-decision information with geometric convergence , 2019, ArXiv.

[11]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[12]  Wei Shi,et al.  Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[13]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[14]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[15]  Sergio Barbarossa,et al.  Potential Games: A Framework for Vector Power Control Problems With Coupled Constraints , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[16]  Tatiana Tatarenko,et al.  Stochastic learning in multi-agent optimization: Communication and payoff-based approaches , 2019, Autom..

[17]  Na Li,et al.  Accelerated Distributed Nesterov Gradient Descent , 2017, IEEE Transactions on Automatic Control.