Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking

We study distributed algorithms for seeking a Nash equilibrium in a class of non-cooperative games with strongly monotone mappings. Each player has access to her own smooth local cost function and can communicate to her neighbors in some undirected graph. We first consider a distributed gradient play algorithm, which we call GRANE, for determining a Nash equilibrium. The algorithm involves every player performing a gradient step to minimize her own cost function while sharing and retrieving information locally among her neighbors in the network. We prove the convergence of this algorithm to a Nash equilibrium with a geometric rate. Further, we introduce the Nesterov type acceleration for the gradient play algorithm. We demonstrate that, similarly to the accelerated algorithms in centralized optimization and variational inequality problems, our accelerated algorithm outperforms GRANE in the convergence rate.

[1]  Tatiana Tatarenko,et al.  Proving convergence of log-linear learning in potential games , 2014, 2014 American Control Conference.

[2]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[3]  Angelia Nedic,et al.  A gossip algorithm for aggregative games on graphs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[4]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[5]  David S. Leslie,et al.  Mixed-Strategy Learning With Continuous Action Sets , 2017, IEEE Transactions on Automatic Control.

[6]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[7]  John Lygeros,et al.  On aggregative and mean field games with applications to electricity markets , 2016, 2016 European Control Conference (ECC).

[8]  Tatiana Tatarenko,et al.  Independent Log-Linear Learning in Potential Games With Continuous Actions , 2018, IEEE Transactions on Control of Network Systems.

[9]  Tansu Alpcan,et al.  Distributed Algorithms for Nash Equilibria of Flow Control Games , 2005 .

[10]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Wei Shi,et al.  LANA: An ADMM-like Nash equilibrium seeking algorithm in decentralized environment , 2017, 2017 American Control Conference (ACC).

[12]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[13]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Willem H. Haemers,et al.  Spectra of Graphs , 2011 .

[15]  Yurii Nesterov,et al.  Solving Strongly Monotone Variational and Quasi-Variational Inequalities , 2006 .

[16]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[17]  Sergio Barbarossa,et al.  Potential Games: A Framework for Vector Power Control Problems With Coupled Constraints , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[18]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[19]  Sonia Martínez,et al.  Distributed Coverage Games for Energy-Aware Mobile Sensor Networks , 2013, SIAM J. Control. Optim..

[20]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[21]  Wei Shi,et al.  Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking , 2018, IEEE Transactions on Automatic Control.

[22]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..