Distributed Nash equilibrium seeking under partial-decision information via the alternating direction method of multipliers

In this paper, we consider the problem of finding a Nash equilibrium in a multi-player game over generally connected networks. This model differs from a conventional setting in that players have partial information on the actions of their opponents and the communication graph is not necessarily the same as the players’ cost dependency graph. We develop a relatively fast algorithm within the framework of inexact-ADMM, based on local information exchange between the players. We prove its convergence to Nash equilibrium for fixed step-sizes and analyse its convergence rate. Numerical simulations illustrate its benefits when compared to a consensus-based gradient type algorithm with diminishing step-sizes.

[1]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[2]  Qing Ling,et al.  A Proximal Gradient Algorithm for Decentralized Composite Optimization , 2015, IEEE Transactions on Signal Processing.

[3]  Lacra Pavel,et al.  A distributed primal-dual algorithm for computation of generalized Nash equilibria via operator splitting methods , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[4]  Xiangfeng Wang,et al.  Multi-Agent Distributed Optimization via Inexact Consensus ADMM , 2014, IEEE Transactions on Signal Processing.

[5]  Emilio Frazzoli,et al.  Distributed robust adaptive equilibrium computation for generalized convex games , 2015, Autom..

[6]  Tansu Alpcan,et al.  Distributed Algorithms for Nash Equilibria of Flow Control Games , 2005 .

[7]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[8]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[9]  Hui Zhang,et al.  The restricted strong convexity revisited: analysis of equivalence to error bound and quadratic growth , 2015, Optim. Lett..

[10]  R. Rockafellar.  On the maximality of sums of nonlinear monotone operators , 1970 .

[11]  Mehmet E. Yildiz,et al.  Competitive Targeted Advertising Over Networks , 2016, Oper. Res..

[12]  Tamer Basar,et al.  Distributed algorithms for the computation of noncooperative equilibria , 1987, Autom..

[13]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[14]  R. Kranton,et al.  Strategic Interaction and Networks , 2010 .

[15]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[16]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking in networked graphical games , 2017, Autom..

[17]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Jason R. Marden.  Learning in Large-Scale Games and Cooperative Control , 2007 .

[19]  R. Rockafellar,et al.  Prox-regular functions in variational analysis , 1996 .

[20]  Prashant G. Mehta,et al.  Nash Equilibrium Problems With Scaled Congestion Costs and Shared Constraints , 2011, IEEE Transactions on Automatic Control.

[21]  Lacra Pavel,et al.  Games with coupled propagated constraints in optical networks with multi-link topologies , 2009, Autom..

[22]  Soummya Kar,et al.  Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games , 2013, IEEE Transactions on Signal Processing.

[23]  Uday V. Shanbhag,et al.  Distributed Computation of Equilibria in Monotone Nash Games via Iterative Regularization Techniques , 2012, SIAM J. Optim..

[24]  Wei Shi,et al.  LANA: An ADMM-like Nash equilibrium seeking algorithm in decentralized environment , 2017, 2017 American Control Conference (ACC).

[25]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[26]  Lacra Pavel,et al.  Distributed Generalized Nash Equilibria Computation of Monotone Games via Double-Layer Preconditioned Proximal-Point Algorithms , 2019, IEEE Transactions on Control of Network Systems.

[27]  Asuman E. Ozdaglar,et al.  Distributed Alternating Direction Method of Multipliers , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[28]  Gerard Debreu,et al.  A Social Equilibrium Existence Theorem* , 1952, Proceedings of the National Academy of Sciences.

[29]  K. J. Ray Liu,et al.  Game theory for cognitive radio networks: An overview , 2010, Comput. Networks.

[30]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[31]  Francisco Facchinei,et al.  Real and Complex Monotone Communication Games , 2012, IEEE Transactions on Information Theory.

[32]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[33]  Farzad Salehisadaghiani,et al.  Distributed Nash Equilibrium Seeking via the Alternating Direction Method of Multipliers , 2016, ArXiv.

[34]  Xuemin Shen,et al.  Opportunistic Spectrum Access for CR-VANETs: A Game-Theoretic Approach , 2014, IEEE Transactions on Vehicular Technology.

[35]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Kostas Bimpikis,et al.  Cournot competition in networked markets , 2014, EC.

[37]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[38]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[39]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..