A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks

In this paper, we consider the problem of distributed Nash equilibrium (NE) seeking over networks, a setting in which players have limited local information on the others’ decisions. We start from a continuous-time gradient-play dynamics that converges to an NE under strict monotonicity of the pseudogradient and assumes perfect information. We consider how to modify it in the case of partial, or networked information between players. We propose an augmented gradient-play dynamics with correction, in which players communicate locally only with their neighbors to compute an estimate of the other players’ actions. We derive the new dynamics based on the reformulation as a multiagent coordination problem over an undirected graph. We exploit incremental passivity properties and show that a synchronizing, distributed Laplacian feedback can be designed using relative estimates of the neighbors. Under a strict monotonicity property of the pseudogradient, we show that the augmented gradient-play dynamics converges to consensus on the NE of the game. We further discuss two cases that highlight the tradeoff between properties of the game and the communication graph.

[1]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[2]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[3]  Kenneth J. Arrow,et al.  A Gradient Method for Approximating Saddle Points and Constrained Maxima , 2014 .

[4]  J. Hiriart-Urruty,et al.  Fundamentals of Convex Analysis , 2004 .

[5]  Francisco Facchinei,et al.  Real and Complex Monotone Communication Games , 2012, IEEE Transactions on Information Theory.

[6]  Farzad Salehisadaghiani,et al.  Distributed Nash Equilibrium Seeking via the Alternating Direction Method of Multipliers , 2016, ArXiv.

[7]  Vincent Acary,et al.  On the equivalence between complementarity systems, projected systems and differential inclusions , 2006, Syst. Control. Lett..

[8]  Vivek S. Borkar,et al.  Distributed Stochastic Approximation with Local Projections , 2017, SIAM J. Optim..

[9]  Xu Chen,et al.  Spatial spectrum access game: nash equilibria and distributed learning , 2012, MobiHoc '12.

[10]  R. Kranton,et al.  Strategic Interaction and Networks , 2010 .

[11]  George H. Hines,et al.  Equilibrium-independent passivity: A new definition and numerical certification , 2011, Autom..

[12]  Asuman E. Ozdaglar,et al.  Optimal Pricing in Networks with Externalities , 2011, Oper. Res..

[13]  Jeff S. Shamma,et al.  Population games, stable games, and passivity , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[14]  Lacra Pavel,et al.  Games with coupled propagated constraints in optical networks with multi-link topologies , 2009, Autom..

[15]  Soummya Kar,et al.  Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games , 2013, IEEE Transactions on Signal Processing.

[16]  Kostas Bimpikis,et al.  Cournot competition in networked markets , 2014, EC.

[17]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[18]  Nan Xiao,et al.  Distributed consensus in noncooperative congestion games: An application to road pricing , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[19]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[20]  Tansu Alpcan,et al.  A hybrid systems model for power control in multicell wireless data networks , 2004, Perform. Evaluation.

[21]  Wenjia Li,et al.  ART: An Attack-Resistant Trust Management Scheme for Securing Vehicular Ad Hoc Networks , 2016, IEEE Transactions on Intelligent Transportation Systems.

[22]  Mingyan Liu,et al.  Atomic Congestion Games on Graphs and Their Applications in Networking , 2012, IEEE/ACM Transactions on Networking.

[23]  Lacra Pavel,et al.  An operator splitting approach for distributed generalized Nash equilibria computation , 2019, Autom..

[24]  Yu Zhang,et al.  AMD: Audit-Based Misbehavior Detection in Wireless Ad Hoc Networks , 2016, IEEE Transactions on Mobile Computing.

[25]  Farzad Salehisadaghiani,et al.  Nash equilibrium seeking by a gossip-based algorithm , 2014, 53rd IEEE Conference on Decision and Control.

[26]  Angelia Nedic,et al.  A gossip algorithm for aggregative games on graphs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[27]  Xuemin Shen,et al.  Opportunistic Spectrum Access for CR-VANETs: A Game-Theoretic Approach , 2014, IEEE Transactions on Vehicular Technology.

[28]  P. Rowlinson ALGEBRAIC GRAPH THEORY (Graduate Texts in Mathematics 207) By CHRIS GODSIL and GORDON ROYLE: 439 pp., £30.50, ISBN 0-387-95220-9 (Springer, New York, 2001). , 2002 .

[29]  Claudio De Persis,et al.  Dynamic coupling design for nonlinear output agreement and time-varying flow control , 2013, Autom..

[30]  Mihaela van der Schaar,et al.  Distributed Learning for Stochastic Generalized Nash Equilibrium Problems , 2016, IEEE Transactions on Signal Processing.

[31]  Bahman Gharesifard,et al.  Distributed convergence to Nash equilibria in two-network zero-sum games , 2012, Autom..

[32]  Lacra Pavel,et al.  A distributed primal-dual algorithm for computation of generalized Nash equilibria with shared affine coupling constraints via operator splitting methods , 2017, ArXiv.

[33]  Jason R. Marden,et al.  Game Theory and Distributed Control , 2015 .

[34]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[35]  F. Szidarovszky,et al.  The Theory of Oligopoly with Multi-Product Firms , 1990 .

[36]  Karl Henrik Johansson,et al.  Nash Equilibrium Computation in Subnetwork Zero-Sum Games With Switching Communications , 2013, IEEE Transactions on Automatic Control.

[37]  Mehmet E. Yildiz,et al.  Competitive Targeted Advertising Over Networks , 2016, Oper. Res..

[38]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[39]  Zhu Han,et al.  Competitive Spectrum Access in Cognitive Radio Networks: Graphical Game and Learning , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[40]  Francesca Parise,et al.  Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control , 2014, IEEE Transactions on Automatic Control.

[41]  P. Olver Nonlinear Systems , 2013 .

[42]  Frank Allgöwer,et al.  Duality and network theory in passivity-based cooperative control , 2013, Autom..

[43]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[44]  Lorenzo Marconi,et al.  Incremental passivity and output regulation , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[45]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[46]  Tamer Basar,et al.  Distributed algorithms for the computation of noncooperative equilibria , 1987, Autom..

[47]  K. J. Ray Liu,et al.  Game theory for cognitive radio networks: An overview , 2010, Comput. Networks.

[48]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..

[49]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[50]  Murat Arcak,et al.  Passivity as a Design Tool for Group Coordination , 2007, IEEE Transactions on Automatic Control.

[51]  Lacra Pavel,et al.  Game Theory for Control of Optical Networks , 2012 .

[52]  Lacra Pavel,et al.  Continuous-time distributed dynamics for Nash equilibrium over networks via a passivity-based control approach , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[53]  Jeff S. Shamma,et al.  Passivity analysis of higher order evolutionary dynamics and population games , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[54]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[55]  K. Brown,et al.  Graduate Texts in Mathematics , 1982 .

[56]  Tansu Alpcan,et al.  Distributed Algorithms for Nash Equilibria of Flow Control Games , 2005 .

[57]  A. Nagurney,et al.  Projected Dynamical Systems and Variational Inequalities with Applications , 1995 .

[58]  Sjur Didrik Flåm,et al.  Equilibrium, Evolutionary stability and Gradient Dynamics , 2002, IGTR.

[59]  Lacra Pavel,et al.  A noncooperative game approach to OSNR optimization in optical networks , 2006, IEEE Transactions on Automatic Control.

[60]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[61]  Wei Shi,et al.  LANA: An ADMM-like Nash equilibrium seeking algorithm in decentralized environment , 2017, 2017 American Control Conference (ACC).

[62]  Jason R. Marden Learning in Large-Scale Games and Cooperative Control , 2007 .

[63]  Prashant G. Mehta,et al.  Nash Equilibrium Problems With Scaled Congestion Costs and Shared Constraints , 2011, IEEE Transactions on Automatic Control.

[64]  Mario di Bernardo,et al.  On QUAD, Lipschitz, and Contracting Vector Fields for Consensus and Synchronization of Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[65]  Uday V. Shanbhag,et al.  Distributed Computation of Equilibria in Monotone Nash Games via Iterative Regularization Techniques , 2012, SIAM J. Optim..

[66]  Frank Allgöwer,et al.  Practical synchronization with diffusive couplings , 2015, Autom..

[67]  Jing Wang,et al.  A control perspective for centralized and distributed convex optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.