On the Characterization of Local Nash Equilibria in Continuous Games

We present a unified framework for characterizing local Nash equilibria in continuous games on either infinite-dimensional or finite-dimensional non-convex strategy spaces. We provide intrinsic necessary and sufficient first- and second-order conditions ensuring strategies constitute local Nash equilibria. We term points satisfying the sufficient conditions differential Nash equilibria. Further, we provide a sufficient condition (non-degeneracy) guaranteeing differential Nash equilibria are isolated and show that such equilibria are structurally stable. We present tutorial examples to illustrate our results and highlight degeneracies that can arise in continuous games.

[1]  Émile de Laveleye Eléments d'économie politique , .

[2]  I. Glicksberg A FURTHER GENERALIZATION OF THE KAKUTANI FIXED POINT THEOREM, WITH APPLICATION TO NASH EQUILIBRIUM POINTS , 1952 .

[3]  R. Palais Morse theory on Hilbert manifolds , 1963 .

[4]  J. Goodman Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[5]  I. Ekeland TOPOLOGIE DIFFERENTIELLE ET THEORIE DES JEUX , 1974 .

[6]  R. Abraham,et al.  Manifolds, Tensor Analysis, and Applications , 1983 .

[7]  Tamer Basar,et al.  Distributed algorithms for the computation of noncooperative equilibria , 1987, Autom..

[8]  T. Basar,et al.  Relaxation techniques and asynchronous algorithms for on-line computation of noncooperative equilibria , 1987, 26th IEEE Conference on Decision and Control.

[9]  R. Abraham,et al.  Manifolds, tensor analysis, and applications: 2nd edition , 1988 .

[10]  J. Vickers MANIFOLDS, TENSOR ANALYSIS AND APPLICATIONS (2nd edition) (Applied Mathematical Sciences 75) , 1990 .

[11]  L. Shapley,et al.  Potential Games , 1994 .

[12]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1995 .

[13]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[14]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[15]  Sjur Didrik Flåm,et al.  Restricted attention, myopic play, and thelearning of equilibrium , 1998, Ann. Oper. Res..

[16]  M. Joung,et al.  A Continuous Strategy Game for Power Transactions Analysis in Competitive Electricity Markets , 2001, IEEE Power Engineering Review.

[17]  Daniel E. Koditschek,et al.  Phase Regulation of Decentralized Cyclic Robotic Systems , 2002, Int. J. Robotics Res..

[18]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[19]  J. Hofbauer Uncoupled Dynamics Do Not Lead to Nash Equilibrium , 2003 .

[20]  Magnus Egerstedt,et al.  Decentralized Coordination with Local Interactions: Some New Directions , 2003 .

[21]  J. Krawczyk,et al.  Numerical solutions to Nash-Cournot equilibria in coupled constraint electricity markets , 2004, IEEE Transactions on Power Systems.

[22]  S. Smale Global analysis and economics , 1975, Synthese.

[23]  M Ergun,et al.  Dynamic traffic signal control using a nonlinear coupled oscillators approach , 2005 .

[24]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[25]  Naomi Ehrich Leonard,et al.  Stabilization of Planar Collective Motion: All-to-All Communication , 2007, IEEE Transactions on Automatic Control.

[26]  R. Sepulchre,et al.  Oscillator Models and Collective Motion , 2007, IEEE Control Systems.

[27]  Andreas Fischer,et al.  On generalized Nash games and variational inequalities , 2007, Oper. Res. Lett..

[28]  Phil Husbands,et al.  Exploring the Kuramoto model of coupled oscillators in minimally cognitive evolutionary robotics tasks , 2010, IEEE Congress on Evolutionary Computation.

[29]  Masayuki Fujita,et al.  Potential game theoretic attitude coordination on the circle: Synchronization and balanced circular formation , 2010, 2010 IEEE International Symposium on Intelligent Control.

[30]  Sean P. Meyn,et al.  Synchronization of Coupled Oscillators is a Game , 2010, IEEE Transactions on Automatic Control.

[31]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[32]  Asuman E. Ozdaglar,et al.  Near-Optimal Power Control in Wireless Networks: A Potential Game Approach , 2010, 2010 Proceedings IEEE INFOCOM.

[33]  N. McClamroch,et al.  Rigid-Body Attitude Control , 2011, IEEE Control Systems.

[34]  A. Bressan,et al.  Nash equilibria for a model of traffic flow with several groups of drivers , 2012 .

[35]  Quanyan Zhu,et al.  A game-theoretic framework for control of distributed renewable-based energy resources in smart grids , 2012, 2012 American Control Conference (ACC).

[36]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[37]  Quanyan Zhu,et al.  GUIDEX: A Game-Theoretic Incentive-Based Mechanism for Intrusion Detection Networks , 2012, IEEE Journal on Selected Areas in Communications.

[38]  S. Shankar Sastry,et al.  Pricing in linear-quadratic dynamic games , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[39]  Hubertus Th. Jongen,et al.  On Structure and Computation of Generalized Nash Equilibria , 2013, SIAM J. Optim..

[40]  Santa Barbara,et al.  Dynamics and Control in Power Grids and Complex Oscillator Networks , 2013 .

[41]  S. Shankar Sastry,et al.  Characterization and computation of local Nash equilibria in continuous games , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[42]  S. Shankar Sastry,et al.  Energy management via pricing in LQ dynamic games , 2013, 2013 American Control Conference.

[43]  S. Shankar Sastry,et al.  Genericity and structural stability of non-degenerate differential Nash equilibria , 2014, 2014 American Control Conference.

[44]  Alexandre M. Bayen,et al.  Stackelberg Routing on Parallel Networks With Horizontal Queues , 2012, IEEE Transactions on Automatic Control.

[45]  Yongqiang Wang,et al.  Collective Oscillation Period of Inter-Coupled Biological Negative Cyclic Feedback Oscillators , 2015, IEEE Transactions on Automatic Control.