An inexact-penalty method for GNE seeking in games with dynamic agents

We consider a network of autonomous agents whose outputs are actions in a game with coupled constraints. In such network scenarios, agents seeking to minimize coupled cost functions using distributed information while satisfying the coupled constraints. Current methods consider the small class of multiintegrator agents using primal-dual methods. These methods can only ensure constraint satisfaction in steady-state. In contrast, we propose an inexact penalty method using a barrier function for nonlinear agents with equilibrium-independent passive dynamics. We show that these dynamics converge to an ε-GNE while satisfying the constraints for all time, not only in steady-state. We develop these dynamics in both the full-information and partialinformation settings. In the partial-information setting, dynamic estimates of the others’ actions are used to make decisions and are updated through local communication. Applications to optical networks and velocity synchronization of flexible robots are provided.

[1]  Wei Lin,et al.  Distributed game strategy design with application to multi-agent formation control , 2014, 53rd IEEE Conference on Decision and Control.

[2]  Masao Fukushima,et al.  Restricted generalized Nash equilibria and controlled penalty algorithm , 2011, Comput. Manag. Sci..

[3]  Claudio De Persis,et al.  Network games with dynamic players: Stabilization and output convergence to Nash equilibrium , 2019, ArXiv.

[4]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[5]  Francisco Facchinei,et al.  Penalty Methods for the Solution of Generalized Nash Equilibrium Problems , 2010, SIAM J. Optim..

[6]  Sergio Grammatico,et al.  Continuous-time fully distributed generalized Nash equilibrium seeking for multi-integrator agents , 2021, Autom..

[7]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[8]  Francisco Facchinei,et al.  Real and Complex Monotone Communication Games , 2012, IEEE Transactions on Information Theory.

[9]  Lacra Pavel,et al.  Distributed GNE Seeking Under Partial-Decision Information Over Networks via a Doubly-Augmented Operator Splitting Approach , 2018, IEEE Transactions on Automatic Control.

[10]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..

[11]  P. Olver Nonlinear Systems , 2013 .

[12]  Lacra Pavel,et al.  GNE seeking in games with passive dynamic agents via inexact-penalty methods , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[13]  Lacra Pavel,et al.  Dynamic NE Seeking for Multi-Integrator Networked Agents With Disturbance Rejection , 2019, IEEE Transactions on Control of Network Systems.

[14]  John W. Simpson-Porco,et al.  Equilibrium-Independent Dissipativity With Quadratic Supply Rates , 2017, IEEE Transactions on Automatic Control.

[15]  Long Wang,et al.  Distributed Algorithms for Searching Generalized Nash Equilibrium of Noncooperative Games , 2019, IEEE Transactions on Cybernetics.

[16]  Ziyang Meng,et al.  Continuous-time distributed Nash equilibrium seeking algorithms for non-cooperative constrained games , 2021, Autom..

[17]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[18]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[19]  Franco Blanchini,et al.  Set-theoretic methods in control , 2007 .

[20]  Tansu Alpcan,et al.  Distributed Algorithms for Nash Equilibria of Flow Control Games , 2005 .

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Lacra Pavel,et al.  An operator splitting approach for distributed generalized Nash equilibria computation , 2019, Autom..

[23]  Filippo Fabiani,et al.  Nash equilibrium seeking in potential games with double-integrator agents , 2019, 2019 18th European Control Conference (ECC).

[24]  R. Boţ,et al.  A second-order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities , 2016, Optimization.

[25]  K. Brown,et al.  Graduate Texts in Mathematics , 1982 .

[26]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[27]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[28]  Juan Peypouquet,et al.  A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization , 2014, SIAM J. Optim..

[29]  Sergio Grammatico,et al.  Continuous-Time Integral Dynamics for a Class of Aggregative Games With Coupling Constraints , 2020, IEEE Transactions on Automatic Control.

[30]  Lacra Pavel,et al.  A noncooperative game approach to OSNR optimization in optical networks , 2006, IEEE Transactions on Automatic Control.

[31]  Francisco Facchinei,et al.  Generalized Nash Equilibrium Problems , 2010, Ann. Oper. Res..