Distributed Nash Equilibrium Computation for Mixed-order Multi-player Games

Noticing that agents with different dynamics may work together, this paper considers Nash equilibrium computation for a class of games in which first-order integrator-type players and second-order integrator-type players interact in a distributed network. To deal with this situation, we firstly exploit a centralized method for full information games. In the considered scenario, the players can employ its own gradient information, though it may rely on all players’ actions. Based on the proposed centralized algorithm, we further develop a distributed counterpart. Different from the centralized one, the players are assumed to have limited access into the other players’ actions. Appropriate Lyapunov functions are constructed to investigate the effectiveness of the proposed methods analytically. It is shown that the proposed method would drive the players’ actions to the Nash equilibrium exponentially. Lastly, the theoretical results are numerically verified by simulation examples.

[1]  Frank L. Lewis,et al.  Adaptive and distributed control of nonlinear and heterogeneous multi-agent systems , 2013, 52nd IEEE Conference on Decision and Control.

[2]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking in Multiagent Games Under Switching Communication Topologies , 2018, IEEE Transactions on Cybernetics.

[3]  Frank L. Lewis,et al.  Output regulation of linear heterogeneous multi-agent systems via output and state feedback , 2016, Autom..

[4]  Maojiao Ye,et al.  On Distributed Nash Equilibrium Computation: Hybrid Games and a Novel Consensus-Tracking Perspective , 2020, IEEE Transactions on Cybernetics.

[5]  Cheng-Lin Liu,et al.  Average-Consensus Tracking of Sensor Network via Distributed Coordination Control of Heterogeneous Multi-Agent Systems , 2019, IEEE Control Systems Letters.

[6]  Maojiao Ye,et al.  Consensus analysis of hybrid multiagent systems: A game‐theoretic approach , 2019, International Journal of Robust and Nonlinear Control.

[7]  Zhengtao Ding,et al.  Distributed Optimal Coordination for Heterogeneous Linear Multiagent Systems With Event-Triggered Mechanisms , 2020, IEEE Transactions on Automatic Control.

[8]  Long Wang,et al.  Consensus of heterogeneous multi-agent systems without velocity measurements , 2012, Int. J. Control.

[9]  Maojiao Ye,et al.  An extremum seeking-based approach for Nash equilibrium seeking in N-cluster noncooperative games , 2020, Autom..

[10]  Zhang Ren,et al.  Distributed Time-Varying Formation Robust Tracking for General Linear Multiagent Systems With Parameter Uncertainties and External Disturbances , 2017, IEEE Transactions on Cybernetics.

[11]  Fei Liu,et al.  Stationary consensus of heterogeneous multi-agent systems with bounded communication delays , 2011, Autom..

[12]  Maria Prandini,et al.  Price of anarchy in electric vehicle charging control games: When Nash equilibria achieve social welfare , 2016, Autom..

[13]  Ashish Cherukuri,et al.  Decentralized Nash equilibrium learning by strategic generators for economic dispatch , 2016, 2016 American Control Conference (ACC).

[14]  Junwei Cao,et al.  Optimal energy management strategies for energy Internet via deep reinforcement learning approach , 2019, Applied Energy.

[15]  Tomohisa Hayakawa,et al.  Nash Equilibrium Seeking with Linear Time-Invariant Dynamic Agents , 2019, 2019 American Control Conference (ACC).

[16]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[17]  Jie Chen,et al.  Distributed Consensus of Second-Order Multi-Agent Systems With Heterogeneous Unknown Inertias and Control Gains Under a Directed Graph , 2016, IEEE Transactions on Automatic Control.

[18]  Sergio Grammatico,et al.  Distributed averaging integral Nash equilibrium seeking on networks , 2018, Autom..

[19]  Maojiao Ye,et al.  Distributed Robust Seeking of Nash Equilibrium for Networked Games: An Extended State Observer-Based Approach , 2019, IEEE Transactions on Cybernetics.

[20]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking for Games in Systems With Bounded Control Inputs , 2019, IEEE Transactions on Automatic Control.

[21]  Maojiao Ye,et al.  Game Design and Analysis for Price-Based Demand Response: An Aggregate Game Approach , 2015, IEEE Transactions on Cybernetics.

[22]  Tingwen Huang,et al.  Fully Distributed Formation-Containment Control of Heterogeneous Linear Multiagent Systems , 2019, IEEE Transactions on Automatic Control.

[23]  Tomohisa Hayakawa,et al.  Nash Equilibrium Seeking with Second-Order Dynamic Agents , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[24]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[25]  F. Lewis,et al.  A Unified Strategy for Solution Seeking in Graphical $N$-Coalition Noncooperative Games , 2017, IEEE Transactions on Automatic Control.

[26]  Maojiao Ye,et al.  Nash equilibrium seeking for N-coalition noncooperative games , 2018, Autom..

[27]  Zhihua Qu,et al.  Distributed formation control with open-loop Nash strategy , 2019, Autom..