Stability and robustness analysis of minmax solutions for differential graphical games

Abstract Recent studies have shown that, in general, Nash equilibrium cannot be achieved by the players of a differential graphical game by using distributed control policies. Alternative solution concepts that do not necessarily lead to Nash equilibrium can be proposed to allow the players in the game determine distributed optimal strategies. This paper analyzes the performance properties of the solution concept regarded as minmax strategies. The minmax formulation is shown to provide distributed control policies for linear systems under mild assumptions. The stability and robustness characteristics of the proposed solution are studied in terms of gain and phase margins, and related to the robustness properties of the single-agent LQR controller. The results of our analysis are finally tested by means of a simulation example.

[1]  Kevin L. Moore,et al.  High-Order and Model Reference Consensus Algorithms in Cooperative Control of MultiVehicle Systems , 2007 .

[2]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[3]  Frank L. Lewis,et al.  $ {H}_{ {\infty }}$ Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Jiangping Hu,et al.  Tracking control for multi-agent consensus with an active leader and variable topology , 2006, Autom..

[5]  Frank L. Lewis,et al.  Optimal Control , 1986 .

[6]  Frank L. Lewis,et al.  Cooperative Control of Multi-Agent Systems: Optimal and Adaptive Design Approaches , 2013 .

[7]  Xiang Li,et al.  Pinning a complex dynamical network to its equilibrium , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[8]  D. Bernstein.  Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[9]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[10]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[11]  M. Athans,et al.  Gain and phase margin for multiloop LQG regulators. [Linear-Quadratic-Gaussian theory] , 1977 .

[12]  P. Khargonekar,et al.  State-space solutions to standard H/sub 2/ and H/sub infinity / control problems , 1989 .

[13]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .

[14]  Frank L. Lewis,et al.  Multi-agent differential graphical games , 2011, Proceedings of the 30th Chinese Control Conference.

[15]  Frank L. Lewis,et al.  Output regulation of heterogeneous linear multi‐agent systems with differential graphical game , 2016 .

[16]  P. Khargonekar,et al.  State-space solutions to standard H2 and H∞ control problems , 1988, 1988 American Control Conference.

[17]  Zhisheng Duan,et al.  On H∞ and H2 performance regions of multi-agent systems , 2011, Autom..

[18]  Emre Ertin,et al.  MiniMax equilibrium of networked differential games , 2008, TAAS.

[19]  Frank L. Lewis,et al.  On constructing Lyapunov functions for multi-agent systems , 2015, Autom..

[20]  Huaguang Zhang,et al.  Distributed Cooperative Optimal Control for Multiagent Systems on Directed Graphs: An Inverse Optimal Approach , 2015, IEEE Transactions on Cybernetics.

[21]  Zhihua Qu,et al.  A Design of Distributed Game Strategies for Networked Agents , 2009 .

[22]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[23]  Huibert Kwakernaak,et al.  Robust control and H∞-optimization - Tutorial paper , 1993, Autom..