Feedback Nash Equilibrium for Markov Jump Games under Differential-Algebraic Constraints with Application to Robust Control

As a subclass of stochastic differential games with algebraic constraints, this article studies dynamic noncooperative games where the constraints are described by jump Markov differential-algebraic equations (DAEs). Theoretical tools, which require computing the infinitesimal generator and deriving Hamiton-Jacobi-Bellman equation for Markov jump DAEs, are developed. These fundamental results lead to pure feedback optimal strategies to compute the Nash equilibrium in noncooperative setting. In case of quadratic cost and linear dynamics, these strategies are obtained by solving coupled Riccati differential equations. The problem of robust control can be formulated as a two-player zero sum game and is solved by applying the results developed in this paper.

[1]  R. Rishel.  Control of systems with jump Markov disturbances , 1975 .

[2]  Debasish Chatterjee,et al.  Stabilization of Deterministic Control Systems Under Random Sampling: Overview and Recent Developments , 2018 .

[3]  Tamer Basar,et al.  Feedback Equilibria in Differential Games with Structural and Modal Uncertainties , 1982 .

[4]  T. Başar,et al.  H∞-Control of Markovian Jump Systems and Solutions to Associated Piecewise-Deterministic Differential Games , 1995 .

[5]  Jacob Engwerda,et al.  The Open-Loop Linear Quadratic Differential Game for index one Descriptor Systems , 2008 .

[6]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[7]  Aneel Tanwani,et al.  Determinability and state estimation for switched differential-algebraic equations , 2016, Autom..

[8]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Quanyan Zhu,et al.  Robust and resilient control design for cyber-physical systems with an application to power systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[10]  Mark H. A. Davis.  Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[11]  Quanyan Zhu,et al.  Game-Theoretic Methods for Robustness, Security, and Resilience of Cyberphysical Control Systems: Games-in-Games Principle for Optimal Cross-Layer Resilient Control Systems , 2015, IEEE Control Systems.

[12]  Daniel Liberzon,et al.  Switched nonlinear differential algebraic equations: Solution theory, Lyapunov functions, and stability , 2012, Autom..

[13]  Georges Zaccour,et al.  Feedback Nash Equilibria in Linear-Quadratic Difference Games With Constraints , 2014, IEEE Transactions on Automatic Control.