Nash strategy of multiparameter singularly perturbed Markov jump stochastic systems with state- and control-dependent noise

This paper investigates Nash games for a class of multiparameter singularly perturbed stochastic systems governed by Itô's differential equation with Markov jump parameters with state- and control-dependent noise. First, in order to obtain Nash equilibrium strategies, cross-coupled stochastic algebraic Riccati equations (CSAREs) are introduced. After establishing an asymptotic structure with positive definiteness for solutions of CSAREs, feasible numerical algorithms by means of the linear matrix inequality (LMI) are considered. In addition, the mode-independent Nash strategy set is also investigated. Finally, we provide a numerical example to verify the efficiency of the proposed algorithms.

[1]  Djordjija Petkovski,et al.  Recursive approach to finite time singularly perturbed and weakly coupled linear control systems , 1990 .

[2]  Hiroaki Mukaidani,et al.  A new design approach for solving linear quadratic nash games of multiparameter singularly perturbed systems , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  T. Başar.  A counterexample in linear-quadratic games: Existence of nonlinear nash solutions , 1974 .

[4]  Gang Feng,et al.  Technical communique: Infinite horizon H2/H∞ control for stochastic systems with Markovian jumps , 2008 .

[5]  Hiroaki Mukaidani,et al.  Soft-constrained stochastic Nash games for weakly coupled large-scale systems , 2009, Autom..

[6]  V. Dragan.  THE LINEAR QUADRATIC OPTIMIZATION PROBLEM FOR A CLASS OF SINGULARLY PERTURBED STOCHASTIC SYSTEMS , 2005 .

[7]  Hassan K. Khalil,et al.  Control of linear systems with multiparameter singular perturbations , 1979, Autom..

[8]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[9]  V. Dragan,et al.  Mathematical Methods in Robust Control of Linear Stochastic Systems , 2006 .

[10]  Xun Yu Zhou,et al.  Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon , 2003, J. Glob. Optim..

[11]  Yulin Huang,et al.  Infinite Horizon H2/H Control for Stochastic Systems with Markovian Jumps , 2007, 2007 American Control Conference.

[12]  P. Kokotovic,et al.  Control strategies for decision makers using different models of the same system , 1978 .

[13]  Hiroaki Mukaidani,et al.  Pareto Optimal Strategy for Stochastic Weakly Coupled Large Scale Systems With State Dependent System Noise , 2009, IEEE Transactions on Automatic Control.

[14]  Luca Lambertini,et al.  Dynamic Oligopoly with Sticky Prices: Closed-Loop, Feedback, and Open-Loop Solutions , 2004 .

[15]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[16]  T. Björk.  Finite dimensional optimal filters for a class of ltô- processes with jumping parameters , 1980 .

[17]  Eugênio B. Castelan,et al.  Bounded Nash type controls for uncertain linear systems , 2008, Autom..

[18]  Hiroaki Mukaidani,et al.  Near‐optimal control for multiparameter singularly perturbed stochastic systems , 2011 .

[19]  Bor-Sen Chen,et al.  Stochastic H2/H∞ control with state-dependent noise , 2004, IEEE Trans. Autom. Control..

[20]  V. Dragan,et al.  Nash Strategies of Markov Jump Stochastic Systems Applied to Weakly-Coupled Large-Scale Systems , 2011 .

[21]  V. Dragan,et al.  The linear quadratic optimization problems for a class of linear stochastic systems with multiplicative white noise and Markovian jumping , 2004, IEEE Transactions on Automatic Control.

[22]  Tetsuro Yamamoto,et al.  A method for finding sharp error bounds for Newton's method under the Kantorovich assumptions , 1986 .