Numerical computation of linear quadratic control problem for singularly perturbed stochastic systems

In this paper, linear quadratic control with state-dependent noise for singularly perturbed stochastic systems (SPSS) is addressed. After establishing the asymptotic structure of the stochastic algebraic Riccati equation (SARE), a new iterative algorithm that combine the Newton's method with the fixed point algorithm is established. As a result, the quadratic convergence and the reduced-order computation in the same dimension of the subsystem are both attained. As another important feature, a high-order state feedback controller by means of the obtained iterative solution is given and the degradation of the cost performance is investigated for the stochastic case for the first time. Finally, in order to demonstrate the efficiency of the proposed algorithm, numerical example is given for practical megawatt-frequency control problem.

[1]  D. Hinrichsen,et al.  Stochastic H∞ , 1998 .

[2]  V. Dragan.  THE LINEAR QUADRATIC OPTIMIZATION PROBLEM FOR A CLASS OF SINGULARLY PERTURBED STOCHASTIC SYSTEMS , 2005 .

[3]  V. Ugrinovskii.  Robust H∞ infinity control in the presence of stochastic uncertainty , 1998 .

[4]  D. Hinrichsen,et al.  Stochastic $H^\infty$ , 1998 .

[5]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[6]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[7]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[8]  Bor-Sen Chen,et al.  Stochastic H2/H∞ control with state-dependent noise , 2004, IEEE Trans. Autom. Control..

[9]  Hiroaki Mukaidani,et al.  Asymptotic Expansions and a New Numerical Algorithm of the Algebraic Riccati Equation for Multiparameter Singularly Perturbed Systems , 2002 .

[10]  Charles E. Fosha,et al.  Optimum Megawatt-Frequency Control of Multiarea Electric Energy Systems , 1970 .

[11]  Hiroaki Mukaidani,et al.  New results for near-optimal control of linear multiparameter singularly perturbed systems , 2003, Autom..

[12]  Hiroaki Mukaidani,et al.  A numerical algorithm for finding solution of sign-indefinite algebraic Riccati equations for general multiparameter singularly perturbed systems , 2007, Appl. Math. Comput..

[13]  V. R. Nosov,et al.  Mathematical theory of control systems design , 1996 .

[14]  Tetsuro Yamamoto,et al.  A method for finding sharp error bounds for Newton's method under the Kantorovich assumptions , 1986 .