Computing the Positive Stabilizing Solution to Algebraic Riccati Equations With an Indefinite Quadratic Term via a Recursive Method

An iterative algorithm to solve algebraic riccati equations with an indefinite quadratic term is proposed. The global convergence and local quadratic rate of convergence of the algorithm are guaranteed and a proof is given. Numerical examples are also provided to demonstrate the superior effectiveness of the proposed algorithm when compared with methods based on finding stable invariant subspaces of Hamiltonian matrices. A game theoretic interpretation of the algorithm is also provided.

[1]  K. Mårtensson,et al.  On the matrix riccati equation , 1971, Inf. Sci..

[2]  J. B. Rosen.  Iterative Solution of Nonlinear Optimal Control Problems , 1966 .

[3]  V. Mehrmann,et al.  Defect correction method for the solution of algebraic Riccati equations , 1988 .

[4]  V. Mehrmann.  The Autonomous Linear Quadratic Control Problem , 1991 .

[5]  Brian D. O. Anderson,et al.  Recursive algorithm for spectral factorization , 1974 .

[6]  A. Laub.  A schur method for solving algebraic Riccati equations , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[7]  D. Kleinman.  On an iterative technique for Riccati equation computations , 1968 .

[8]  H. Abou-Kandil,et al.  Matrix Riccati Equations in Control and Systems Theory , 2003, IEEE Transactions on Automatic Control.

[9]  A. Laub,et al.  Generalized eigenproblem algorithms and software for algebraic Riccati equations , 1984, Proceedings of the IEEE.

[10]  Vasile Sima,et al.  Algorithms for Linear-Quadratic Optimization , 2021 .

[11]  Harald K. Wimmer,et al.  On the algebraic Riccati equation , 1976, Bulletin of the Australian Mathematical Society.

[12]  R. Bellman,et al.  Quasilinearization and nonlinear boundary-value problems , 1966 .

[13]  Peter Benner,et al.  Computational Methods for Linear-Quadratic Optimization , 1999 .

[14]  Enmin Feng,et al.  Indefinite stochastic LQ control with cross term via semidefinite programming , 2003 .

[15]  Chun-Hua Guo,et al.  Efficient methods for solving a nonsymmetric algebraic Riccati equation arising in stochastic fluid models , 2006 .

[16]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[17]  Shuping Chen.  Necessary and sufficient conditions for the existence of positive solutions to algebraic Riccati equations with indefinite quadratic term , 1992 .

[18]  Richard Bellman,et al.  Introduction to the mathematical theory of control processes , 1967 .

[19]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[20]  Peter Benner,et al.  The Kleinman Iteration for Nonstabilizable Systems , 2003, Math. Control. Signals Syst..

[21]  Xun Yu Zhou,et al.  Indefinite Stochastic Riccati Equations , 2003, SIAM J. Control. Optim..

[22]  David J. N. Limebeer,et al.  Linear Robust Control , 1994 .

[23]  Daniel Boley,et al.  Numerical Methods for Linear Control Systems , 1994 .

[24]  L. Dieci,et al.  Some numerical considerations and Newton's method revisited for solving algebraic Riccati equations , 1991 .

[25]  D. Hinrichsen,et al.  Newton's method for a rational matrix equation occurring in stochastic control , 2001 .

[26]  Chun-Hua Guo.  A note on the minimal nonnegative solution of a nonsymmetric algebraic Riccati equation , 2002 .

[27]  B. Anderson,et al.  Iterative method of computing the limiting solution of the matrix Riccati differential equation , 1972 .

[28]  D. Wishart.  Introduction to the Mathematical Theory of Control Processes. Volume 1—Linear Equations and Quadratic Criteria , 1969 .

[29]  B. Anderson,et al.  Linear Optimal Control , 1971 .

[30]  K. Mrtensson.  On the matrix riccati equation , 1971 .

[31]  Richard H. Bartels,et al.  Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4] , 1972, Commun. ACM.

[32]  V. Mehrmann.  The Autonomous Linear Quadratic Control Problem: Theory and Numerical Solution , 1991 .

[33]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[34]  J. Willems.  Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[35]  Michael McAsey,et al.  Generalized Riccati equations arising in stochastic games , 2006 .

[36]  Chun-Hua Guo,et al.  Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control , 2002 .

[37]  Brain O. Anderson.  Second-order convergent algorithms for the steady-state Riccati equation , 1977 .

[38]  John B. Moore,et al.  Indefinite Stochastic Linear Quadratic Control and Generalized Differential Riccati Equation , 2002, SIAM J. Control. Optim..

[39]  Enmin Feng,et al.  Generalized differential Riccati equation and indefinite stochastic LQ control with cross term , 2004, Appl. Math. Comput..

[40]  T. Damm.  Rational Matrix Equations in Stochastic Control , 2004 .

[41]  Ruey-Wen Liu,et al.  Construction of Suboptimal Control Sequences , 1967 .