Lyapunov Iterations for Solving Coupled Algebraic Riccati Equations of Nash Differential Games and Algebraic Riccati Equations of Zero-Sum Games

In this paper we study the symmetric coupled algebraic Riccati equations corresponding to the steady state Nash strategies. Under control-oriented assumptions, imposed on the problem matrices, the Lyapunov iterations are constructed such that the proposed algorithm converges to the nonnegative (positive) definite stabilizing solution of the coupled algebraic Riccati equations. In addition, the problem order reduction is achieved since the obtained Lyapunov equations are of the reduced-order and can be solved independently. As a matter of fact a parallel synchronous algorithm is obtained. A high-order numerical example is included in order to demonstrate the efficiency of the proposed algorithm. In the second part of this paper we have proposed an algorithm, in terms of the Lyapunov iterations, for finding the positive semidefinite stabilizing solution of the algebraic Riccati equation of the zero-sum differential games. The similar algebraic Riccati type equations appear in the H ∞ optimal control and related problems.

[1]  L. Kantorovich,et al.  Functional analysis in normed spaces , 1952 .

[2]  R Bellman,et al.  Monotone Approximation in Dynamic Programming and the Calculus of Variations. , 1954, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[4]  R. Bellman.  Dynamic programming. , 1957, Science.

[5]  Ruey-Wen Liu,et al.  Construction of Suboptimal Control Sequences , 1967 .

[6]  R. Larson,et al.  A survey of dynamic programming computational procedures , 1967, IEEE Transactions on Automatic Control.

[7]  R. Chattopadhyay.  On Differential Games , 1967 .

[8]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[9]  D. Kleinman.  On an iterative technique for Riccati equation computations , 1968 .

[10]  Y. Ho,et al.  Nonzero-sum differential games , 1969 .

[11]  Donald E. Kirk,et al.  Optimal Control Theory , 1970 .

[12]  Z. Rekasius,et al.  On the solution of the optimal linear control problems under conflict of interest , 1971 .

[13]  V. Kučera.  A contribution to matrix quadratic equations , 1972 .

[14]  Martin D. Levine,et al.  On-line learning optimal control using successive approximation techniques , 1973 .

[15]  T. Başar.  A counterexample in linear-quadratic games: Existence of nonlinear nash solutions , 1974 .

[16]  D. Tabak.  Numerical solutions of differential game problems , 1975 .

[17]  G. Olsder.  Comments on a numerical procedure for the solution of differential games , 1975 .

[18]  E. Mageirou.  Values and strategies for infinite time linear quadratic games , 1976 .

[19]  E. Mageirou.  Iterative techniques for Riccati game equations , 1977 .

[20]  Yu-Chi Ho,et al.  Decentralized stabilization via game theoretic methods , 1977, Autom..

[21]  Ümit Özgüner,et al.  A series solution to the nash strategy for large scale interconnected systems , 1977, Autom..

[22]  P. Kokotovic,et al.  Feedback and well-posedness of singularly perturbed Nash games , 1978 .

[23]  J. B. CruzJr.,et al.  On the existence of Nash strategies and solutions to coupled riccati equations in linear-quadratic games , 1979 .

[24]  H. Khalil.  Multimodel design of a Nash strategy , 1980 .

[25]  Lamberto Cesari,et al.  Optimization-Theory And Applications , 1983 .

[26]  Ian R. Petersen,et al.  A riccati equation approach to the stabilization of uncertain linear systems , 1986, Autom..

[27]  Z. Gajic,et al.  Recursive solution of linear-quadratic Nash games for weakly interconnected systems , 1986, 1986 American Control Conference.

[28]  I. Petersen.  Disturbance attenuation and H^{∞} optimization: A design method based on the algebraic Riccati equation , 1987 .

[29]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[30]  Ian R. Petersen,et al.  Some new results on algebraic Riccati equations arising in linear quadratic differential games and the stabilization of uncertain linear systems , 1988 .

[31]  P. Khargonekar,et al.  An algebraic Riccati equation approach to H ∞ optimization , 1988 .

[32]  H. Abou-Kandil,et al.  Kronecker products and coupled matrix Riccati differential systems , 1989 .

[33]  D. Bernstein,et al.  LQG control with an H/sup infinity / performance bound: a Riccati equation approach , 1989 .

[34]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[35]  S. Bittanti,et al.  The Riccati equation , 1991 .

[36]  T. Başar.  Generalized Riccati Equations in Dynamic Games , 1991 .

[37]  John N. Tsitsiklis,et al.  Some aspects of parallel and distributed iterative algorithms - A survey, , 1991, Autom..

[38]  G. Hewer.  Existence theorems for positive semidefinite and sign indefinite stabilizing solutions of H ∞ Riccati equations , 1993 .

[39]  Z. Gajic,et al.  Parallel Algorithms for Optimal Control of Large Scale Linear Systems , 1993 .

[40]  H. Abou-Kandil,et al.  Necessary conditions for constant solutions of coupled Riccati equations in Nash games , 1993 .

[41]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..