Iterative least-squares solutions of coupled Sylvester matrix equations

Abstract In this paper, we present a general family of iterative methods to solve linear equations, which includes the well-known Jacobi and Gauss–Seidel iterations as its special cases. The methods are extended to solve coupled Sylvester matrix equations. In our approach, we regard the unknown matrices to be solved as the system parameters to be identified, and propose a least-squares iterative algorithm by applying a hierarchical identification principle and by introducing the block-matrix inner product (the star product for short). We prove that the iterative solution consistently converges to the exact solution for any initial value. The algorithms proposed require less storage capacity than the existing numerical ones. Finally, the algorithms are tested on computer and the results verify the theoretical findings.

[1]  Robert R. Bitmead,et al.  Explicit solutions of the discrete-time Lyapunov matrix equation and Kalman-Yakubovich equations , 1981 .

[2]  N. Komaroff.  Lower bounds for the solution of the discrete algebraic Lyapunov equation , 1992 .

[3]  Chien-Hua Lee.  On the matrix bounds for the solution matrix of the discrete algebraic Riccati equation , 1996, IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications.

[4]  Takehiro Mori,et al.  On solution bounds for three types of Lyapunov matrix equations: continuous, discrete and unified equations , 2002, IEEE Trans. Autom. Control..

[5]  Isak Jonsson,et al.  Recursive blocked algorithms for solving triangular systems—Part II: two-sided and generalized Sylvester and Lyapunov matrix equations , 2002, TOMS.

[6]  Joan-Josep Climent,et al.  Convergence and comparison theorems for a generalized alternating iterative method , 2003, Appl. Math. Comput..

[7]  J. D. Stegeman,et al.  Fractional Hadamard powers of positive semidefinite matrices , 2003 .

[8]  Bruce A. Francis,et al.  Optimal Sampled-Data Control Systems , 1996, Communications and Control Engineering Series.

[9]  Robert R. Bitmead,et al.  On the solution of the discrete-time Lyapunov matrix equation in controllable canonical form , 1979 .

[10]  I. Borno.  Parallel computation of the solutions of coupled algebraic Lyapunov equations , 1995, Autom..

[11]  G. Golub,et al.  A Hessenberg-Schur method for the problem AX + XB= C , 1979 .

[12]  Israel Gohberg,et al.  Recent Developments in Operator Theory and Its Applications : International Conference in Winnipeg, October 2-6, 1994 , 1996 .

[13]  J. Garloff.  Bounds for the eigenvalues of the solution of the discrete Riccati and Lyapunov equations and the continuous Lyapunov equation , 1986 .

[14]  Michael K. Tippett,et al.  Bounds for the solution of the discrete algebraic Lyapunov equation , 1998, Autom..

[15]  W. Niethammer,et al.  SOR for AX−XB=C , 1991 .

[16]  Michael K. Tippett,et al.  Upper bounds for the solution of the discrete algebraic Lyapunov equation , 1999, Autom..

[17]  A. Barraud.  A numerical algorithm to solve AT X A - X = Q , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[18]  Gene H. Golub,et al.  Matrix computations , 1983 .

[19]  M. Benseddik,et al.  Unified type non-stationary Lyapunov matrix equation — simultaneous eigenvalue bounds , 1995 .

[20]  Chien-Hua Lee.  Upper and lower matrix bounds of the solution for the discrete Lyapunov equation , 1996, IEEE Trans. Autom. Control..

[21]  Isak Jonsson,et al.  Recursive blocked algorithms for solving triangular systems—Part I: one-sided and coupled Sylvester-type matrix equations , 2002, TOMS.

[22]  A. Hmamed,et al.  Discrete Lyapunov equation: simultaneous eigenvalue lower bounds , 1991 .

[23]  Bo Kågström,et al.  A Perturbation Analysis of the Generalized Sylvester Equation $( AR - LB,DR - LE ) = ( C,F )$ , 1994, SIAM J. Matrix Anal. Appl..

[24]  T. Mori,et al.  A brief summary of the bounds on the solution of the algebraic matrix equations in control theory , 1984 .

[25]  N. Komaroff.  Upper summation and product bounds for solution eigenvalues of the Lyapunov matrix equation , 1992 .

[26]  Tongwen Chen,et al.  Multirate sampled-data systems: all H∞ suboptimal controllers and the minimum entropy controller , 1999, IEEE Trans. Autom. Control..

[27]  Young Soo Moon,et al.  Bounds in algebraic Riccati and Lyapunov equations: a survey and some new results , 1996 .

[28]  K. Chu.  The solution of the matrix equations AXB−CXD=E AND (YA−DZ,YC−BZ)=(E,F) , 1987 .

[29]  N. Komaroff.  Simultaneous eigenvalue lower bounds for the Lyapunov matrix equation , 1988 .

[30]  G. Corach,et al.  Index of Hadamard multiplication by positive matrices II , 1999 .

[31]  Shuhuang Xiang.  On an inequality for the Hadamard product of an M-matrix or an H-matrix and its inverse☆ , 2003 .

[32]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[33]  R. Scott Grabinger.  The Solution Matrix. , 1989 .

[34]  J. Heinen,et al.  A technique for solving the extended discrete Lyapunov matrix equation , 1972 .

[35]  Li Qiu,et al.  H∞ design of general multirate sampled-data control systems , 1994, Autom..

[36]  Hiroaki Mukaidani,et al.  New iterative algorithm for algebraic Riccati equation related to H ∞ control problem of singularly perturbed systems , 2001, IEEE Trans. Autom. Control..

[37]  Li Qiu,et al.  Contractive Completion of Block Matrices and its Application to ℋ∞ Control of Periodic systems , 1996 .

[38]  K. Loparo,et al.  New estimates for solutions of Lyapunov equations , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[39]  Li Qiu,et al.  Unitary dilation approach to contractive matrix completion , 2004 .

[40]  Charles R. Johnson,et al.  The relationship between Hadamard and conventional multiplication for positive definite matrices , 1987 .

[41]  M. Mrabti,et al.  Bounds for the solution of the Lyapunov matrix equation—a unified approach , 1992 .