Gradient Based Iterative Algorithms for Solving a Class of Matrix Equations

In this note, we apply a hierarchical identification principle to study solving the Sylvester and Lyapunov matrix equations. In our approach, we regard the unknown matrix to be solved as system parameters to be identified, and present a gradient iterative algorithm for solving the equations by minimizing certain criterion functions. We prove that the iterative solution consistently converges to the true solution for any initial value, and illustrate that the rate of convergence of the iterative solution can be enhanced by choosing the convergence factor (or step-size) appropriately. Furthermore, the iterative method is extended to solve general linear matrix equations. The algorithms proposed require less storage capacity than the existing numerical ones. Finally, the algorithms are tested on computer and the results verify the theoretical findings.

[1]  Feng Ding,et al.  Iterative least-squares solutions of coupled Sylvester matrix equations , 2005, Syst. Control. Lett..

[2]  J. Heinen,et al.  A technique for solving the extended discrete Lyapunov matrix equation , 1972 .

[3]  G. Golub,et al.  A Hessenberg-Schur method for the problem AX + XB= C , 1979 .

[4]  Feng Ding,et al.  Hierarchical least squares identification methods for multivariable systems , 2005, IEEE Trans. Autom. Control..

[5]  Tatjana Stykel,et al.  Numerical solution and perturbation theory for generalized Lyapunov equations , 2002 .

[6]  Isak Jonsson,et al.  Recursive blocked algorithms for solving triangular systems—Part I: one-sided and coupled Sylvester-type matrix equations , 2002, TOMS.

[7]  Hiroaki Mukaidani,et al.  New iterative algorithm for algebraic Riccati equation related to H ∞ control problem of singularly perturbed systems , 2001, IEEE Trans. Autom. Control..

[8]  Young Soo Moon,et al.  Bounds in algebraic Riccati and Lyapunov equations: a survey and some new results , 1996 .

[9]  W. Niethammer,et al.  SOR for AX−XB=C , 1991 .

[10]  E. Davison,et al.  The numerical solution of A'Q+QA =-C , 1968 .

[11]  Robert R. Bitmead,et al.  On the solution of the discrete-time Lyapunov matrix equation in controllable canonical form , 1979 .

[12]  T. Mori,et al.  A brief summary of the bounds on the solution of the algebraic matrix equations in control theory , 1984 .

[13]  Isak Jonsson,et al.  Recursive blocked algorithms for solving triangular systems—Part II: two-sided and generalized Sylvester and Lyapunov matrix equations , 2002, TOMS.

[14]  Yuguang Fang,et al.  New estimates for solutions of Lyapunov equations , 1997, IEEE Trans. Autom. Control..

[15]  Enrique S. Quintana-Ortí,et al.  Solving stable generalized Lyapunov equations with the matrix sign function , 1999, Numerical Algorithms.

[16]  Feng Ding,et al.  Hierarchical gradient-based identification of multivariable discrete-time systems , 2005, Autom..

[17]  Robert R. Bitmead,et al.  Explicit solutions of the discrete-time Lyapunov matrix equation and Kalman-Yakubovich equations , 1981 .

[18]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .