Least Squares Solution of the Linear Operator Equation

The least squares problems have wide applications in inverse Sturm–Liouville problem, particle physics and geology, inverse problems of vibration theory, control theory, digital image and signal processing. In this paper, we discuss the solution of the operator least squares problem. By extending the conjugate gradient least squares method, we propose an efficient matrix algorithm for solving the operator least squares problem. The matrix algorithm can find the solution of the problem within a finite number of iterations in the absence of round-off errors. Some numerical examples are given to illustrate the effectiveness of the matrix algorithm.

[1]  Qing-Wen Wang,et al.  Ranks and the least-norm of the general solution to a system of quaternion matrix equations , 2009 .

[2]  Feng Ding,et al.  Hierarchical least squares identification methods for multivariable systems , 2005, IEEE Trans. Autom. Control..

[3]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[4]  N. Nichols,et al.  Eigenstructure assignment in descriptor systems , 1986 .

[5]  Guang-Ren Duan,et al.  An explicit solution to the matrix equation AV+BW=EV J , 2007 .

[6]  James Lam,et al.  Robust eigenvalue assignment in second-order systems: A gradient flow approach , 1997 .

[7]  Guang-Ren Duan,et al.  Solution to the second-order Sylvester matrix equation MVF/sup 2/+DVF+KV=BW , 2006, IEEE Transactions on Automatic Control.

[8]  Masoud Hajarian,et al.  Matrix form of the CGS method for solving general coupled matrix equations , 2014, Appl. Math. Lett..

[9]  Ai-Guo Wu,et al.  Finite iterative algorithms for a common solution to a group of complex matrix equations , 2011, Appl. Math. Comput..

[10]  Mehdi Dehghan,et al.  An iterative method for solving the generalized coupled Sylvester matrix equations over generalized bisymmetric matrices , 2010 .

[11]  Z. Bai.  ON HERMITIAN AND SKEW-HERMITIAN SPLITTING ITERATION METHODS FOR CONTINUOUS SYLVESTER EQUATIONS * , 2010 .

[12]  Hajarian Masoud,et al.  A matrix LSQR algorithm for solving constrained linear operator equations , 2014 .

[13]  Ting-Zhu Huang,et al.  LSQR iterative method for generalized coupled Sylvester matrix equations , 2012 .

[14]  James Lam,et al.  Gradient-based maximal convergence rate iterative method for solving linear matrix equations , 2010, Int. J. Comput. Math..

[15]  Feng Ding,et al.  Hierarchical gradient-based identification of multivariable discrete-time systems , 2005, Autom..

[16]  Feng Ding,et al.  Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle , 2008, Appl. Math. Comput..

[17]  Michael A. Epton.  Methods for the solution ofAXD−BXC=E and its application in the numerical solution of implicit ordinary differential equations , 1980 .

[18]  D. Bernstein,et al.  The optimal projection equations for fixed-order dynamic compensation , 1984 .

[19]  Masoud Hajarian.  Solving the general coupled and the periodic coupled matrix equations via the extended QMRCGSTAB algorithms , 2014 .

[20]  Zhuohua Peng,et al.  The reflexive least squares solutions of the general coupled matrix equations with a submatrix constraint , 2013, Appl. Math. Comput..

[21]  Masoud Hajarian,et al.  A gradient-based iterative algorithm for generalized coupled Sylvester matrix equations over generalized centro-symmetric matrices , 2014 .

[22]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results , 1990, Autom..

[23]  J. Woude,et al.  A system of real quaternion matrix equations with applications , 2009 .

[24]  Qing-Wen Wang,et al.  THE REFLEXIVE RE-NONNEGATIVE DEFINITE SOLUTION TO A QUATERNION MATRIX EQUATION ∗ , 2008 .

[25]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[26]  Guang-Ren Duan,et al.  Gradient based iterative algorithm for solving coupled matrix equations , 2009, Syst. Control. Lett..

[27]  Guang-Ren Duan,et al.  The solution to the matrix equation AV + BW = EVJ + R , 2004, Appl. Math. Lett..

[28]  Qing-Wen Wang,et al.  The common solution to six quaternion matrix equations with applications , 2008, Appl. Math. Comput..

[29]  L. Dai,et al.  Singular Control Systems , 1989, Lecture Notes in Control and Information Sciences.

[30]  Masoud Hajarian.  Developing the CGLS algorithm for the least squares solutions of the general coupled matrix equations , 2014 .

[31]  Masoud Hajarian,et al.  Finite algorithms for solving the coupled Sylvester-conjugate matrix equations over reflexive and Hermitian reflexive matrices , 2015, Int. J. Syst. Sci..

[32]  Chuanqing Gu,et al.  A shift-splitting hierarchical identification method for solving Lyapunov matrix equations , 2009 .

[33]  Feng Ding,et al.  Gradient Based Iterative Algorithms for Solving a Class of Matrix Equations , 2005, IEEE Trans. Autom. Control..

[34]  G. Duan,et al.  An explicit solution to the matrix equation AX − XF = BY , 2005 .

[35]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[36]  Masoud Hajarian,et al.  A Finite Iterative Method for Solving the General Coupled Discrete-Time Periodic Matrix Equations , 2015, Circuits Syst. Signal Process..

[37]  Lothar Reichel,et al.  Application of ADI Iterative Methods to the Restoration of Noisy Images , 1996, SIAM J. Matrix Anal. Appl..

[38]  Masoud Hajarian,et al.  Matrix iterative methods for solving the Sylvester-transpose and periodic Sylvester matrix equations , 2013, J. Frankl. Inst..

[39]  Zhuohua Peng.  The reflexive least squares solutions of the matrix equation $A_1X_1B_1+A_2X_2B_2+\cdots +A_lX_lB_l=C$with a submatrix constraint , 2012, Numerical Algorithms.

[40]  James Lam,et al.  On Smith-type iterative algorithms for the Stein matrix equation , 2009, Appl. Math. Lett..

[41]  M. Dehghan,et al.  The general coupled matrix equations over generalized bisymmetric matrices , 2010 .

[42]  Mehdi Dehghan,et al.  The generalized centro‐symmetric and least squares generalized centro‐symmetric solutions of the matrix equation AYB + CYTD = E , 2011 .