Preconditioned GMRES methods with incomplete Givens orthogonalization method for large sparse least-squares problems

We propose to precondition the GMRES method by using the incomplete Givens orthogonalization (IGO) method for the solution of large sparse linear least-squares problems. Theoretical analysis shows that the preconditioner satisfies the sufficient condition that can guarantee that the preconditioned GMRES method will never break down and always give the least-squares solution of the original problem. Numerical experiments further confirm that the new preconditioner is efficient. We also find that the IGO preconditioned BA-GMRES method is superior to the corresponding CGLS method for ill-conditioned and singular least-squares problems.

[1]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[2]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[3]  G. Herman,et al.  A Preconditioned Krylov Subspace Method for the Solution of Least Squares Problems in Inverse Scattering , 1996 .

[4]  Zeng-Qi Wang,et al.  Restrictive preconditioners for conjugate gradient methods for symmetric positive definite linear systems , 2006 .

[5]  Iain S. Duff,et al.  A Class of Incomplete Orthogonal Factorization Methods. I: Methods and Theories , 1999 .

[6]  Zhong-zhi,et al.  A SHIFT-SPLITTING PRECONDITIONER FOR NON-HERMITIAN POSITIVE DEFINITE MATRICES , 2006 .

[7]  Shao-Liang Zhang,et al.  A necessary and sufficient convergence condition of orthomin(k) methods for least squares problem with weight , 1990 .

[8]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[9]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[10]  Z. Bai,et al.  Restrictively preconditioned conjugate gradient methods for systems of linear equations , 2003 .

[11]  Iain S. Duff,et al.  Incomplete Orthogonal Factorization Methods Using Givens Rotations II: Implementation and Results , 2002 .

[12]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[13]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[14]  Iain S. Duff,et al.  A Class of Incomplete Orthogonal Factorization Methods. II: Implementation and Results , 2005 .

[15]  Preconditioned GMRES methods for least squares problems , 2008 .

[16]  ZhangShaoLiang,et al.  Orthomin(k) Method for Linear Least Squares Problem , 1991 .

[17]  Jun-Feng Yin,et al.  GMRES Methods for Least Squares Problems , 2010, SIAM J. Matrix Anal. Appl..

[18]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[19]  Junfeng,et al.  THE RESTRICTIVELY PRECONDITIONED CONJUGATE GRADIENT METHODS ON NORMAL RESIDUAL FOR BLOCK TWO-BY-TWO LINEAR SYSTEMS , 2008 .