A stationary iterative pseudoinverse algorithm

Iterative methods applied to the normal equationsATAx=ATb are sometimes used for solving large sparse linear least squares problems. However, when the matrix is rank-deficient many methods, although convergent, fail to produce the unique solution of minimal Euclidean norm. Examples of such methods are the Jacobi and SOR methods as well as the preconditioned conjugate gradient algorithm. We analyze here an iterative scheme that overcomes this difficulty for the case of stationary iterative methods. The scheme combines two stationary iterative methods. The first method produces any least squares solution whereas the second produces the minimum norm solution to a consistent system.

[1]  Achiya Dax,et al.  The Convergence of Linear Stationary Iterative Processes for Solving Singular Unstructured Systems of Linear Equations , 1990, SIAM Rev..

[2]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[3]  Y. Censor,et al.  Strong underrelaxation in Kaczmarz's method for inconsistent systems , 1983 .

[4]  L. D. Pyle.  A generalized inverse ∈-algorithm for constructing intersection projection matrices, with applications , 1967 .

[5]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[6]  Constantin Popa,et al.  Least-squares solution of overdetermined inconsistent linear systems using kaczmarz's relaxation , 1995, Int. J. Comput. Math..

[7]  T. Elfving.  Block-iterative methods for consistent and inconsistent linear equations , 1980 .

[8]  J. Meyer.  Generalized Inverses (Theory And Applications) (Adi Ben-Israel and Thomas N. E. Greville) , 1976 .

[9]  F. Natterer.  The Mathematics of Computerized Tomography , 1986 .

[10]  Å. Björck,et al.  Accelerated projection methods for computing pseudoinverse solutions of systems of linear equations , 1979 .

[11]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[12]  A. Lent,et al.  Iterative algorithms for large partitioned linear systems, with applications to image reconstruction , 1981 .

[13]  M. Hanke,et al.  On the acceleration of Kaczmarz's method for inconsistent linear systems , 1990 .

[14]  Gabor T. Herman,et al.  Image Reconstruction From Projections , 1975, Real Time Imaging.

[15]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[16]  M. Heath.  Numerical Methods for Large Sparse Linear Least Squares Problems , 1984 .

[17]  K. Tanabe.  Projection method for solving a singular system of linear equations and its applications , 1971 .