Spectral Condition Numbers of Orthogonal Projections and Full Rank Linear Least Squares Residuals

A simple formula is proved to be a tight estimate for the condition number of the full rank linear least squares residual with respect to the matrix of least squares coefficients and scaled 2-norms. The tight estimate reveals that the condition number depends on three quantities, two of which can cause ill-conditioning. The numerical linear algebra literature presents several estimates of various instances of these condition numbers. All the prior values exceed the formula introduced here, sometimes by large factors.

[1]  J. Grcar.  Nuclear Norms of Rank 2 Matrices for Spectral Condition Numbers of Full Rank Linear Least Squares Solutions , 2010, 1003.2733.

[2]  A. Sluis,et al.  Stability of the solutions of linear least squares problems , 1974 .

[3]  A. J. Geurts,et al.  A contribution to the theory of condition , 1982 .

[4]  J. Rice.  A Theory of Condition , 1966 .

[5]  Gene H. Golub,et al.  Matrix computations , 1983 .

[6]  P. Wedin.  Perturbation theory for pseudo-inverses , 1973 .

[7]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[8]  A. Sluis.  Condition numbers and equilibration of matrices , 1969 .

[9]  Å. Björck.  Solving linear least squares problems by Gram-Schmidt orthogonalization , 1967 .

[10]  Serge Gratton,et al.  On the condition number of linear least squares problems in a weighted Frobenius norm , 1996 .

[11]  G. Stewart.  On the Perturbation of Pseudo-Inverses, Projections and Linear Least Squares Problems , 1977 .

[12]  Alexander N. Malyshev.  A Unified Theoryof Conditioning for Linear Least Squares and Tikhonov Regularization Solutions , 2003, SIAM J. Matrix Anal. Appl..

[13]  J. H. Wilkinson,et al.  Note on the iterative refinement of least squares solution , 1966 .

[14]  James Hardy Wilkinson,et al.  Rounding errors in algebraic processes , 1964, IFIP Congress.

[15]  Nicholas J. Higham,et al.  INVERSE PROBLEMS NEWSLETTER , 1991 .

[16]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.