Relative Perturbation Theory: II. Eigenspace and Singular Subspace Variations

The classical perturbation theory for Hermitian matrix eigenvalue and singular value problems provides bounds on invariant subspace variations that are proportional to the reciprocals of absolute gaps between subsets of spectra or subsets of singular values. These bounds may be bad news for invariant subspaces corresponding to clustered eigenvalues or clustered singular values of much smaller magnitudes than the norms of matrices under considerations. In this paper, we consider how eigenspaces of a Hermitian matrix A change when it is perturbed to $\widetilde A=D^*AD$ and how singular spaces of a (nonsquare) matrix B change when it is perturbed to $\widetilde B=D_1^*BD_2$, where D, D1, and D2 are nonsingular. It is proved that under these kinds of perturbations, the changes of invariant subspaces are proportional to the reciprocals of relative gaps between subsets of spectra or subsets of singular values. The classical Davis--Kahan $\sin\theta$ theorems and Wedin $\sin\theta$ theorems are extended.

[1]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[2]  J. Barlow,et al.  Computing accurate eigensystems of scaled diagonally dominant matrices: LAPACK working note No. 7 , 1988 .

[3]  A. Ostrowski.  A QUANTITATIVE FORMULATION OF SYLVESTER'S LAW OF INERTIA. , 1959, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Ren-Cang Li.  Relative Perturbation Theory: I. Eigenvalue and Singular Value Variations , 1998, SIAM J. Matrix Anal. Appl..

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  W. Kahan.  Accurate eigenvalues of a symmetric tri-diagonal matrix , 1966 .

[7]  R. Mathias.  Spectral Perturbation Bounds for Positive Definite Matrices , 1997 .

[8]  Ilse C. F. Ipsen,et al.  Relative perturbation techniques for singular value problems , 1995 .

[9]  Chandler Davis.  The rotation of eigenvectors by a perturbation , 1963 .

[10]  Ren-Cang Li.  On perturbations of matrix pencils with real spectra , 1994 .

[11]  James Demmel,et al.  Jacobi's Method is More Accurate than QR , 1989, SIAM J. Matrix Anal. Appl..

[12]  Chandler Davis,et al.  Perturbation of spectral subspaces and solution of linear operator equations , 1983 .

[13]  W. Gragg,et al.  On computing accurate singular values and eigenvalues of matrices with acyclic graphs , 1992 .

[14]  P. Wedin.  Perturbation bounds in connection with singular value decomposition , 1972 .

[15]  James Demmel,et al.  Accurate Singular Values of Bidiagonal Matrices , 1990, SIAM J. Sci. Comput..

[16]  Ren Li.  Relative perturbation theory: (I) eigenvalue variations , 1994 .