First-Order Perturbation Analysis of Singular Vectors in Singular Value Decomposition

The perturbation analysis of singular value decomposition (SVD) has been well documented in the literature within the context of subspace decomposition. The contribution of the signal subspace to the perturbation of the singular vectors that span the signal subspace is often ignored as it is treated as second and higher order terms, and thus the first-order perturbation is typically given as the column span of the noise subspace. In this paper, we show that not only the noise subspace, but also the signal subspace, contribute to the first-order perturbation of the singular vectors. We further show that the contribution of the signal subspace does not impact on the performance analysis of algorithms that rely on the signal subspace for parameter estimation, but it affects the analysis of algorithms that depends on the individual basis vectors. For the latter, we also give a condition under which the contribution of the signal subspace to the perturbation of singular vectors may be ignored in the statistical sense.

[1]  Merico E. Argentati,et al.  Principal Angles between Subspaces in an A-Based Scalar Product: Algorithms and Perturbation Estimates , 2001, SIAM J. Sci. Comput..

[2]  Anthony J. Weiss,et al.  On the second-order statistics of the eigenvectors of sample covariance matrices , 1998, IEEE Trans. Signal Process..

[3]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[4]  J. H. Wilkinson.  The algebraic eigenvalue problem , 1966 .

[5]  Yonina C. Eldar,et al.  MMSE whitening and subspace whitening , 2003, IEEE Transactions on Information Theory.

[6]  I. Jolliffe.  Principal Component Analysis , 2002 .

[7]  F. Li,et al.  Performance analysis for DOA estimation algorithms: unification, simplification, and observations , 1993 .

[8]  A. V. D. Veen.  Algebraic methods for deterministic blind beamforming , 1998, Proc. IEEE.

[9]  Hamid Krim,et al.  Projections on unstructured subspaces , 1996, IEEE Trans. Signal Process..

[10]  Zhengyuan Xu,et al.  Perturbation analysis for subspace decomposition with applications in subspace-based algorithms , 2002, IEEE Trans. Signal Process..

[11]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[12]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[13]  Richard J. Vaccaro,et al.  A Second-Order Perturbation Expansion for the SVD , 1994 .

[14]  G. Stewart.  Introduction to matrix computations , 1973 .

[15]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[16]  G. Stewart.  Error and Perturbation Bounds for Subspaces Associated with Certain Eigenvalue Problems , 1973 .

[17]  T. W. Anderson.  ASYMPTOTIC THEORY FOR PRINCIPAL COMPONENT ANALYSIS , 1963 .