Principal angles between subspaces and their tangents

Principal angles between subspaces (PABS) (also called canonical angles) serve as a classical tool in mathematics, statistics, and applications, e.g., data mining. Traditionally, PABS are introduced and used via their cosines. The tangents of PABS have attracted relatively less attention, but are important for analysis of convergence of subspace iterations for eigenvalue problems. We explicitly construct matrices, such that their singular values are equal to the tangents of PABS, using several approaches: orthonormal and nonorthonormal bases for subspaces, and orthogonal projectors. Cornell University Library This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. Copyright c ©Mitsubishi Electric Research Laboratories, Inc., 2012 201 Broadway, Cambridge, Massachusetts 02139

[1]  C. Paige,et al.  History and generality of the CS decomposition , 1994 .

[2]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[3]  Chandler Davis.  The rotation of eigenvectors by a perturbation , 1963 .

[4]  G. W. Stewart,et al.  Matrix algorithms , 1998 .

[5]  F. Deutsch.  The Angle Between Subspaces of a Hilbert Space , 1995 .

[6]  G. Golub,et al.  The canonical correlations of matrix pairs and their numerical computation , 1992 .

[7]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[8]  C. Jordan.  Essai sur la géométrie à $n$ dimensions , 1875 .

[9]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[10]  Andrew Knyazev,et al.  Angles between infinite dimensional subspaces with applications to the Rayleigh-Ritz and alternating projectors methods ✩ , 2007, 0705.1023.

[11]  Ilse C. F. Ipsen,et al.  The Angle Between Complementary Subspaces , 1995 .

[12]  Alan Edelman,et al.  The Beta-Jacobi Matrix Model, the CS Decomposition, and Generalized Singular Value Problems , 2008, Found. Comput. Math..

[13]  M. Saunders,et al.  Towards a Generalized Singular Value Decomposition , 1981 .

[14]  Zlatko Drmač.  On relative residual bounds for the eigenvalues of a Hermitian matrix , 1996 .

[15]  P. Halmos.  TWO SUBSPACES , 2010 .

[16]  Zlatko Drmac,et al.  Subspace Gap Residuals for Rayleigh-Ritz Approximations , 2009, SIAM J. Matrix Anal. Appl..

[17]  P. Wedin.  On angles between subspaces of a finite dimensional inner product space , 1983 .

[18]  Merico E. Argentati,et al.  Majorization for Changes in Angles Between Subspaces, Ritz Values, and Graph Laplacian Spectra , 2006, SIAM J. Matrix Anal. Appl..

[19]  Brian D. Sutton.  Computing the complete CS decomposition , 2007, Numerical Algorithms.