Angles between infinite dimensional subspaces with applications to the Rayleigh-Ritz and alternating projectors methods ✩

We define angles for infinite dimensional subspaces of Hilbert spaces, inspired by the work of E.J. Hannan, 1961/1962. The angles of Dixmier and Friedrichs, and the gaps are characterized. We establish connections between the angles corresponding to orthogonal complements. The sensitivity of angles with respect to subspaces is estimated. We show that the squared cosines of the angles from one subspace to another can be interpreted as Ritz values in the Rayleigh–Ritz method. The Hausdorff distance between the Ritz values, corresponding to different trial subspaces, is shown to be bounded by a constant times the gap between the subspaces. We prove a similar eigenvalue perturbation bound that involves the gap squared. An ultimate acceleration of the classical alternating projectors method is proposed. Its convergence rate is estimated in terms of the angles. We illustrate the acceleration for a domain decomposition method with a small overlap for the 1D diffusion equation.

[1]  JAN MANDELyAbstract.  ON THE SPECTRA OF SUMS OF ORTHOGONAL PROJECTIONS WITH APPLICATIONS TO PARALLEL COMPUTING , 1991 .

[2]  Merico E. Argentati,et al.  Majorization for Changes in Angles Between Subspaces, Ritz Values, and Graph Laplacian Spectra , 2006, SIAM J. Matrix Anal. Appl..

[3]  F. Deutsch.  The Angle Between Subspaces of a Hilbert Space , 1995 .

[4]  Olof B. Widlund,et al.  To overlap or not to overlap: a note on a domain decomposition method for elliptic problems , 1989 .

[5]  Andrew V. Knyazev.  Observations on degenerate saddle point problems , 2007 .

[6]  Magnus R. Hestenes,et al.  Conjugate Direction Methods in Optimization , 1980 .

[7]  A. Knyazev.  Convergence rate estimates for iterative methods for a mesh symmetrie eigenvalue problem , 1987 .

[8]  Jacques Periaux,et al.  On Domain Decomposition Methods , 1988 .

[9]  Abram Jujunashvili.  ANGLES BETWEEN INFINITE-DIMENSIONAL SUBSPACES , 2005 .

[10]  The norm of the sum of two projections , 1977 .

[11]  Tosio Kato.  Perturbation theory for linear operators , 1966 .

[12]  A. Weinstein,et al.  Methods of intermediate problems for eigenvalues: theory and ramifications , 1972 .

[13]  M. Gander,et al.  Why Restricted Additive Schwarz Converges Faster than Additive Schwarz , 2003 .

[14]  Sankatha Prasad Singh,et al.  Approximation Theory, Wavelets and Applications , 1995 .

[15]  J. Koliha,et al.  On the Norm of Idempotents in $C^*$ -Algebras , 2004 .

[16]  Spectra of the difference and product of projections , 1987 .

[17]  Merico E. Argentati,et al.  Rayleigh-Ritz Majorization Error Bounds with Applications to FEM , 2009, SIAM J. Matrix Anal. Appl..

[18]  F. Deutsch.  Best approximation in inner product spaces , 2001 .

[19]  K. Friedrichs.  On certain inequalities and characteristic value problems for analytic functions and for functions of two variables , 1937 .

[20]  A. Böttcher,et al.  A gentle guide to the basics of two projections theory , 2010 .

[21]  P. Halmos.  TWO SUBSPACES , 2010 .

[22]  H. Weinberger.  Variational Methods for Eigenvalue Approximation , 1974 .

[23]  Jinchao Xu,et al.  The method of alternating projections and the method of subspace corrections in Hilbert space , 2002 .

[24]  A. Knyazev,et al.  On proximity of Rayleigh quotients for different vectors and Ritz values generated by different trial subspaces , 2006 .

[25]  Andrea Toselli,et al.  Domain decomposition methods : algorithms and theory , 2005 .

[26]  Andrew V. Knyazev,et al.  New A Priori FEM Error Estimates for Eigenvalues , 2006, SIAM J. Numer. Anal..

[27]  E. Hannan.  The general theory of canonical correlation and its relation to functional analysis , 1961, Journal of the Australian Mathematical Society.

[28]  Merico E. Argentati,et al.  Bounds on Changes in Ritz Values for a Perturbed Invariant Subspace of a Hermitian Matrix , 2008, SIAM J. Matrix Anal. Appl..

[29]  Chandler Davis.  The rotation of eigenvectors by a perturbation , 1963 .

[30]  P. Wedin.  On angles between subspaces of a finite dimensional inner product space , 1983 .

[31]  Heinz H. Bauschke,et al.  Accelerating the convergence of the method of alternating projections , 2003 .

[32]  W. Kahan,et al.  The Rotation of Eigenvectors by a Perturbation. III , 1970 .

[33]  F. Deutsch.  Accelerating the Convergence of the Method of Alternating Projections Via a Line Search: a Brief Survey , 2001 .

[34]  Merico E. Argentati,et al.  Principal Angles between Subspaces in an A-Based Scalar Product: Algorithms and Perturbation Estimates , 2001, SIAM J. Sci. Comput..