The rate of convergence of GMRES on a tridiagonal Toeplitz linear system

The Generalized Minimal Residual method (GMRES) is often used to solve a nonsymmetric linear system Ax = b. But its convergence analysis is a rather difficult task in general. A commonly used approach is to diagonalize A = XΛ X−1 and then separate the study of GMRES convergence behavior into optimizing the condition number of X and a polynomial minimization problem over A’s spectrum. This artificial separation could greatly overestimate GMRES residuals and likely yields error bounds that are too far from the actual ones. On the other hand, considering the effects of both A’s spectrum and the conditioning of X at the same time poses a difficult challenge, perhaps impossible to deal with in general but only possible for certain particular linear systems. This paper will do so for a (nonsymmetric) tridiagonal Toeplitz system. Sharp error bounds on and sometimes exact expressions for residuals are obtained. These expressions and/or bounds are in terms of the three parameters that define A and Chebyshev polynomials of the first kind.

[1]  A. Wathen,et al.  Iterative Methods for Toeplitz Systems , 2005 .

[2]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[3]  Anne Greenbaum,et al.  Iterative methods for solving linear systems , 1997, Frontiers in applied mathematics.

[4]  Wei Zhang.  GMRES ON A TRIDIAGONAL TOEPLITZ LINEAR SYSTEM , 2007 .

[5]  JÖRG LIESEN,et al.  ON THE WORST-CASE CONVERGENCE OF MR AND CG FOR SYMMETRIC POSITIVE DEFINITE TRIDIAGONAL TOEPLITZ MATRICES , 2005 .

[6]  Joseph Lipka,et al.  A Table of Integrals , 2010 .

[7]  Ren-Cang Li,et al.  The rate of convergence of GMRES on a tridiagonal toeplitz linear system. II , 2009 .

[8]  P. Strevens.  Iii , 1985 .

[9]  Aaron E. Naiman,et al.  A note on conjugate gradient convergence , 1997 .

[10]  S. Eisenstat,et al.  Variational Iterative Methods for Nonsymmetric Systems of Linear Equations , 1983 .

[11]  H. Elman.  Iterative methods for large, sparse, nonsymmetric systems of linear equations , 1982 .

[12]  Ren-Cang Li,et al.  On Meinardus' examples for the conjugate gradient method , 2008, Math. Comput..

[13]  Michael Eiermann,et al.  Fields of values and iterative methods , 1993 .

[14]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[15]  LI REN-CANG,et al.  HARD CASES FOR CONJUGATE GRADIENT METHOD , 2007 .

[16]  Tobin A. Driscoll,et al.  From Potential Theory to Matrix Iterations in Six Steps , 1998, SIAM Rev..

[17]  Daniel B. Szyld,et al.  An introduction to iterative Toeplitz solvers , 2009, Math. Comput..

[18]  Oliver G. Ernst,et al.  Residual-Minimizing Krylov Subspace Methods for Stabilized Discretizations of Convection-Diffusion Equations , 2000, SIAM J. Matrix Anal. Appl..

[19]  G. Hedstrom,et al.  Numerical Solution of Partial Differential Equations , 1966 .

[20]  Ren-Cang Li,et al.  Sharpness in rates of convergence for the symmetric Lanczos method , 2010, Math. Comput..

[21]  Anne Greenbaum,et al.  Any Nonincreasing Convergence Curve is Possible for GMRES , 1996, SIAM J. Matrix Anal. Appl..

[22]  Eugene E. Tyrtyshnikov,et al.  Some Remarks on the Elman Estimate for GMRES , 2005, SIAM J. Matrix Anal. Appl..

[23]  James Demmel,et al.  Applied Numerical Linear Algebra , 1997 .

[24]  Arno B. J. Kuijlaars,et al.  Superlinear CG convergence for special right-hand sides , 2002 .

[25]  Ilse C. F. Ipsen.  Expressions and Bounds for the GMRES Residual , 2000, Bit Numerical Mathematics.

[26]  Zdenek Strakos,et al.  Convergence of GMRES for Tridiagonal Toeplitz Matrices , 2004, SIAM J. Matrix Anal. Appl..

[27]  G. A. Watson,et al.  Numerical analysis, 1991 : proceedings of the 14th Dundee Conference, June 1991 , 1992 .

[28]  Ren-Cang Li.  Convergence of CG and GMRES on a tridiagonal Toeplitz linear system , 2007 .

[29]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[30]  Dianne P. O'Leary,et al.  Complete stagnation of gmres , 2003 .

[31]  Zdenek Strakos,et al.  GMRES Convergence Analysis for a Convection-Diffusion Model Problem , 2005, SIAM J. Sci. Comput..

[32]  Jörg Liesen,et al.  The Worst-Case GMRES for Normal Matrices , 2004 .

[33]  M. Eiermann,et al.  Geometric aspects of the theory of Krylov subspace methods , 2001, Acta Numerica.

[34]  Shlomo Engelberg,et al.  A note on conjugate gradient convergence – Part II , 2000, Numerische Mathematik.

[35]  C. F. IPSEN,et al.  EXPRESSIONS AND BOUNDS FOR THE GMRES RESIDUALILSE , 1999 .

[36]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[37]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[38]  Ren-Cang Li.  05-01 Sharpness in Rates of Convergence For CG and Symmetric Lanczos Methods , 2005 .

[39]  J. Liesen,et al.  Least Squares Residuals and Minimal Residual Methods , 2001, SIAM J. Sci. Comput..