The convergence of inexact Chebyshev and Richardson iterative methods for solving linear systems

SummaryThe Chebyshev and second-order Richardson methods are classical iterative schemes for solving linear systems. We consider the convergence analysis of these methods when each step of the iteration is carried out inexactly. This has many applications, since a preconditioned iteration requires, at each step, the solution of a linear system which may be solved inexactly using an “inner” iteration. We derive an error bound which applies to the general nonsymmetric inexact Chebyshev iteration. We show how this simplifies slightly in the case of a symmetric or skew-symmetric iteration, and we consider both the cases of underestimating and overestimating the spectrum. We show that in the symmetric case, it is actually advantageous to underestimate the spectrum when the spectral radius and the degree of inexactness are both large. This is not true in the case of the skew-symmetric iteration. We show how similar results apply to the Richardson iteration. Finally, we describe numerical experiments which illustrate the results and suggest that the Chebyshev and Richardson methods, with reasonable parameter choices, may be more effective than the conjugate gradient method in the presence of inexactness.

[1]  G. Golub The Use of Chebyshev Matrix Polynomials in The Iterative Solution of Linear Equations Compared to The Method of Successive Overrelaxation , 1959 .

[2]  R. Varga,et al.  Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods , 1961 .

[3]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[4]  Gene H. Golub Bounds for the round-off errors in the richardson second order method , 1962 .

[5]  James E. Gunn The numerical solution of ▿·a▿u=f by a semi-explicit alternating-direction iterative technique , 1964 .

[6]  Victor Pereyra,et al.  Accelerating the Convergence of Discretization Algorithms , 1967 .

[7]  Louis A. Hageman,et al.  Iterative Solution of Large Linear Systems. , 1971 .

[8]  Nancy Nichols,et al.  On the Convergence of Two-Stage Iterative Processes for Solving Linear Equations , 1973 .

[9]  R. A. Nicolaides,et al.  On the local convergence of certain two step terative procedures , 1975 .

[10]  H. Woźniakowski,et al.  Numerical stability of the Chebyshev method for the solution of large linear systems , 1977 .

[11]  T. Manteuffel The Tchebychev iteration for nonsymmetric linear systems , 1977 .

[12]  O. Widlund A Lanczos Method for a Class of Nonsymmetric Systems of Linear Equations , 1978 .

[13]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[14]  Richard S. Varga,et al.  The analysis ofk-step iterative methods for linear systems from summability theory , 1983 .

[15]  Richard S. Varga,et al.  A study of semiiterative methods for nonsymmetric systems of linear equations , 1985 .

[16]  R. Freund,et al.  On a class of Chebyshev approximation problems which arise in connection with a conjugate gradient type method , 1986 .

[17]  Bart W. Stuck,et al.  A Computer and Communication Network Performance Analysis Primer (Prentice Hall, Englewood Cliffs, NJ, 1985; revised, 1987) , 1987, Int. CMG Conference.

[18]  A. Greenbaum Behavior of slightly perturbed Lanczos and conjugate-gradient recurrences , 1989 .