Operator Coefficient Methods for Linear Equations

New iterative methods for solving linear equations are presented that are easy to use, generalize good existing methods, and appear to be faster. The new algorithms mix two kinds of linear recurrence formulas. Older methods have either high order recurrence formulas with scalars for coefficients, as in truncated orthomin, or have 1st order recurrence formulas with matrix polynomials for coefficients, as in restarted gcr/gmres. The new methods include both: high order recurrence formulas and matrix polynomials for coefficients. These methods provide a trade-off between recurrence order and polynomial degree that can be exploited to achieve greater efficiency. Convergence results are obtained for both constant coefficient and varying coefficient methods.

[1]  S. Frankel.  Convergence rates of iterative treatments of partial differential equations , 1950 .

[2]  W. Arnoldi.  The principle of minimized iterations in the solution of the matrix eigenvalue problem , 1951 .

[3]  R. P. Eddy,et al.  On the Iterative Solution of a System of Equations , 1952 .

[4]  E. J. Craig.  The N‐Step Iteration Procedures , 1955 .

[5]  G. Golub.  The Use of Chebyshev Matrix Polynomials in The Iterative Solution of Linear Equations Compared to The Method of Successive Overrelaxation , 1959 .

[6]  E. Stiefel,et al.  Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems , 1959 .

[7]  Magnus R. Hestenes,et al.  Iterative methods for solving linear equations , 1973 .

[8]  Stanley C. Eisenstat,et al.  Solving Approximations To The Convection Diffusion Equation , 1979 .

[9]  H. Elman.  Iterative methods for large, sparse, nonsymmetric systems of linear equations , 1982 .

[10]  S. Eisenstat,et al.  Variational Iterative Methods for Nonsymmetric Systems of Linear Equations , 1983 .

[11]  T. Manteuffel,et al.  Necessary and Sufficient Conditions for the Existence of a Conjugate Gradient Method , 1984 .

[12]  H. Elman,et al.  Polynomial iteration for nonsymmetric indefinite linear systems , 1986 .

[13]  P. Brown,et al.  Matrix-free methods for stiff systems of ODE's , 1986 .

[14]  Thomas A. Manteuffel,et al.  Orthogonal error methods , 1987 .

[15]  Anthony T. Chronopoulos.  A class of parallel iterative methods implemented on multiprocessors , 1987 .

[16]  Anthony T. Chronopoulos.  s-Step Iterative Methods for (Non) Symmetric (In) Definite Linear Systems , 1989, PPSC.

[17]  Anthony T. Chronopoulos,et al.  s-step iterative methods for symmetric linear systems , 1989 .

[18]  T. Manteuffel,et al.  A taxonomy for conjugate gradient methods , 1990 .

[19]  Gene H. Golub,et al.  A generalized conjugate gradient method for non-symmetric systems of linear equations , 2007, Milestones in Matrix Computation.