Fields of values and iterative methods

Abstract The performance of an iterative scheme to solve x = T x + c , T ϵ C n × n , c ϵ C n , is often judged by spectral properties of T . If T is not normal, it is however well known that only conclusions about the assymptotic behavior of an iterative method can be drawn from spectral information. To anticipate the progress of the iteration after a finite number of steps, the knowledge of the eigenvalues alone is often useless. In addition, the spectrum of T may be highly sensitive to perturbations if T is not normal. An iterative method which—on the basis of some spectral information—is predicted to converge rapidly for T may well diverge if T is slightly perturbed. In practice, the convergence of the iteration x m = T x m -1 + c is therefore frequently measured by some norm [Verbar] T [Verbar], rather than by the spectral radius ϱ( T ). But apart from the fact that norms lead to error estimates which are often too pessimistic, they cannot be used to analyze more general schemes such as, e.g., the Chebyshev iterative methods. Here, we discuss another tool to analyze the behavior of an iterative method, namely the field of values W ( T ), the collection of all Rayleigh quotients of T . W ( T ) contains the eigenvalues of T , and the numerical radius μ( T ) = max z ϵ W ( T ) | z | defines a norm on C n × n . The field of values represents therefore an “intermediate concept” to judge an iterative scheme by—it is related to the spectral approach but has also certain norm properties.

[1]  R. Bellman,et al.  A Survey of Matrix Theory and Matrix Inequalities , 1965 .

[2]  Wilhelm Niethammer Relaxation bei Matrizen mit der Eigenschaft „A” , 1964 .

[3]  M. Marcus,et al.  Computer generated numerical ranges and some resulting theorems , 1987 .

[4]  C. Loan How Near is a Stable Matrix to an Unstable Matrix , 1984 .

[5]  D. Young Iterative methods for solving partial difference equations of elliptic type , 1954 .

[6]  F. Hausdorff Der Wertvorrat einer Bilinearform , 1919 .

[7]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[8]  Richard S. Varga,et al.  The analysis ofk-step iterative methods for linear systems from summability theory , 1983 .

[9]  E. Tadmor,et al.  On the Numerical Radius and Its Applications , 1982 .

[10]  J. Westlake Handbook of Numerical Matrix Inversion and Solution of Linear Equations , 1968 .

[11]  M. Marcus,et al.  A Survey of Matrix Theory and Matrix Inequalities , 1965 .

[12]  T. Manteuffel The Tchebychev iteration for nonsymmetric linear systems , 1977 .

[13]  G. Starke Fields of values and the ADI method for non-normal matrices , 1993 .

[14]  L. Trefethen Approximation theory and numerical linear algebra , 1990 .

[15]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[16]  Tosio Kato Some mapping theorems for the numerical range , 1965 .

[17]  R. Varga,et al.  Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods , 1961 .

[18]  N. Higham MATRIX NEARNESS PROBLEMS AND APPLICATIONS , 1989 .

[19]  L. Trefethen,et al.  Eigenvalues and pseudo-eigenvalues of Toeplitz matrices , 1992 .

[20]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[21]  Charles R. Johnson NUMERICAL DETERMINATION OF THE FIELD OF VALUES OF A GENERAL COMPLEX MATRIX , 1978 .

[22]  C. Pearcy An elementary proof of the power inequality for the numerical radius. , 1966 .

[23]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[24]  P. Halmos A Hilbert Space Problem Book , 1967 .

[25]  G. Golub,et al.  Toward an effective two-parameter SOR method , 1990 .

[26]  G. Golub,et al.  ITERATIVE METHODS FOR CYCLICALLY REDUCED NON-SELF-ADJOINT LINEAR SYSTEMS , 1990 .

[27]  R. Varga,et al.  Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods , 1961 .

[28]  M. N. Spijker,et al.  A generalization of the numerical range of a matrix , 1990 .

[29]  Lothar Berg Lineare Gleichungssysteme mit Bandstruktur und ihr asymptotisches Verhalten , 1986 .