Diagonal pivoting for partially reconstructible Cauchy-like Matrices

Abstract In an earlier paper we exploited the displacement structure of Cauchy-like matrices to derive for them a fast O ( n 2 ) implementation of Gaussian elimination with partial pivoting. One application is to the rapid and numerically accurate solution of linear systems with Toeplitz-like coefficient matrices, based on the fact that the latter can be transformed into Cauchy-like matrices by using the fast Fourier, sine, or cosine transform. However, symmetry is lost in the process, and the algorithm given is not optimal for Hermitian coefficient matrices. In this paper we present a new fast O ( n 2 ) implementation of symmetric Gaussian elimination with partial diagonal pivoting for Hermitian Cauchy-like matrices, and show how to transform Hermitian Toeplitz-like matrices to Hermitian Cauchy-like matrices, obtaining algorithms that are twice as fast as those in the earlier work. Numerical experiments indicate that in order to obtain not only fast but also numerically accurate methods, it is advantageous to explore the important case in which the corresponding displacement operators have nontrivial kernels; this situation gives rise to what we call partially reconstructible matrices, which are introduced and studied in the present paper. We extend the transformation technique and the generalized Schur algorithms (i.e., fast displacement-based implementations of Gaussian elimination) to partially reconstructible matrices. We show by a variety of computed examples that the incorporation of diagonal pivoting methods leads to high accuracy. We focused in this paper on the design of new numerically reliable algorithms for Hermitian Toeplitz-like matrices. However, the proposed algorithms have other important applications; in particular, we briefly describe how they recursively solve a boundary interpolation problem for J -unitary rational matrix functions.

[1]  Adam W. Bojanczyk,et al.  A Multi-step Algorithm for Hankel Matrices , 1994, J. Complex..

[2]  J. Bunch,et al.  Direct Methods for Solving Symmetric Indefinite Systems of Linear Equations , 1971 .

[3]  T. Kailath,et al.  Recursive solutions of rational interpolation problems via fast matrix factorization , 1994 .

[4]  Georg Heinig,et al.  Algebraic Methods for Toeplitz-like Matrices and Operators , 1984 .

[5]  Richard P. Brent,et al.  Error analysis of a fast partial pivoting method for structured matrices , 1995, Optics & Photonics.

[6]  Per Christian Hansen,et al.  A Look-Ahead Levinson Algorithm for Indefinite Toeplitz Systems , 1992, SIAM J. Matrix Anal. Appl..

[7]  I. Gohberg,et al.  Complexity of multiplication with vectors for structured matrices , 1994 .

[8]  T. Chan An Optimal Circulant Preconditioner for Toeplitz Systems , 1988 .

[9]  Thomas Kailath,et al.  Displacement ranks of a matrix , 1979 .

[10]  Israel Gohberg,et al.  Circulants, displacements and decompositions of matrices , 1992 .

[11]  Thomas Kailath,et al.  Displacement structure for Hankel, Vandermonde, and related (derived) matrices , 1991 .

[12]  H. Zha,et al.  A look-ahead algorithm for the solution of general Hankel systems , 1993 .

[13]  N. Higham Stability of the Diagonal Pivoting Method with Partial Pivoting , 1997, SIAM J. Matrix Anal. Appl..

[14]  James M. Varah,et al.  The prolate matrix , 1993 .

[15]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[16]  L. Rodman,et al.  Interpolation of Rational Matrix Functions , 1990 .

[17]  Israel Gohberg,et al.  Fast state space algorithms for matrix Nehari and Nehari-Takagi interpolation problems , 1994 .

[18]  Thomas Kailath,et al.  Fast Gaussian elimination with partial pivoting for matrices with displacement structure , 1995 .

[19]  J. Bunch Analysis of the Diagonal Pivoting Method , 1971 .

[20]  Ali H. Sayed,et al.  Fast algorithms for generalized displacement structures , 1991 .

[21]  Ali H. Sayed,et al.  Displacement Structure: Theory and Applications , 1995, SIAM Rev..

[22]  J. Bunch,et al.  Some stable methods for calculating inertia and solving symmetric linear systems , 1977 .

[23]  James R. Bunch,et al.  Stability of Methods for Solving Toeplitz Systems of Equations , 1985 .

[24]  Gene H. Golub,et al.  Matrix computations , 1983 .

[25]  Thomas Kailath,et al.  Linear Systems , 1980 .

[26]  V. Pan On computations with dense structured matrices , 1990 .

[27]  R. Damodar,et al.  The Gaussian Toeplitz matrix , 1992 .

[28]  Georg Heinig,et al.  Inversion of generalized Cauchy matrices and other classes of structured matrices , 1995 .

[29]  George Cybenko,et al.  The Numerical Stability of the Levinson-Durbin Algorithm for Toeplitz Systems of Equations , 1980 .

[30]  Ali H. Sayed,et al.  A Look-Ahead Block Schur Algorithm for Toeplitz-Like Matrices , 1995, SIAM J. Matrix Anal. Appl..

[31]  Ming Gu,et al.  Stable and Efficient Algorithms for Structured Systems of Linear Equations , 1998, SIAM J. Matrix Anal. Appl..

[32]  P. Dewilde,et al.  Lossless inverse scattering, digital filters, and estimation theory , 1984, IEEE Trans. Inf. Theory.

[33]  Thomas Kailath,et al.  Displacement structure approach to Chebyshev-Vandermonde and related matrices , 1995 .

[34]  T. Kailath,et al.  Fast Parallel Algorithms for QR and Triangular Factorization , 1987 .

[35]  V. Pan,et al.  Polynomial and Matrix Computations , 1994, Progress in Theoretical Computer Science.