Bunch-Kaufman Pivoting for Partially Reconstructible Cauchy-like Matrices, with Applications to Toep

In an earlier paper [GKO95] we exploited the displacement structure of Cauchy-like matrices to derive for them a fast O(n) implementation of Gaussian elimination with partial pivoting. One application is to the rapid and numerically accurate solution of linear systems with Toeplitzlike coe cient matrices, based on the fact that the latter can be transformed into Cauchy-like matrices by using the Fast Fourier, Sine or Cosine Transforms. However symmetry is lost in the process, and the algorithm of [GKO95] is not optimal for Hermitian coe cient matrices. In this paper we present a new fast O(n) implementation of symmetric Gaussian elimination with partial diagonal pivoting for Hermitian Cauchy-like matrices, and show how to transform Hermitian Toeplitz-like matrices to Hermitian Cauchy-like matrices, obtaining algorithms that are now twice as fast as those in [GKO95]. Numerical experiments indicate that in order to obtain not only fast but also numerically accurate methods, it is advantageous to explore the important case in which the corresponding displacement operators have nontrivial kernels; this situation gives rise to what we call partially reconstructible matrices, which are introduced and studied in the present paper. We extend the transformation technique and the generalized Schur algorithms ( i.e., fast displacement-based implementations of Gaussian elimination ) to partially reconstructible matrices. We show by a variety of computed examples that the incorporation of diagonal pivoting methods leads to high accuracy. We focused in this paper on the design of new numerically reliable algorithms for Hermitian Toeplitz-like matrices. However, the proposed algorithms have other important applications; in particular, we brie y describe how they recursively solve a boundary interpolation problem for J-unitary rational matrix functions.

[1]  James M. Varah,et al.  The prolate matrix , 1993 .

[2]  Ali H. Sayed,et al.  A Look-Ahead Block Schur Algorithm for Toeplitz-Like Matrices , 1995, SIAM J. Matrix Anal. Appl..

[3]  L. Rodman,et al.  Interpolation of Rational Matrix Functions , 1990 .

[4]  N. S. Barnett,et al.  Private communication , 1969 .

[5]  Adam W. Bojanczyk,et al.  On the stability of the Bareiss and related Toeplitz factorization algorithms , 2010, SIAM J. Matrix Anal. Appl..

[6]  I. Gohberg,et al.  Complexity of multiplication with vectors for structured matrices , 1994 .

[7]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[8]  T. Chan An Optimal Circulant Preconditioner for Toeplitz Systems , 1988 .

[9]  George Cybenko,et al.  The Numerical Stability of the Levinson-Durbin Algorithm for Toeplitz Systems of Equations , 1980 .

[10]  T. Kailath,et al.  Fast Parallel Algorithms for QR and Triangular Factorization , 1987 .

[11]  J. Schur,et al.  Über Potenzreihen, die im Innern des Einheitskreises beschränkt sind. , 1917 .

[12]  Thomas Kailath,et al.  Displacement structure for Hankel, Vandermonde, and related (derived) matrices , 1991 .

[13]  Israel Gohberg,et al.  Circulants, displacements and decompositions of matrices , 1992 .

[14]  V. Pan,et al.  Polynomial and Matrix Computations , 1994, Progress in Theoretical Computer Science.

[15]  J. Bunch Analysis of the Diagonal Pivoting Method , 1971 .

[16]  Georg Heinig,et al.  Inversion of generalized Cauchy matrices and other classes of structured matrices , 1995 .

[17]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[18]  Israel Gohberg,et al.  Fast state space algorithms for matrix Nehari and Nehari-Takagi interpolation problems , 1994 .

[19]  Per Christian Hansen,et al.  A Look-Ahead Levinson Algorithm for Indefinite Toeplitz Systems , 1992, SIAM J. Matrix Anal. Appl..

[20]  Adam W. Bojanczyk,et al.  A Multi-step Algorithm for Hankel Matrices , 1994, J. Complex..

[21]  Thomas Kailath,et al.  Fast Gaussian elimination with partial pivoting for matrices with displacement structure , 1995 .

[22]  M. SIAMJ. STABILITY OF THE DIAGONAL PIVOTING METHOD WITH PARTIAL PIVOTING , 1995 .

[23]  P. Dewilde,et al.  Lossless inverse scattering, digital filters, and estimation theory , 1984, IEEE Trans. Inf. Theory.

[24]  Ali H. Sayed,et al.  Displacement Structure: Theory and Applications , 1995, SIAM Rev..

[25]  J. Bunch,et al.  Some stable methods for calculating inertia and solving symmetric linear systems , 1977 .

[26]  James R. Bunch,et al.  Stability of Methods for Solving Toeplitz Systems of Equations , 1985 .

[27]  J. Bunch,et al.  Direct Methods for Solving Symmetric Indefinite Systems of Linear Equations , 1971 .

[28]  T. Kailath,et al.  Recursive solutions of rational interpolation problems via fast matrix factorization , 1994 .

[29]  V. Pan On computations with dense structured matrices , 1990 .

[30]  Georg Heinig,et al.  Algebraic Methods for Toeplitz-like Matrices and Operators , 1984 .

[31]  R. Damodar,et al.  The Gaussian Toeplitz matrix , 1992 .

[32]  Ali H. Sayed,et al.  Fast algorithms for generalized displacement structures , 1991 .