Fast Gaussian elimination with partial pivoting for matrices with displacement structure

Fast O(n 2 ) implementation of Gaussian elimination with partial pivoting is designed for matrices possessing Cauchy-like displacement structure. We show how Toeplitz-like, Toeplitz-plus-Hankel-like and Vandermonde-like matrices can be transformed into Cauchy-like matrices by using Discrete Fourier, Cosine or Sine Transform matrices. In particular this allows us to propose a new fast O(n 2 ) Toeplitz solver GKO, which incorporates partial pivoting. A large set of numerical examples showed that GKO demonstrated stable numerical behavior and can be recommended for solving linear systems, especially with nonsymmetric, indefinite and ill-conditioned positive definite Toeplitz matrices. It is also useful for block Toeplitz and mosaic Toeplitz ( Toeplitz-block ) matrices. The algorithms proposed in this paper suggest an attractive alternative to look-ahead approaches, where one has to jump over ill-conditioned leading submatrices, which in the worst case requires O(n 3 ) operations.

[1]  Thomas Kailath,et al.  Displacement-structure approach to polynomial Vandermonde and related matrices , 1997 .

[2]  Adam W. Bojanczyk,et al.  On the stability of the Bareiss and related Toeplitz factorization algorithms , 2010, SIAM J. Matrix Anal. Appl..

[3]  Ali H. Sayed,et al.  Displacement Structure: Theory and Applications , 1995, SIAM Rev..

[4]  Thomas Kailath,et al.  Displacement structure approach to Chebyshev-Vandermonde and related matrices , 1995 .

[5]  Georg Heinig,et al.  Inversion of generalized Cauchy matrices and other classes of structured matrices , 1995 .

[6]  Enrico Bozzo,et al.  On the Use of Certain Matrix Algebras Associated with Discrete Trigonometric Transforms in Matrix Displacement Decomposition , 1995, SIAM J. Matrix Anal. Appl..

[7]  I. Koltracht,et al.  Condition and accuracy of algorithms for computing Schur coefficients of Toeplitz matrices , 1994 .

[8]  I. Gohberg,et al.  Complexity of multiplication with vectors for structured matrices , 1994 .

[9]  Israel Gohberg,et al.  Fast state space algorithms for matrix Nehari and Nehari-Takagi interpolation problems , 1994 .

[10]  T. Kailath,et al.  Generalized Displacement Structure for Block-Toeplitz,Toeplitz-Block, and Toeplitz-Derived Matrices , 1994 .

[11]  T. Kailath,et al.  Fast triangular factorization of the sum of quasi-Toeplitz and quasi-Hankel matrices , 1993 .

[12]  James M. Varah,et al.  The prolate matrix , 1993 .

[13]  Israel Gohberg,et al.  Circulants, displacements and decompositions of matrices , 1992 .

[14]  R. Damodar,et al.  The Gaussian Toeplitz matrix , 1992 .

[15]  Israel Gohberg,et al.  Solution of the Yule-Walker equations , 1991, Optics & Photonics.

[16]  Thomas Kailath,et al.  Displacement structure for Hankel, Vandermonde, and related (derived) matrices , 1991 .

[17]  Ali H. Sayed,et al.  Fast algorithms for generalized displacement structures , 1991 .

[18]  V. Pan On computations with dense structured matrices , 1990 .

[19]  L. Rodman,et al.  Interpolation of Rational Matrix Functions , 1990 .

[20]  ByoungSeon Choi A Decomposition of the Inverse of a Toeplitz Matrix , 1989 .

[21]  I. Koltracht,et al.  Efficient algorithm for Toeplitz plus Hankel matrices , 1989 .

[22]  Georg Heinig,et al.  Fast inversion algorithms of Toeplitz-plus-Hankel matrices , 1988 .

[23]  Thomas Kailath Signal-processing applications of some moment problems , 1987 .

[24]  T. Kailath,et al.  Triangular Factorization of Structured Hermitian Matrices , 1986 .

[25]  P. Lancaster,et al.  The theory of matrices : with applications , 1985 .

[26]  Georg Heinig,et al.  Algebraic Methods for Toeplitz-like Matrices and Operators , 1984 .

[27]  G. Golub Matrix computations , 1983 .

[28]  George Cybenko,et al.  The Numerical Stability of the Levinson-Durbin Algorithm for Toeplitz Systems of Equations , 1980 .

[29]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[30]  J. Schur,et al.  Über Potenzreihen, die im Innern des Einheitskreises beschränkt sind. , 1917 .