Asymptotically fast solution of Toeplitz-like singular linear systems

The Toeplitz-likeness of a matrix (Kailath et al. 1979) is the generalization of the notion that a matrix is Toeplitz. Block matrices with Toeplitz blocks, such as the Sylvester matrix corresponding to the resultant of two univariate polynomials, are Toeplitz-like, as are products and inverses of Toeplitz-like matrices. The displacement rank of a matrix is a measure for the degree of being Toeplitz-like. For example, an r × s block matrix with Toeplitz blocks has displacement rank r+s whereas a generic N × N matrix has displacement rank N . A matrix of displacement rank α can be implicitly represented by a sum of α matrices, each of which is the product of a lower triangular and an upper triangular Toeplitz matrices. Such a ΣLU representation can usually be obtained efficiently. We consider the problem of computing a solution to a possibly singular linear system Ax = b with coefficients in an arbitrary field, where A is an N ×N matrix of displacement rank α given in ΣLU representation. By use of randomization we show that if the system is solvable we can find a vector that is uniformly sampled from the solution manifold in O(αN(log N) loglog N) expected arithmetic operations in the field of entries. In case no solution exists, this fact is discovered by our algorithm. In asymptotically the same time we can also compute the rank of A and the determinant of a non-singular A. Toeplitz and Toeplitz-like matrices and the corresponding linear systems are ubiquitous in control theory, of course, but also in symbolic computation. Examples

[1]  Volker Strassen,et al.  The computational complexity of continued fractions , 1981, SYMSAC '81.

[2]  Michael Kalkbrener,et al.  Low Degree Solutions to Linear Equations with K[x] Coefficients , 1993, J. Symb. Comput..

[3]  Erich Kaltofen,et al.  On Wiedemann's Method of Solving Sparse Linear Systems , 1991, AAECC.

[4]  Richard J. Lipton,et al.  A Probabilistic Remark on Algebraic Program Testing , 1978, Inf. Process. Lett..

[5]  B. Anderson,et al.  Asymptotically fast solution of toeplitz and related systems of linear equations , 1980 .

[6]  Hoon Hong,et al.  Quantifier Elimination for Formulas Constrained by Quadratic Equations via Slope Resultants , 1993, Comput. J..

[7]  Wolfgang Fichtner,et al.  Efficient Hybrid Solution of Sparse Linear Systems , 1995 .

[8]  Philippe Delsarte,et al.  A generalization of the Levinson algorithm for Hermitian Toeplitz matrices with any rank profile , 1985, IEEE Trans. Acoust. Speech Signal Process..

[9]  Thomas Kailath,et al.  Efficient solution of linear systems of equations with recursive structure , 1986 .

[10]  Richard Zippel,et al.  Probabilistic algorithms for sparse polynomials , 1979, EUROSAM.

[11]  R. E. Cunningham,et al.  Analysis of Applications , 1980 .

[12]  W. F. Trench An Algorithm for the Inversion of Finite Toeplitz Matrices , 1964 .

[13]  Jacob T. Schwartz,et al.  Fast Probabilistic Algorithms for Verification of Polynomial Identities , 1980, J. ACM.

[14]  Erich Kaltofen,et al.  Analysis of Coppersmith's Block Wiedemann Algorithm for the Parallel Solution of Sparse Linear Systems , 1993, AAECC.

[15]  D. Coppersmith Solving homogeneous linear equations over GF (2) via block Wiedemann algorithm , 1994 .

[16]  Erich Kaltofen,et al.  Process Scheduling in DSC and the Large Sparse Linear Systems Challenge , 1995, J. Symb. Comput..

[17]  Robert T. Moenck,et al.  Fast computation of GCDs , 1973, STOC.

[18]  V. Pan PARAMETRIZATION OF NEWTON'S ITERATION FOR COMPUTATIONS WITH STRUCTURED MATRICES AND APPLICATIONS , 1992 .

[19]  Martin Morf,et al.  Doubling algorithms for Toeplitz and related equations , 1980, ICASSP.

[20]  John F. Canny,et al.  An Efficient Algorithm for the Sparse Mixed Resultant , 1993, AAECC.

[21]  Tateaki Sasaki,et al.  Secondary Polynomial Remainder Sequence and an Extension of Subresultant Theory , 1984 .

[22]  David Y. Y. Yun,et al.  Fast Solution of Toeplitz Systems of Equations and Computation of Padé Approximants , 1980, J. Algorithms.

[23]  Erich Kaltofen Direct proof of a theorem by Kalkbrener, Sweedler, and Taylor , 1993, SIGS.

[24]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .