Superfast algorithms for Cauchy-like matrix computations and extensions

Abstract An effective algorithm of [M. Morf, Ph.D. Thesis, Department of Electrical Engineering, Stanford University, Stanford, CA, 1974; in: Proceedings of the IEEE International Conference on ASSP, IEEE Computer Society Press, Silver Spring, MD, 1980, pp. 954–959; R.R. Bitmead and B.D.O. Anderson, Linear Algebra Appl. 34 (1980) 103–116] computes the solution x → =T −1 b → to a strongly nonsingular Toeplitz or Toeplitz-like linear system T x → = b → , a short displacement generator for the inverse T −1 of T , and det T . We extend this algorithm to the similar computations with n×n Cauchy and Cauchy-like matrices. Recursive triangular factorization of such a matrix can be computed by our algorithm at the cost of executing O (nr 2 log 3 n) arithmetic operations, where r is the scaling rank of the input Cauchy-like matrix C (r=1 if C is a Cauchy matrix). Consequently, the same cost bound applies to the computation of the determinant of C , a short scaling generator of C −1 , and the solution to a nonsingular linear system of n equations with such a matrix C . (Our algorithm does not use the reduction to Toeplitz-like computations.) We also relax the assumptions of strong nonsingularity and even nonsingularity of the input not only for the computations in the field of complex or real numbers, but even, where the algorithm runs in an arbitrary field. We achieve this by using randomization, and we also show a certain improvement of the respective algorithm by Kaltofen for Toeplitz-like computations in an arbitrary field. Our subject has close correlation to rational tangential (matrix) interpolation under passivity condition (e.g., to Nevanlinna–Pick tangential interpolation problems) and has further impact on the decoding of algebraic codes.

[1]  V. Strassen Gaussian elimination is not optimal , 1969 .

[2]  Victor Y. Pan,et al.  New transformations of Cauchy matrices and Trummer's problem , 1998 .

[3]  Walter Gautschi,et al.  Norm estimates for inverses of Vandermonde matrices , 1974 .

[4]  I. Gohberg,et al.  Complexity of multiplication with vectors for structured matrices , 1994 .

[5]  Georg Heinig,et al.  An inversion formula and fast algorithms for Cauchy-Vandermonde matrices , 1993 .

[6]  V. Rokhlin Rapid solution of integral equations of classical potential theory , 1985 .

[7]  Hao Lu Solution of Vandermonde-Like Systems and Confluent Vandermonde-Like Systems , 1996, SIAM J. Matrix Anal. Appl..

[8]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[9]  Leslie Greengard,et al.  A fast algorithm for particle simulations , 1987 .

[10]  Victor Y. Pan,et al.  Nearly optimal computations with structured matrices , 2014, Theor. Comput. Sci..

[11]  E. Kaltofen Analysis of Coppersmith's block Wiedemann algorithm for the parallel solution of sparse linear systems , 1995 .

[12]  Israel Gohberg,et al.  Fast state space algorithms for matrix Nehari and Nehari-Takagi interpolation problems , 1994 .

[13]  Thomas Kailath,et al.  Linear complexity parallel algorithms for linear systems of equations with recursive structure , 1987 .

[14]  Hao Lu Fast Algorithms for Confluent Vandermonde Linear Systems and Generalized Trummer's Problem , 1995, SIAM J. Matrix Anal. Appl..

[15]  Thomas Kailath,et al.  Fast Gaussian elimination with partial pivoting for matrices with displacement structure , 1995 .

[16]  Victor Y. Pan,et al.  A unified superfast algorithm for boundary rational tangential interpolation problems and for inversion and factorization of dense structured matrices , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[17]  Erich Kaltofen Asymptotically fast solution of Toeplitz-like singular linear systems , 1994, ISSAC '94.

[18]  Nicholas J. Higham,et al.  Fast Solution of Vandermonde-Like Systems Involving Orthogonal Polynomials , 1988 .

[19]  V. Pan,et al.  Polynomial and matrix computations (vol. 1): fundamental algorithms , 1994 .

[20]  Hao Lu Fast Solution of Confluent Vandermonde Linear Systems , 1994 .

[21]  Lothar Reichel,et al.  A Matrix Problem with Application to Rapid Solution of Integral Equations , 1990, SIAM Journal on Scientific Computing.

[22]  Martin Morf,et al.  Doubling algorithms for Toeplitz and related equations , 1980, ICASSP.

[23]  Jacob T. Schwartz,et al.  Fast Probabilistic Algorithms for Verification of Polynomial Identities , 1980, J. ACM.

[24]  Victor Y. Pan,et al.  Fundamental Computations with Polynomials , 1994 .

[25]  A. Gerasoulis A fast algorithm for the multiplication of generalized Hilbert matrices with vectors , 1988 .

[26]  V. Pan On computations with dense structured matrices , 1990 .

[27]  Georg Heinig,et al.  Algebraic Methods for Toeplitz-like Matrices and Operators , 1984 .

[28]  Erich Kaltofen,et al.  On Wiedemann's Method of Solving Sparse Linear Systems , 1991, AAECC.

[29]  Amin Shokrollahi,et al.  A displacement approach to efficient decoding of algebraic-geometric codes , 1999, STOC '99.

[30]  Richard J. Lipton,et al.  A Probabilistic Remark on Algebraic Program Testing , 1978, Inf. Process. Lett..

[31]  Victor Y. Pan Decreasing the displacement rank of a matrix , 1993 .

[32]  Å. Björck,et al.  Solution of Vandermonde Systems of Equations , 1970 .

[33]  W. Donoghue Monotone Matrix Functions and Analytic Continuation , 1974 .

[34]  Israel Gohberg,et al.  Fast Algorithms with Preprocessing for Matrix-Vector Multiplication Problems , 1994, J. Complex..

[35]  Victor Y. Pan,et al.  Superfast Computations with Singular Structured Matrices over Abstract Fields , 1999, CASC.

[36]  Victor Y. Pan,et al.  Transformations of Cauchy Matrices, Trummer's Problem and a Cauchy-Like Linear Solver , 1998, IRREGULAR.

[37]  B. Anderson,et al.  Asymptotically fast solution of toeplitz and related systems of linear equations , 1980 .

[38]  Manfred R. Trummer,et al.  An efficient implementation of a conformal mapping method based on the Szego¨ kernel , 1986 .

[39]  Thomas Kailath,et al.  Efficient solution of linear systems of equations with recursive structure , 1986 .

[40]  Nicholas J. Higham,et al.  Stability analysis of algorithms for solving confluent Vandermonde-like systems , 1990 .

[41]  Victor Y. Pan,et al.  Multivariate Polynomials, Duality, and Structured Matrices , 2000, J. Complex..

[42]  M. Morf Fast Algorithms for Multivariable Systems , 1974 .

[43]  Victor Y. Pan,et al.  Polynomial and Rational Evaluation and Interpolation (with Structured Matrices) , 1999, ICALP.