Block matrices with L-block-banded inverse: inversion algorithms

Block-banded matrices generalize banded matrices. We study the properties of positive definite full matrices P whose inverses A are L-block-banded. We show that, for such matrices, the blocks in the L-block band of P completely determine P; namely, all blocks of P outside its L-block band are computed from the blocks in the L-block band of P. We derive fast inversion algorithms for P and its inverse A that, when compared to direct inversion, are faster by two orders of magnitude of the linear dimension of the constituent blocks. We apply these inversion algorithms to successfully develop fast approximations to Kalman-Bucy filters in applications with high dimensional states where the direct inversion of the covariance matrix is computationally unfeasible.

[1]  Beatrice Meini,et al.  Effective Methods for Solving Banded Toeplitz Systems , 1999, SIAM J. Matrix Anal. Appl..

[2]  John W. Woods,et al.  Two-dimensional discrete Markovian fields , 1972, IEEE Trans. Inf. Theory.

[3]  A. V. D. Veen,et al.  Inner-outer factorization and the inversion of locally finite systems of equations , 2000 .

[4]  D. Manolakis,et al.  Fast algorithms for block toeplitz matrices with toeplitz entries , 1984 .

[5]  W. Gragg,et al.  Superfast solution of real positive definite toeplitz systems , 1988 .

[6]  Gene H. Golub,et al.  Numerical Linear Algebra, Digital Signal Processing and Parallel Algorithms , 1991, NATO ASI Series.

[7]  José M. F. Moura,et al.  Data assimilation in large time-varying multidimensional fields , 1999, IEEE Trans. Image Process..

[8]  Nikhil Balram,et al.  Recursive structure of noncausal Gauss-Markov random fields , 1992, IEEE Trans. Inf. Theory.

[9]  Mrityunjoy Chakraborty,et al.  An efficient algorithm for solving general periodic Toeplitz systems , 1998, IEEE Trans. Signal Process..

[10]  Andrew E. Yagle,et al.  A fast algorithm for Toeplitz-block-Toeplitz linear systems , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[11]  Celestino A. Corral,et al.  Inversion of matrices with prescribed structured inverses , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  José M. F. Moura,et al.  Matrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes , 2000, IEEE Trans. Inf. Theory.

[13]  José M. F. Moura,et al.  Fast inversion of L-block banded matrices and their inverses , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  José M. F. Moura,et al.  Image codec by noncausal prediction, residual mean removal, and cascaded VQ , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[16]  L. Trefethen,et al.  Numerical linear algebra , 1997 .

[17]  T. M. Chin,et al.  Sequential filtering for multi-frame visual reconstruction , 1992, Signal Process..

[18]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[19]  Stanley J. Reeves Fast algorithm for solving block banded Toeplitz systems with banded Toeplitz blocks , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  S. Chandrasekaran,et al.  A Fast Stable Solver for Nonsymmetric Toeplitz and Quasi-Toeplitz Systems of Linear Equations , 1998 .

[21]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[22]  W. F. Tinney,et al.  On computing certain elements of the inverse of a sparse matrix , 1975, Commun. ACM.

[23]  T. Kailath,et al.  Generalized Displacement Structure for Block-Toeplitz,Toeplitz-Block, and Toeplitz-Derived Matrices , 1994 .