Distributed iterate-collapse inversion (DICI) algorithm for L-banded matrices

In this paper, we present a distributed algorithm to invert L-banded matrices that are symmetric positive definite (SPD), when the sub-matrices in the band are distributed among several processing nodes. We provide a distributed iterate-collapse inversion (DICI) algorithm that converges, at each node, to the corresponding submatrices in the inverse of the L-banded matrix. The computational complexity of the DICI algorithm to invert an SPD L-banded n x n matrix can be shown at each node to be independent of the size, n, of the matrix. Local information exchange is carried out after each iteration to guarantee convergence. We apply this algorithm to invert the information matrices in a computationally efficient distributed implementation of the Kalman filter and show its application towards inverting arbitrary sparse SPD matrices.

[1]  N. Balram,et al.  Noncausal Gauss Markov random fields: Parameter structure and estimation , 1993, IEEE Trans. Inf. Theory.

[2]  E. Cuthill,et al.  Reducing the bandwidth of sparse symmetric matrices , 1969, ACM '69.

[3]  Richard G. Baraniuk,et al.  Robust Distributed Estimation Using the Embedded Subgraphs Algorithm , 2006, IEEE Transactions on Signal Processing.

[4]  J. Moura,et al.  Model Distribution for Distributed Kalman Filters: A Graph Theoretic Approach , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[5]  José M. F. Moura,et al.  Distributing the Kalman Filter for Large-Scale Systems , 2007, IEEE Transactions on Signal Processing.

[6]  José M. F. Moura,et al.  Matrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes , 2000, IEEE Trans. Inf. Theory.

[7]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[8]  José M. F. Moura,et al.  Block matrices with L-block-banded inverse: inversion algorithms , 2005, IEEE Transactions on Signal Processing.

[9]  José M. F. Moura,et al.  Inversion of Block Matrices with L-Block Banded Inverse , 2002 .