Distributed Kalman filter via Gaussian Belief Propagation

Recent result shows how to compute distributively and efficiently the linear MMSE for the multiuser detection problem, using the Gaussian BP algorithm. In the current work, we extend this construction, and show that operating this algorithm twice on the matching inputs, has several interesting interpretations. First, we show equivalence to computing one iteration of the Kalman filter. Second, we show that the Kalman filter is a special case of the Gaussian information bottleneck algorithm, when the weight parameter beta = 1. Third, we discuss the relation to the Affine-scaling interior-point method and show it is a special case of Kalman filter. Besides of the theoretical interest of this linking estimation, compression/clustering and optimization, we allow a single distributed implementation of those algorithms, which is a highly practical and important task in sensor and mobile ad-hoc networks. Application to numerous problem domains includes collaborative signal processing and distributed allocation of resources in a communication network.

[1]  A. U.S.,et al.  Predictability , Complexity , and Learning , 2002 .

[2]  Dahlia Malkhi,et al.  A unifying framework of rating users and data items in peer-to-peer and social networks , 2008, Peer-to-Peer Netw. Appl..

[3]  Danny Dolev,et al.  Polynomial Linear Programming with Gaussian belief propagation , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[4]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[5]  X. Jin.  Factor graphs and the Sum-Product Algorithm , 2002 .

[6]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[7]  Paul H. Siegel,et al.  Gaussian belief propagation based multiuser detection , 2008, 2008 IEEE International Symposium on Information Theory.

[8]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[9]  Gal Chechik,et al.  Information Bottleneck for Gaussian Variables , 2003, J. Mach. Learn. Res..

[10]  Robert J. Vanderbei,et al.  A modification of karmarkar's linear programming algorithm , 1986, Algorithmica.

[11]  Paul H. Siegel,et al.  Gaussian belief propagation solver for systems of linear equations , 2008, 2008 IEEE International Symposium on Information Theory.

[12]  Dmitry M. Malioutov,et al.  Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation , 2005, NIPS.

[13]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[14]  R. Saigal,et al.  Solving stochastic programming problems via Kalman filter and affine scaling , 1995 .

[15]  Danny Dolev,et al.  A Gaussian Belief Propagation Solver for Large Scale Support Vector Machines , 2008, ArXiv.