Distributed convergence verification for Gaussian belief propagation

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks. However, the convergence of Gaussian BP is still an open issue. Though sufficient convergence conditions have been studied in the literature, verifying these conditions requires gathering all the information over the whole network, which defeats the main advantage of distributed computing by using Gaussian BP. In this paper, we propose a novel sufficient convergence condition for Gaussian BP that applies to both the pairwise linear Gaussian model and to Gaussian Markov random fields. We show analytically that this sufficient convergence condition can be easily verified in a distributed way that satisfies the network topology constraint.

[1]  Tao Yang,et al.  A Belief Propagation Based Power Distribution System State Estimator , 2011, IEEE Computational Intelligence Magazine.

[2]  H. Vincent Poor,et al.  Distributed Hybrid Power State Estimation Under PMU Sampling Phase Errors , 2014, IEEE Transactions on Signal Processing.

[3]  Soummya Kar,et al.  Convergence Analysis of Distributed Inference with Vector-Valued Gaussian Belief Propagation , 2016, J. Mach. Learn. Res..

[4]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[5]  Jian Li,et al.  Computationally efficient sparse bayesian learning via belief propagation , 2009 .

[6]  Dahlia Malkhi,et al.  A unifying framework of rating users and data items in peer-to-peer and social networks , 2008, Peer Peer Netw. Appl..

[7]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[8]  Yik-Chung Wu,et al.  Network-Wide Distributed Carrier Frequency Offsets Estimation and Compensation via Belief Propagation , 2013, IEEE Transactions on Signal Processing.

[9]  Yik-Chung Wu,et al.  Distributed Clock Skew and Offset Estimation in Wireless Sensor Networks: Asynchronous Algorithm and Convergence Analysis , 2013, IEEE Transactions on Wireless Communications.

[10]  Soummya Kar,et al.  Convergence analysis of belief propagation for pairwise linear Gaussian models , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[11]  Dmitry M. Malioutov,et al.  Walk-Sums and Belief Propagation in Gaussian Graphical Models , 2006, J. Mach. Learn. Res..

[12]  Jamie S. Evans,et al.  Distributed Downlink Beamforming With Cooperative Base Stations , 2008, IEEE Transactions on Information Theory.

[13]  Michael J. Black,et al.  Efficient Belief Propagation with Learned Higher-Order Markov Random Fields , 2006, ECCV.

[14]  Xue Liu,et al.  Proactive Doppler Shift Compensation in Vehicular Cyber-Physical Systems , 2018, IEEE/ACM Transactions on Networking.

[15]  B. Sundar Rajan,et al.  Low-Complexity Detection in Large-Dimension MIMO-ISI Channels Using Graphical Models , 2011, IEEE Journal of Selected Topics in Signal Processing.

[16]  Yik-Chung Wu,et al.  Fully distributed clock skew and offset estimation in wireless sensor networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Soummya Kar,et al.  Convergence analysis of the information matrix in Gaussian Belief Propagation , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Frédéric Lehmann,et al.  Iterative Mitigation of Intercell Interference in Cellular Networks Based on Gaussian Belief Propagation , 2012, IEEE Transactions on Vehicular Technology.

[19]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[20]  Yaming Wang,et al.  Fast Distributed Rate Control Algorithm with QoS Support in Ad Hoc Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[21]  Benjamin Van Roy,et al.  Convergence of Min-Sum Message Passing for , 2009 .

[22]  Paul H. Siegel,et al.  Gaussian belief propagation solver for systems of linear equations , 2008, 2008 IEEE International Symposium on Information Theory.

[23]  Brendan J. Frey Local Probability Propagation for Factor Analysis , 1999, NIPS.