Convergence analysis of belief propagation for pairwise linear Gaussian models

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide geographical area. One particular case is when two neighboring agents share a common observation. For example, to estimate voltage in the direct current (DC) power flow model, the current measurement over a power line is proportional to the voltage difference between two neighboring buses. When applying the Gaussian BP algorithm to this type of problem, the convergence condition remains an open issue. In this paper, we analyze the convergence properties of Gaussian BP for this pairwise linear Gaussian model. We show analytically that the updating information matrix converges at a geometric rate to a unique positive definite matrix with arbitrary positive semidefinite initial value and further provide the necessary and sufficient convergence condition for the belief mean vector to the optimal estimate.

[1]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[2]  Yik-Chung Wu,et al.  Network-Wide Distributed Carrier Frequency Offsets Estimation and Compensation via Belief Propagation , 2013, IEEE Transactions on Signal Processing.

[3]  H. Vincent Poor,et al.  Distributed Linear Parameter Estimation: Asymptotically Efficient Adaptive Strategies , 2011, SIAM J. Control. Optim..

[4]  H. Vincent Poor,et al.  Distributed Bayesian hybrid power state estimation with PMU synchronization errors , 2014, 2014 IEEE Global Communications Conference.

[5]  Paul H. Siegel,et al.  Gaussian belief propagation solver for systems of linear equations , 2008, 2008 IEEE International Symposium on Information Theory.

[6]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[7]  Tao Yang,et al.  A Belief Propagation Based Power Distribution System State Estimator , 2011, IEEE Computational Intelligence Magazine.

[8]  Soummya Kar,et al.  Convergence Analysis of Distributed Inference with Vector-Valued Gaussian Belief Propagation , 2016, J. Mach. Learn. Res..

[9]  Soummya Kar,et al.  Distributed convergence verification for Gaussian belief propagation , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[10]  Benjamin Van Roy,et al.  Convergence of Min-Sum Message Passing for Quadratic Optimization , 2006, IEEE Transactions on Information Theory.

[11]  Yik-Chung Wu,et al.  Distributed CFOs estimation and compensation in multi-cell cooperative networks , 2013, 2013 International Conference on ICT Convergence (ICTC).

[12]  Brendan J. Frey.  Local Probability Propagation for Factor Analysis , 1999, NIPS.

[13]  Yaming Wang,et al.  Fast Distributed Rate Control Algorithm with QoS Support in Ad Hoc Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[14]  Jian Li,et al.  Computationally Efficient Sparse Bayesian Learning via Belief Propagation , 2009, IEEE Transactions on Signal Processing.

[15]  Lin Tian,et al.  Spectral - and energy-efficient two-stage cooperative multicast for LTE-advanced and beyond , 2014, IEEE Wireless Communications.

[16]  Yik-Chung Wu,et al.  On Convergence Conditions of Gaussian Belief Propagation , 2015, IEEE Transactions on Signal Processing.

[17]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[18]  Dahlia Malkhi,et al.  A unifying framework of rating users and data items in peer-to-peer and social networks , 2008, Peer Peer Netw. Appl..

[19]  Dmitry M. Malioutov,et al.  Walk-Sums and Belief Propagation in Gaussian Graphical Models , 2006, J. Mach. Learn. Res..

[20]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.

[21]  Jamie S. Evans,et al.  Distributed Downlink Beamforming With Cooperative Base Stations , 2008, IEEE Transactions on Information Theory.

[22]  Yik-Chung Wu,et al.  Distributed Clock Skew and Offset Estimation in Wireless Sensor Networks: Asynchronous Algorithm and Convergence Analysis , 2013, IEEE Transactions on Wireless Communications.

[23]  Yik-Chung Wu,et al.  Fully distributed clock skew and offset estimation in wireless sensor networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Moe Z. Win,et al.  Cooperative Localization in Wireless Networks , 2009, Proceedings of the IEEE.

[25]  Soummya Kar,et al.  Convergence analysis of the information matrix in Gaussian Belief Propagation , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Yang Weng,et al.  Graphical model for state estimation in electric power systems , 2013, 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[27]  Soummya Kar.  Large scale networked dynamical systems: Distributed inference , 2010 .

[28]  Lin Tian,et al.  Two-Stage Cooperative Multicast Transmission with Optimized Power Consumption and Guaranteed Coverage , 2014, IEEE Journal on Selected Areas in Communications.