Uniformly Reweighted Belief Propagation for Estimation and Detection in Wireless Networks

In this paper, we propose a new inference algorithm, suitable for distributed processing over wireless networks. The algorithm, called uniformly reweighted belief propagation (URW-BP), combines the local nature of belief propagation with the improved performance of tree-reweighted belief propagation (TRW-BP) in graphs with cycles. It reduces the degrees of freedom in the latter algorithm to a single scalar variable, the uniform edge appearance probability ρ. We provide a variational interpretation of URW-BP, give insights into good choices of ρ, develop an extension to higher-order potentials, and complement our work with numerical performance results on three inference problems in wireless communication systems: spectrum sensing in cognitive radio, cooperative positioning, and decoding of a low-density parity-check (LDPC) code.

[1]  Roberto Garello,et al.  Distributed Inference of Channel Occupation Probabilities in Cognitive Networks via Message Passing , 2010, 2010 IEEE Symposium on New Frontiers in Dynamic Spectrum (DySPAN).

[2]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[3]  Husheng Li.  Cooperative Spectrum Sensing via Belief Propagation in Spectrum-Heterogeneous Cognitive Radio Systems , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[4]  Hilbert J. Kappen,et al.  Sufficient Conditions for Convergence of the Sum–Product Algorithm , 2005, IEEE Transactions on Information Theory.

[5]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[6]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[7]  Brendan J. Frey,et al.  A comparison of algorithms for inference and learning in probabilistic graphical models , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Henk Wymeersch,et al.  Uniformly reweighted belief propagation: A factor graph approach , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[9]  Yaser Sheikh,et al.  Bayesian object detection in dynamic scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[11]  Roy D. Yates,et al.  Cooperative sensing of primary users in cognitive radio networks based on message passing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[12]  Santiago Zazo,et al.  An Experimental Study of RSS-Based Indoor Localization Using Nonparametric Belief Propagation Based on Spanning Trees , 2010, 2010 Fourth International Conference on Sensor Technologies and Applications.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  James A. Ritcey,et al.  A factor graph approach to iterative channel estimation and LDPC decoding over fading channels , 2005, IEEE Transactions on Wireless Communications.

[15]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[16]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[17]  Amir Globerson,et al.  Convergent message passing algorithms - a unifying view , 2009, UAI.

[18]  Martin J. Wainwright,et al.  MAP estimation via agreement on trees: message-passing and linear programming , 2005, IEEE Transactions on Information Theory.

[19]  Carlos Guestrin,et al.  A robust architecture for distributed inference in sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[20]  Martin J. Wainwright,et al.  A new class of upper bounds on the log partition function , 2002, IEEE Transactions on Information Theory.

[21]  Santiago Zazo,et al.  Indoor Positioning Using Nonparametric Belief Propagation Based on Spanning Trees , 2010, EURASIP J. Wirel. Commun. Netw..

[22]  John W. Fisher,et al.  Nonparametric belief propagation for self-localization of sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[23]  Hui Liu,et al.  Iterative receiver design in Rayleigh fading using factor graph , 2003, The 57th IEEE Semiannual Vehicular Technology Conference, 2003. VTC 2003-Spring..

[24]  Niclas Wiberg,et al.  Codes and Decoding on General Graphs , 1996 .

[25]  P.K. Varshney,et al.  A communication architecture for reaching consensus in decision for a large network , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[26]  Wayne E. Stark,et al.  Unified design of iterative receivers using factor graphs , 2001, IEEE Trans. Inf. Theory.

[27]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[28]  Martin J. Wainwright,et al.  Convergence Analysis of Reweighted Sum-Product Algorithms , 2007, IEEE Transactions on Signal Processing.

[29]  Henk Wymeersch,et al.  Iterative Receiver Design , 2007 .

[30]  Frank R. Kschischang,et al.  A factor graph approach to link loss monitoring in wireless sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[31]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[32]  Moe Z. Win,et al.  Cooperative Localization in Wireless Networks In harsh environments where geographic positioning fails, communication between wireless nodes can be used to improve the accuracy of location information. , 2009 .

[33]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[34]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[35]  Greg,et al.  Graphical models and message-passing algorithms for network-constrained decision problems , 2008 .

[36]  Jamie S. Evans,et al.  Distributed Downlink Beamforming With Cooperative Base Stations , 2008, IEEE Transactions on Information Theory.

[37]  Mung Chiang,et al.  Distributed network control through sum product algorithm on graphs , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[38]  Andrew W. Eckford.  Channel Estimation in Block Fading Channels Using the Factor Graph EM Algorithm , 2004 .

[39]  Moe Z. Win,et al.  Cooperative Localization in Wireless Networks , 2009, Proceedings of the IEEE.

[40]  Aleksandar Dogandzic,et al.  Distributed Estimation and Detection for Sensor Networks Using Hidden Markov Random Field Models , 2006, IEEE Transactions on Signal Processing.

[41]  Richard G. Baraniuk,et al.  The embedded triangles algorithm for distributed estimation in sensor networks , 2003, IEEE Workshop on Statistical Signal Processing, 2003.