Sparse Bayesian consensus-based distributed field estimation

We present a fully decentralized algorithm that is inspired by sparse Bayesian learning (SBL) and can be used for non-parametric sparse estimation of unknown spatial functions - spatial fields - with wireless sensor networks (WSNs). It is assumed that a spatial field is represented as a linear combination of weighted fixed basis functions. By exploiting the similarity between the topology of a WSN and the proposed probabilistic graphical model for distributed SBL, a combination of variational inference and loopy belief propagation (LBP) is used to obtain the weights and the sparse subset of relevant basis functions. The algorithm requires only transmission between neighboring sensors and no multi-hop communication is needed. Furthermore, it does not rely on a fixed network structure and no information about the total number of sensors in the network is necessary. Due to consensus in the weight parameters between neighboring sensors, it is demonstrated that also the sparsity patterns of relevant basis functions generally agree. The effectiveness of the proposed algorithm is demonstrated with synthetic data.

[1]  Bin Liu.  Channel aware distributed detection in wireless sensor networks , 2006 .

[2]  Gerald Matz,et al.  Broadcast-based dynamic consensus propagation in wireless sensor networks , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[3]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[4]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[5]  Ananthram Swami,et al.  Wireless Sensor Networks: Signal Processing and Communications , 2007 .

[6]  X. Jin.  Factor graphs and the Sum-Product Algorithm , 2002 .

[7]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[8]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[9]  Benjamin Van Roy,et al.  Consensus Propagation , 2005, IEEE Transactions on Information Theory.

[10]  D.G. Tzikas,et al.  The variational approximation for Bayesian inference , 2008, IEEE Signal Processing Magazine.

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[12]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[13]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[14]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[15]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[16]  Dmitry M. Malioutov,et al.  Walk-Sums and Belief Propagation in Gaussian Graphical Models , 2006, J. Mach. Learn. Res..

[17]  Qing Zhao,et al.  Distributed Learning in Wireless Sensor Networks , 2007 .

[18]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[19]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[20]  Christopher M. Bishop,et al.  Variational Relevance Vector Machines , 2000, UAI.

[21]  Hichem Snoussi,et al.  Distributed Regression in Sensor Networks with a Reduced-Order Kernel Model , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.