Energy-Efficient and Robust In-Network Inference in Wireless Sensor Networks

Distributed in-network inference plays a significant role in large-scale wireless sensor networks (WSNs) in various applications for distributed detection and estimation. While belief propagation (BP) holds great potential for forming a powerful underlying mechanism for such distributed in-network inferences in WSNs, one major challenge is how to systematically improve the energy efficiency of BP-based in-network inference in WSNs. In this paper, we first propose a systematic and rigorous data-driven approach to building information models for WSN applications upon which BP-based in-network inference can be effectively and efficiently performed. We then present a wavelet-based BP framework for multiresolution inference, with respect to our WSN information modeling, to further reduce WSNs' energy. We empirically evaluate our proposed WSN information modeling and wavelet-based BP framework/multiresolution inference using real-world sensor network data. The results demonstrate the merits of our proposed approaches.

[1]  José M. F. Moura,et al.  Intelligent sensor fusion: a graphical model approach , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  Michael I. Jordan.  Learning in Graphical Models , 1999, NATO ASI Series.

[3]  Panganamala Ramana Kumar,et al.  The Number of Neighbors Needed for Connectivity of Wireless Networks , 2004, Wirel. Networks.

[4]  Jay Magidson,et al.  Analyzing qualitative/categorical data: Log-linear models and latent-structure analysis , 1978 .

[5]  Wei Zhao,et al.  Inference in wireless sensor networks based on information structure optimization , 2012, 37th Annual IEEE Conference on Local Computer Networks.

[6]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[7]  A.S. Willsky,et al.  Nonparametric belief propagation for self-calibration in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[8]  Martin J. Wainwright,et al.  Tree-based reparameterization framework for analysis of sum-product and related algorithms , 2003, IEEE Trans. Inf. Theory.

[9]  Hans-Peter Seidel,et al.  Wavelet belief propagation for large scale inference problems , 2011, CVPR 2011.

[10]  A.S. Willsky,et al.  Distributed fusion in sensor networks , 2006, IEEE Signal Processing Magazine.

[11]  Fuan Tsai,et al.  A Reduced-Complexity Data-Fusion Algorithm Using Belief Propagation for Location Tracking in Heterogeneous Observations , 2014, IEEE Transactions on Cybernetics.

[12]  Mathew D. Penrose,et al.  Random Geometric Graphs , 2003 .

[13]  Alessandro Saffiotti,et al.  Multirobot Object Localization: A Fuzzy Fusion Approach , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Fakhri Karray,et al.  Distributed Soft-Data-Constrained Multi-Model Particle Filter , 2015, IEEE Transactions on Cybernetics.

[15]  Edward H. Adelson,et al.  Belief Propagation and Revision in Networks with Loops , 1997 .

[16]  Danny Dolev,et al.  Modified Belief Propagation Algorithm for Energy Saving in Wireless and Sensor Networks , 2005 .

[17]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[18]  Ronald Christensen,et al.  Log-Linear Models and Logistic Regression , 1997 .

[19]  Martin J. Wainwright,et al.  Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$ -Constrained Quadratic Programming (Lasso) , 2009, IEEE Transactions on Information Theory.

[20]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Wei Zhao,et al.  W-LBP: Wavelet-Based Loopy Belief Propagation for Wireless Sensor Networks , 2009, 2009 Third International Conference on Sensor Technologies and Applications.

[22]  Aleksandar Dogandzic,et al.  Distributed Estimation and Detection for Sensor Networks Using Hidden Markov Random Field Models , 2006, IEEE Transactions on Signal Processing.

[23]  Carlos Guestrin,et al.  Robust Probabilistic Inference in Distributed Systems , 2004, UAI.

[24]  Ananthram Swami,et al.  Energy scaling laws for distributed inference in random fusion networks , 2008, IEEE Journal on Selected Areas in Communications.

[25]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[26]  Jung-Fu Cheng,et al.  Turbo Decoding as an Instance of Pearl's "Belief Propagation" Algorithm , 1998, IEEE J. Sel. Areas Commun..

[27]  Mark W. Schmidt,et al.  Structure learning in random fields for heart motion abnormality detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Danny Dolev,et al.  Belief Propagation in Wireless Sensor Networks - A Practical Approach , 2008, WASA.

[29]  B. Bollobás,et al.  Connectivity of random k-nearest-neighbour graphs , 2005, Advances in Applied Probability.

[30]  Lutz H.-J. Lampe,et al.  Energy Efficient Distributed Filtering With Wireless Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[31]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[32]  Urbashi Mitra,et al.  Estimating inhomogeneous fields using wireless sensor networks , 2004, IEEE Journal on Selected Areas in Communications.

[33]  John W. Fisher,et al.  Nonparametric belief propagation for self-localization of sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[34]  Wei Hong,et al.  A macroscope in the redwoods , 2005, SenSys '05.

[35]  Alexandros G. Dimakis,et al.  Robust Message-Passing for Statistical Inference in Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[36]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[37]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[38]  Yang Zhou,et al.  Structure Learning of Probabilistic Graphical Models: A Comprehensive Survey , 2011, ArXiv.

[39]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Martin J. Wainwright,et al.  Multitarget-multisensor data association using the tree-reweighted max-product algorithm , 2003, SPIE Defense + Commercial Sensing.

[41]  Martin J. Wainwright,et al.  Data association based on optimization in graphical models with application to sensor networks , 2006, Math. Comput. Model..

[42]  Nanning Zheng,et al.  Tracking Multiple Visual Targets via Particle-Based Belief Propagation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).