Finding Decomposable Models for Efficient Distributed Inference over Sensor Networks

Graphical models have been widely applied in distributed network computation problems such as inference in large-scale sensor networks. While belief propagation (BP) based on message passing is a powerful approach to solving such distributed inference problems, one major challenge, in the context of wireless sensor networks, is how to systematically address the trade-off between energy efficiency and inference performance. In this paper, we consider a distributed structure optimization problem and investigate the impacts of graphical model structure on energy consumption and inference performance. We first formulate the problem as a multi-objective constrained combinatorial optimization problem and prove its NP-hardness. Then, we propose an efficient distributed heuristic to solve the problem in polynomial time. Through extensive simulations, using both real-world sensor network data and synthetic data, we empirically evaluate our proposed graphical model structure optimization framework. The simulation results demonstrate that the graphical model constructed by the proposed framework can efficiently trades off the performance of the inference algorithm (measured by the mean squared error) with the energy consumed by the inference algorithm (measured by the energy used in communication). In addition, our proposed framework provides valuable insights for network designers on designing efficient model selection algorithms for distributed inference problems.

[1]  Alexandros G. Dimakis,et al.  Robust Message-Passing for Statistical Inference in Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[2]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[3]  Alan S. Willsky,et al.  An Efficient Message-Passing Algorithm for Optimizing Decentralized Detection Networks , 2010, IEEE Transactions on Automatic Control.

[4]  William Stafford Noble,et al.  Faster Mass Spectrometry-Based Protein Inference: Junction Trees Are More Efficient than Sampling and Marginalization by Enumeration , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[5]  Carlos Guestrin,et al.  A robust architecture for distributed inference in sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[6]  Jiming Chen,et al.  Cross-Layer Optimization of Correlated Data Gathering in Wireless Sensor Networks , 2010, 2010 7th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON).

[7]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[8]  Wei Dong,et al.  Exploiting link correlation for core-based dissemination in wireless sensor networks , 2014, 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[9]  Tommi S. Jaakkola,et al.  Tutorial on variational approximation methods , 2000 .

[10]  David J. Spiegelhalter,et al.  Probabilistic Networks and Expert Systems , 1999, Information Science and Statistics.

[11]  Mehul Motani,et al.  Optimizing Graphical Model Structure for Distributed Inference in Wireless Sensor Networks , 2016, 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[12]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[13]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[14]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[15]  Jonathan P. How,et al.  Efficient distributed sensing using adaptive censoring based inference , 2013, 2013 American Control Conference.

[16]  Martin J. Wainwright,et al.  A new class of upper bounds on the log partition function , 2002, IEEE Transactions on Information Theory.

[17]  Francesco M. Malvestuto,et al.  Approximating discrete probability distributions with decomposable models , 1991, IEEE Trans. Syst. Man Cybern..

[18]  Chunguang Li,et al.  Distributed Variational Bayesian Algorithms Over Sensor Networks , 2016, IEEE Transactions on Signal Processing.

[19]  Tamás Szántai,et al.  Discovering a junction tree behind a Markov network by a greedy algorithm , 2011, ArXiv.

[20]  Shudong Jin,et al.  Prediction or Not? An Energy-Efficient Framework for Clustering-Based Data Collection in Wireless Sensor Networks , 2011, IEEE Transactions on Parallel and Distributed Systems.

[21]  Dafna Shahaf,et al.  Learning Thin Junction Trees via Graph Cuts , 2009, AISTATS.

[22]  Ryu Miura,et al.  Toward Energy Efficient Big Data Gathering in Densely Distributed Sensor Networks , 2014, IEEE Transactions on Emerging Topics in Computing.

[23]  Anantha P. Chandrakasan,et al.  An application-specific protocol architecture for wireless microsensor networks , 2002, IEEE Trans. Wirel. Commun..

[24]  Cheng Li,et al.  Distributed Data Aggregation Using Slepian–Wolf Coding in Cluster-Based Wireless Sensor Networks , 2010, IEEE Transactions on Vehicular Technology.

[25]  Bala Shetty,et al.  The nonlinear knapsack problem - algorithms and applications , 2002, Eur. J. Oper. Res..

[26]  Erik G. Larsson,et al.  Target Tracking in Confined Environments With Uncertain Sensor Positions , 2015, IEEE Transactions on Vehicular Technology.

[27]  Michael I. Jordan,et al.  Probabilistic Networks and Expert Systems , 1999 .

[28]  Junshan Zhang,et al.  Modeling social network relationships via t-cherry junction trees , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[29]  R. Marler,et al.  The weighted sum method for multi-objective optimization: new insights , 2010 .

[30]  Philip S. Yu,et al.  ASAP: An Adaptive Sampling Approach to Data Collection in Sensor Networks , 2007, IEEE Transactions on Parallel and Distributed Systems.

[31]  Adrian Weller,et al.  Bethe and Related Pairwise Entropy Approximations , 2015, UAI.

[32]  Pedro M. Domingos,et al.  Learning Efficient Markov Networks , 2010, NIPS.

[33]  Adam R. Teichert,et al.  Learned Prioritization for Trading Off Accuracy and Speed , 2012, NIPS.

[34]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[35]  Frank Jensen,et al.  Optimal junction Trees , 1994, UAI.

[36]  Michael I. Jordan,et al.  Efficient Stepwise Selection in Decomposable Models , 2001, UAI.