Optimizing Graphical Model Structure for Distributed Inference in Wireless Sensor Networks

Graphical models have been widely applied in distributed network computation problems such as inference in large-scale sensor networks. While belief propagation (BP) based on message passing is a powerful approach to solving such distributed inference problems, one major challenge, in the context of wireless sensor networks, is how to systematically address the trade-off between energy efficiency and inference performance. Although various energy-efficient message passing algorithms based on a given graphical model have been proposed in the literature, little work has been done to optimize the graphical model structure to achieve good energy efficiency and inference performance at the same time. In this paper, we propose an efficient distributed algorithm for optimizing the graphical model structure in order to minimize the communication cost required by the inference algorithm without incurring significant performance loss. We first formulate the problem as a multi-objective constrained problem and prove its NP-hardness. Then, we propose an efficient heuristic to solve the problem in polynomial time. Through extensive simulations, using both real-world sensor network data and synthesized data, we empirically evaluate our proposed graphical model structure optimization framework. The simulation results demonstrate that the optimized graphical model efficiently balances the performance of the inference algorithm (measured by mean squared error) and the energy consumed by the inference algorithm (measured by energy used in communication). These highlight the advantages of our proposed framework.

[1]  Anantha P. Chandrakasan,et al.  An application-specific protocol architecture for wireless microsensor networks , 2002, IEEE Trans. Wirel. Commun..

[2]  Alexandre d'Aspremont,et al.  Model Selection Through Sparse Max Likelihood Estimation Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data , 2022 .

[3]  Martin J. Wainwright,et al.  Estimating the "Wrong" Graphical Model: Benefits in the Computation-Limited Setting , 2006, J. Mach. Learn. Res..

[4]  Baochun Li,et al.  A Distributed Framework for Correlated Data Gathering in Sensor Networks , 2008, IEEE Transactions on Vehicular Technology.

[5]  A.S. Willsky,et al.  Distributed fusion in sensor networks , 2006, IEEE Signal Processing Magazine.

[6]  David E. Culler,et al.  Taming the underlying challenges of reliable multihop routing in sensor networks , 2003, SenSys '03.

[7]  Carlos Guestrin,et al.  Robust Probabilistic Inference in Distributed Systems , 2004, UAI.

[8]  Alan S. Willsky,et al.  An Efficient Message-Passing Algorithm for Optimizing Decentralized Detection Networks , 2010, IEEE Transactions on Automatic Control.

[9]  Philip S. Yu,et al.  ASAP: An Adaptive Sampling Approach to Data Collection in Sensor Networks , 2007, IEEE Transactions on Parallel and Distributed Systems.

[10]  Shudong Jin,et al.  Prediction or Not? An Energy-Efficient Framework for Clustering-Based Data Collection in Wireless Sensor Networks , 2011, IEEE Transactions on Parallel and Distributed Systems.

[11]  Samuel Madden,et al.  Distributed regression: an efficient framework for modeling sensor network data , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[12]  Francesco M. Malvestuto,et al.  Approximating discrete probability distributions with decomposable models , 1991, IEEE Trans. Syst. Man Cybern..

[13]  Carlos Guestrin,et al.  A robust architecture for distributed inference in sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[14]  Martin J. Wainwright,et al.  Data association based on optimization in graphical models with application to sensor networks , 2006, Math. Comput. Model..

[15]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[16]  Frank Jensen,et al.  Optimal junction Trees , 1994, UAI.

[17]  R. Marler,et al.  The weighted sum method for multi-objective optimization: new insights , 2010 .

[18]  Adam R. Teichert,et al.  Learned Prioritization for Trading Off Accuracy and Speed , 2012, NIPS.

[19]  Cheng Li,et al.  Distributed Data Aggregation Using Slepian–Wolf Coding in Cluster-Based Wireless Sensor Networks , 2010, IEEE Transactions on Vehicular Technology.

[20]  Bala Shetty,et al.  The nonlinear knapsack problem - algorithms and applications , 2002, Eur. J. Oper. Res..

[21]  Martin J. Wainwright,et al.  Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$ -Constrained Quadratic Programming (Lasso) , 2009, IEEE Transactions on Information Theory.

[22]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[23]  Michael I. Jordan,et al.  Efficient Stepwise Selection in Decomposable Models , 2001, UAI.

[24]  Alexandros G. Dimakis,et al.  Robust Message-Passing for Statistical Inference in Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[25]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[26]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[27]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..