Approximate computational approaches for Bayesian sensor placement in high dimensions

Since the cost of installing and maintaining sensors is usually high, sensor locations are always strategically selected. For those aiming at inferring certain quantities of interest (QoI), it is desirable to explore the dependency between sensor measurements and QoI. One of the most popular metric for the dependency is mutual information which naturally measures how much information about one variable can be obtained given the other. However, computing mutual information is always challenging, and the result is unreliable in high dimension. In this paper, we propose an approach to find an approximate lower bound of mutual information and compute it in a lower dimension. Then, sensors are placed where highest mutual information (lower bound) is achieved and QoI is inferred via Bayes rule given sensor measurements. In addition, Bayesian optimization is introduced to provide a continuous mutual information surface over the domain and thus reduce the number of evaluations. A chemical release accident is simulated where multiple sensors are placed to locate the source of the release. The result shows that the proposed approach is both effective and efficient in inferring QoI.

[1]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[2]  Hyondong Oh,et al.  A review of source term estimation methods for atmospheric dispersion events using static or mobile sensors , 2017, Inf. Fusion.

[3]  G. Pottie,et al.  Entropy-based sensor selection heuristic for target localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[4]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[5]  Peter D. Scott,et al.  Unscented Kalman Filter/Smoother for a CBRN puff-based dispersion model , 2007, 2007 10th International Conference on Information Fusion.

[6]  Peter D. Scott,et al.  Data assimilation in variable dimension dispersion models using particle filters , 2007, 2007 10th International Conference on Information Fusion.

[7]  D. Lindley.  On a Measure of the Information Provided by an Experiment , 1956 .

[8]  Puneet Singla,et al.  Optimal information collection for source parameter estimation of atmospheric release phenomenon , 2014, 2014 American Control Conference.

[9]  Mingyan Liu,et al.  In-situ soil moisture sensing , 2012, ACM Trans. Sens. Networks.

[10]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[11]  J. Beck,et al.  Bayesian Updating of Structural Models and Reliability using Markov Chain Monte Carlo Simulation , 2002 .

[12]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[13]  J. Ching,et al.  Transitional Markov Chain Monte Carlo Method for Bayesian Model Updating, Model Class Selection, and Model Averaging , 2007 .

[14]  A. Mira.  On Metropolis-Hastings algorithms with delayed rejection , 2001 .

[15]  Christine M. Anderson-Cook,et al.  Computational Enhancements to Bayesian Design of Experiments Using Gaussian Processes , 2016 .

[16]  John W. Fisher,et al.  Maximum Mutual Information Principle for Dynamic Sensor Query Problems , 2003, IPSN.

[17]  G. Evensen.  Data Assimilation: The Ensemble Kalman Filter , 2006 .

[18]  S. Saigal,et al.  Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  N. Oudjane,et al.  Progressive correction for regularized particle filters , 2000, Proceedings of the Third International Conference on Information Fusion.

[20]  Krishnendu Chakrabarty,et al.  Sensor placement for effective coverage and surveillance in distributed sensor networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[21]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[22]  Mark R. Morelande,et al.  Information geometry of target tracking sensor networks , 2013, Inf. Fusion.

[23]  Yan Li,et al.  Estimation of Mutual Information: A Survey , 2009, RSKT.

[24]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[25]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[26]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[27]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003 .

[28]  Geir Evensen,et al.  Sequential data assimilation , 2009 .

[29]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.