Gaussian Process Regression for Sensor Networks Under Localization Uncertainty

In this paper, we formulate Gaussian process regression with observations under the localization uncertainty due to the resource-constrained sensor networks. In our formulation, effects of observations, measurement noise, localization uncertainty, and prior distributions are all correctly incorporated in the posterior predictive statistics. The analytically intractable posterior predictive statistics are proposed to be approximated by two techniques, viz., Monte Carlo sampling and Laplace's method. Such approximation techniques have been carefully tailored to our problems and their approximation error and complexity are analyzed. Simulation study demonstrates that the proposed approaches perform much better than approaches without considering the localization uncertainty properly. Finally, we have applied the proposed approaches on the experimentally collected real data from a dye concentration field over a section of a river and a temperature field of an outdoor swimming pool to provide proof of concept tests and evaluate the proposed schemes in real situations. In both simulation and experimental results, the proposed methods outperform the quick-and-dirty solutions often used in practice.

[1]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[2]  Yoichi Miyata,et al.  Fully Exponential Laplace Approximations Using Asymptotic Modes , 2004 .

[3]  F. Gustafsson,et al.  Bayesian Surface and Underwater Navigation , 2006, IEEE Transactions on Signal Processing.

[4]  N. Cressie Kriging Nonstationary Data , 1986 .

[5]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[6]  C. Guestrin,et al.  Near-optimal sensor placements: maximizing information while minimizing communication cost , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[7]  Matthias W. Seeger,et al.  Bayesian Gaussian process models : PAC-Bayesian generalisation error bounds and sparse approximations , 2003 .

[8]  Agathe Girard,et al.  Adaptive, Cautious, Predictive control with Gaussian Process Priors , 2003 .

[9]  Neil D. Lawrence,et al.  Fast Sparse Gaussian Process Methods: The Informative Vector Machine , 2002, NIPS.

[10]  Nicholas S. Johnson,et al.  Mating Pheromone Reception and Induced Behavior in Ovulating Female Sea Lampreys , 2006 .

[11]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[12]  Yoichi Miyata,et al.  Laplace approximations to means and variances with asymptotic modes , 2010 .

[13]  Deborah Estrin,et al.  Guest Editors' Introduction: Overview of Sensor Networks , 2004, Computer.

[14]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[15]  P. Diggle,et al.  Spatiotemporal prediction for log‐Gaussian Cox processes , 2001 .

[16]  Jorge Cortés,et al.  Distributed Kriged Kalman Filter for Spatial Estimation , 2009, IEEE Transactions on Automatic Control.

[17]  N. Johnson,et al.  A synthesized pheromone induces upstream movement in female sea lamprey and summons them into traps , 2009, Proceedings of the National Academy of Sciences.

[18]  Jongeun Choi,et al.  Mobile Sensor Network Navigation Using Gaussian Processes With Truncated Observations , 2011, IEEE Transactions on Robotics.

[19]  K. C. Ho,et al.  Alleviating Sensor Position Error in Source Localization Using Calibration Emitters at Inaccurate Locations , 2010, IEEE Transactions on Signal Processing.

[20]  David Nash,et al.  Using Monte-Carlo simulations and Bayesian Networks to quantify and demonstrate the impact of fertiliser best management practices , 2011, Environ. Model. Softw..

[21]  J. Kocijan,et al.  Predictive control with Gaussian process models , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[22]  Chris Goddard,et al.  Sea Lamprey International Symposium (SLIS II): Advances in the Integrated Management of Sea Lamprey in the Great Lakes , 2003 .

[23]  Frank L. Lewis,et al.  Multi-Scale Adaptive Sampling with Mobile Agents for Mapping of Forest Fires , 2009, J. Intell. Robotic Syst..

[24]  Jongeun Choi,et al.  Adaptive Sampling for Learning Gaussian Processes Using Mobile Sensor Networks , 2011, Sensors.

[25]  Mahdi Jadaliha,et al.  Gaussian process regression using Laplace approximations under localization uncertainty , 2012, 2012 American Control Conference (ACC).

[26]  Carl E. Rasmussen,et al.  Gaussian process dynamic programming , 2009, Neurocomputing.

[27]  Alexander J. Smola,et al.  Sparse Greedy Gaussian Process Regression , 2000, NIPS.

[28]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[29]  Volker Tresp,et al.  A Bayesian Committee Machine , 2000, Neural Computation.

[30]  L. Tierney,et al.  Accurate Approximations for Posterior Moments and Marginal Densities , 1986 .

[31]  João M. F. Xavier,et al.  Robust Localization of Nodes and Time-Recursive Tracking in Sensor Networks Using Noisy Range Measurements , 2011, IEEE Transactions on Signal Processing.

[32]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[33]  Bob Mosier THE UNIVERSITY OF WISCONSIN- STEVENS POINT , 2004 .

[34]  B. R. Smith,et al.  Sea Lamprey (Petromyzon marinus) in Lakes Huron, Michigan, and Superior: History of Invasion and Control, 1936–78 , 1980 .

[35]  David Evans,et al.  Localization for mobile sensor networks , 2004, MobiCom '04.

[36]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[37]  Jongeun Choi,et al.  Distributed learning and cooperative control for multi-agent systems , 2009, Autom..

[38]  Gaurav S. Sukhatme,et al.  Connecting the Physical World with Pervasive Networks , 2002, IEEE Pervasive Comput..

[39]  Hugh Durrant-Whyte,et al.  Simultaneous Localisation and Mapping ( SLAM ) : Part I The Essential Algorithms , 2006 .

[40]  Mahdi Jadaliha,et al.  Environmental Monitoring Using Autonomous Aquatic Robots: Sampling Algorithms and Experiments , 2013, IEEE Transactions on Control Systems Technology.

[41]  L. Tierney,et al.  Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions , 1989 .

[42]  Randy A. Freeman,et al.  Decentralized Environmental Modeling by Mobile Sensor Networks , 2008, IEEE Transactions on Robotics.

[43]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[44]  C. Rasmussen,et al.  Gaussian Process Priors with Uncertain Inputs - Application to Multiple-Step Ahead Time Series Forecasting , 2002, NIPS.