Data‐driven learning and planning for environmental sampling

Robots such as autonomous underwater vehicles (AUVs) and autonomous surface vehicles (ASVs) have been used for sensing and monitoring aquatic environments such as oceans and lakes. Environmental sampling is a challenging task because the environmental attributes to be observed can vary both spatially and temporally, and the target environment is usually a large and continuous domain whereas the sampling data is typically sparse and limited. The challenges require that the sampling method must be informative and efficient enough to catch up with the environmental dynamics. In this paper we present a planning and learning method that enables a sampling robot to perform persistent monitoring tasks by learning and refining a dynamic "data map" that models a spatiotemporal environment attribute such as ocean salinity content. Our environmental sampling framework consists of two components: to maximize the information collected, we propose an informative planning component that efficiently generates sampling waypoints that contain the maximal information; To alleviate the computational bottleneck caused by large-scale data accumulated, we develop a component based on a sparse Gaussian Process whose hyperparameters are learned online by taking advantage of only a subset of data that provides the greatest contribution. We validate our method with both simulations running on real ocean data and field trials with an ASV in a lake environment. Our experiments show that the proposed framework is both accurate in learning the environmental data map and efficient in catching up with the dynamic environmental changes.

[1]  Fumin Zhang,et al.  Collaborative Autonomous Surveys in Marine Environments Affected by Oil Spills , 2014 .

[2]  Duy Nguyen-Tuong,et al.  Local Gaussian Process Regression for Real Time Online Model Learning , 2008, NIPS.

[3]  Naomi Ehrich Leonard,et al.  Adaptive Sampling Using Feedback Control of an Autonomous Underwater Glider Fleet , 2003 .

[4]  Sanjiv Singh,et al.  Yield estimation in vineyards by visual grape detection , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Fernando Lobo Pereira,et al.  Chemical plume source localization with multiple Autonomous Underwater Vehicles , 2010, OCEANS'10 IEEE SYDNEY.

[6]  Jorge Cortés,et al.  Distributed gradient ascent of random fields by robotic sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[7]  Mac Schwager,et al.  Generating informative paths for persistent sensing in unknown environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  K. Assmann,et al.  Glider observations of the Dotson Ice Shelf outflow , 2016 .

[9]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[10]  Alexei Makarenko,et al.  Gaussian Process Models for Indoor and Outdoor Sensor-Centric Robot Localization , 2008, IEEE Transactions on Robotics.

[11]  Thomas C. Henderson,et al.  Gaussian processes for multi-sensor environmental monitoring , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[12]  Robert G. Haight,et al.  Monitoring as a partially observable decision problem , 2014 .

[13]  T. Patterson,et al.  Deep Sea Research Part II: Topical Studies in Oceanography , 2013 .

[14]  Matt Welsh,et al.  Fidelity and yield in a volcano monitoring sensor network , 2006, OSDI '06.

[15]  Kian Hsiang Low,et al.  Multi-robot informative path planning for active sensing of environmental phenomena: a tale of two algorithms , 2013, AAMAS.

[16]  Martin A. Riedmiller,et al.  Optimization of Gaussian process hyperparameters using Rprop , 2013, ESANN.

[17]  J.A. Farrell,et al.  Chemical plume tracing via an autonomous underwater vehicle , 2005, IEEE Journal of Oceanic Engineering.

[18]  Geoffrey A. Hollinger,et al.  Learning Uncertainty in Ocean Current Predictions for Safe and Reliable Navigation of Underwater Vehicles , 2015, J. Field Robotics.

[19]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[20]  N. Cristianini,et al.  On Kernel-Target Alignment , 2001, NIPS.

[21]  Manfred Opper,et al.  A Bayesian approach to on-line learning , 1999 .

[22]  Ming-Hsuan Yang,et al.  Online Sparse Gaussian Process Regression and Its Applications , 2011, IEEE Transactions on Image Processing.

[23]  Gaurav S. Sukhatme,et al.  An information-driven and disturbance-aware planning method for long-term ocean monitoring , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  K. H. Low,et al.  Multi-robot adaptive exploration and mapping for environmental sensing applications , 2009 .

[25]  Edith C. H. Ngai,et al.  Data Modelling with Gaussian Process in Sensor Networks for Urban Environmental Monitoring , 2016, 2016 IEEE 24th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS).

[26]  Wolfram Burgard,et al.  Gas Distribution Modeling using Sparse Gaussian Process Mixture Models , 2008, Robotics: Science and Systems.

[27]  Shi Bai,et al.  Information-theoretic exploration with Bayesian optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Geoffrey A. Hollinger,et al.  Learning uncertainty models for reliable operation of Autonomous Underwater Vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Alexander F. Shchepetkin,et al.  The regional oceanic modeling system (ROMS): a split-explicit, free-surface, topography-following-coordinate oceanic model , 2005 .

[30]  Christopher G. Mayhew,et al.  Robust Source-Seeking Hybrid Controllers for Autonomous Vehicles , 2007, 2007 American Control Conference.

[31]  Gaurav S. Sukhatme,et al.  Multi-robot Informative and Adaptive Planning for Persistent Environmental Monitoring , 2016, DARS.

[32]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[33]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[34]  Alexander J. Smola,et al.  Sparse Greedy Gaussian Process Regression , 2000, NIPS.

[35]  Fumin Zhang,et al.  A bio-inspired robust 3D plume tracking strategy using mobile sensor networks , 2013, 52nd IEEE Conference on Decision and Control.

[36]  Gaurav S. Sukhatme,et al.  Optimizing waypoints for monitoring spatiotemporal phenomena , 2013, Int. J. Robotics Res..

[37]  Miguel Garcia,et al.  A Wireless Sensor Network Deployment for Rural and Forest Fire Detection and Verification , 2009, Sensors.

[38]  Kian Hsiang Low,et al.  Multi-robot active sensing of non-stationary gaussian process-based environmental phenomena , 2014, AAMAS.

[39]  Pratap Tokekar,et al.  A robotic system for monitoring carp in Minnesota lakes , 2010, J. Field Robotics.

[40]  John Lygeros,et al.  Stochastic localization of sources using autonomous underwater vehicles , 2012, 2012 American Control Conference (ACC).

[41]  Naomi Ehrich Leonard,et al.  Cooperative Control for Ocean Sampling: The Glider Coordinated Control System , 2008, IEEE Transactions on Control Systems Technology.

[42]  M. Ani Hsieh,et al.  An information theoretic source seeking strategy for plume tracking in 3D turbulent fields , 2015, 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[43]  G. Laporte The traveling salesman problem: An overview of exact and approximate algorithms , 1992 .

[44]  Fumin Zhang,et al.  A bio-inspired plume tracking algorithm for mobile sensing swarms in turbulent flow , 2013, 2013 IEEE International Conference on Robotics and Automation.

[45]  Yi Guo,et al.  Distributed source seeking by cooperative robots: All-to-all and limited communications , 2012, 2012 IEEE International Conference on Robotics and Automation.

[46]  Gaurav S. Sukhatme,et al.  Persistent ocean monitoring with underwater gliders: Adapting sampling resolution , 2011, J. Field Robotics.

[47]  Vincent G. Ambrosia,et al.  Unmanned Aircraft Systems in Remote Sensing and Scientific Research: Classification and Considerations of Use , 2012, Remote. Sens..

[48]  Heike Freud,et al.  On Line Learning In Neural Networks , 2016 .

[49]  Andreas Krause,et al.  Efficient Planning of Informative Paths for Multiple Robots , 2006, IJCAI.

[50]  Chenghai Yang,et al.  A high-resolution airborne four-camera imaging system for agricultural remote sensing , 2012 .

[51]  Joel J. P. C. Rodrigues,et al.  Wireless Sensor Networks: a Survey on Environmental Monitoring , 2011, J. Commun..

[52]  Lino Marques,et al.  Robots for Environmental Monitoring: Significant Advancements and Applications , 2012, IEEE Robotics & Automation Magazine.

[53]  George J. Pappas,et al.  Stochastic Source Seeking by Mobile Robots , 2012, IEEE Transactions on Automatic Control.

[54]  Kian Hsiang Low,et al.  Active Markov information-theoretic path planning for robotic environmental sensing , 2011, AAMAS.

[55]  Silvia Coradeschi,et al.  Towards environmental monitoring with mobile robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Gaurav S. Sukhatme,et al.  Informative path planning for an autonomous underwater vehicle , 2010, 2010 IEEE International Conference on Robotics and Automation.

[57]  Andreas Krause,et al.  Nonmyopic Informative Path Planning in Spatio-Temporal Models , 2007, AAAI.

[58]  Naomi Ehrich Leonard,et al.  Coordinated control of an underwater glider fleet in an adaptive ocean sampling field experiment in Monterey Bay , 2010, J. Field Robotics.

[59]  Mac Schwager,et al.  Correlated Orienteering Problem and its application to informative path planning for persistent monitoring tasks , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[60]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[61]  Gaurav S. Sukhatme,et al.  Informative planning and online learning with sparse Gaussian processes , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[62]  Karen Anderson,et al.  Lightweight unmanned aerial vehicles will revolutionize spatial ecology , 2013 .