Learning Uncertainty in Ocean Current Predictions for Safe and Reliable Navigation of Underwater Vehicles

Operating autonomous underwater vehicles AUVs near shore is challenging-heavy shipping traffic and other hazards threaten AUV safety at the surface, and strong ocean currents impede navigation when underwater. Predictive models of ocean currents have been shown to improve navigation accuracy, but these forecasts are typically noisy, making it challenging to use them effectively. Prior work has explored the use of probabilistic planners, such as Markov decision processes MDPs, for planning in these scenarios, but prior methods have lacked a principled way of modeling the uncertainty in ocean model predictions, which limits applicability to cases in which high fidelity models are available. To overcome this limitation, we propose using Gaussian processes GPs augmented with interpolation variance to provide confidence measures on predictions. This paper describes two novel planners that incorporate these confidence measures: 1 a stationary risk-aware GPMDP for low-variability currents, and 2 a nonstationary risk-aware NS-GPMDP for faster and high-variability currents. Extensive simulations indicate that the learned confidence measures allow for safe and reliable operation with uncertain ocean current models. Field tests of the planners on Slocum gliders over several weeks in the ocean demonstrate the practical efficacy of our approach.

[1]  Gaurav S. Sukhatme,et al.  USC CINAPS Builds Bridges , 2010, IEEE Robotics & Automation Magazine.

[2]  Fumin Zhang,et al.  A lower bound on navigation error for marine robots guided by ocean circulation models , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  S. Mahadevan,et al.  Solving Semi-Markov Decision Problems Using Average Reward Reinforcement Learning , 1999 .

[4]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[5]  Rustam Stolkin,et al.  Optimal AUV path planning for extended missions in complex, fast-flowing estuarine environments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Geoffrey A. Hollinger,et al.  Learning uncertainty models for reliable operation of Autonomous Underwater Vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  Enrique Alvarez Fanjul,et al.  Path planning for gliders using Regional Ocean Models: Application of Pinzón path planner with the ESEOAT model and the RU27 trans-Atlantic flight data , 2010, OCEANS'10 IEEE SYDNEY.

[8]  Alexander F. Shchepetkin,et al.  The regional oceanic modeling system (ROMS): a split-explicit, free-surface, topography-following-coordinate oceanic model , 2005 .

[9]  Pierre F. J. Lermusiaux,et al.  Uncertainty estimation and prediction for interdisciplinary ocean dynamics , 2006, J. Comput. Phys..

[10]  Giorgio Guglieri,et al.  A Minimum Risk Approach for Path Planning of UAVs , 2011, J. Intell. Robotic Syst..

[11]  Jon Rigelsford Algorithmic and Computational Robotics: New Directions , 2001 .

[12]  Mike Eichhorn,et al.  Opportunities to parallelize path planning algorithms for autonomous underwater vehicles , 2011, OCEANS'11 MTS/IEEE KONA.

[13]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[14]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[15]  E. L. Nelson,et al.  AUV path planning: an A* approach to path planning with consideration of variable vehicle speeds and multiple, overlapping, time-dependent exclusion zones , 1992, Proceedings of the 1992 Symposium on Autonomous Underwater Vehicle Technology.

[16]  Geoffrey A. Hollinger,et al.  Risk‐aware Path Planning for Autonomous Underwater Vehicles using Predictive Ocean Models , 2013, J. Field Robotics.

[17]  Leslie Pack Kaelbling,et al.  Planning in partially-observable switching-mode continuous domains , 2010, Annals of Mathematics and Artificial Intelligence.

[18]  David R. Thompson,et al.  Spatiotemporal path planning in strong, dynamic, uncertain currents , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Apostolos Burnetas,et al.  Optimal Adaptive Policies for Markov Decision Processes , 1997, Math. Oper. Res..

[20]  Joshua Grady Graver,et al.  UNDERWATER GLIDERS: DYNAMICS, CONTROL AND DESIGN , 2005 .

[21]  David S. Wettergreen,et al.  Intelligent Maps for Autonomous Kilometer-Scale Science Survey , 2008 .

[22]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Hans C. Woithe,et al.  Improving Slocum Glider dead reckoning using a Doppler Velocity Log , 2011, OCEANS'11 MTS/IEEE KONA.

[24]  J. Sethian Evolution, implementation, and application of level set and fast marching methods for advancing fronts , 2001 .

[25]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[26]  Mike Eichhorn,et al.  Solutions for practice-oriented requirements for optimal path planning for the AUV “SLOCUM Glider” , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[27]  Er. Waghoo Parvez,et al.  Path planning in construction sites : performance evaluation of the Dijkstra , A * , and GA search algorithms , 2013 .

[28]  Alexander Vladimirsky,et al.  Ordered Upwind Methods for Static Hamilton-Jacobi Equations: Theory and Algorithms , 2003, SIAM J. Numer. Anal..

[29]  Lucas Merckelbach On the probability of underwater glider loss due to collision with a ship , 2013 .

[30]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[31]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[32]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[33]  Robert E. Davis,et al.  Statistics for the evaluation and comparison of models , 1985 .

[34]  G. H. Keulegan Tidal Flow in Entrances; Water-Level Fluctuations of Basins in Communication with Seas , 1967 .

[35]  Neil D. Lawrence,et al.  Computationally Efficient Convolved Multiple Output Gaussian Processes , 2011, J. Mach. Learn. Res..

[36]  Matthew Dunbabin,et al.  Go with the flow : optimal AUV path planning in coastal environments , 2009, ICRA 2009.

[37]  Anthony Stentz,et al.  Anytime RRTs , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  S. Buttrey,et al.  A comparison of robust metamodels for the uncertainty quantification (UQ) of New York Harbor oceanographic data , 2008 .

[39]  Young-Ho Kim,et al.  Spatial Interpolation for Robotic Sampling: Uncertainty with Two Models of Variance , 2012, ISER.

[40]  J. Yamamoto An Alternative Measure of the Reliability of Ordinary Kriging Estimates , 2000 .

[41]  Maxim Likhachev,et al.  D*lite , 2002, AAAI/IAAI.

[42]  Gaurav S. Sukhatme,et al.  Global estimation in constrained environments , 2012, Int. J. Robotics Res..

[43]  A Alvarez,et al.  Model based decision support for underwater glider operation monitoring , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[44]  Gaurav S. Sukhatme,et al.  Planning and Implementing Trajectories for Autonomous Underwater Vehicles to Track Evolving Ocean Processes Based on Predictions from a Regional Ocean Model , 2010, Int. J. Robotics Res..

[45]  Gaurav S. Sukhatme,et al.  USC CINAPS Builds bridges : observing and monitoring the southern california bight , 2010 .

[46]  Pradeep Bhatta,et al.  Nonlinear Stability and Control of Gliding Vehicles , 2006 .

[47]  Hugh F. Durrant-Whyte,et al.  Gaussian Process modeling of large scale terrain , 2009, ICRA.

[48]  R. Bellman Dynamic programming. , 1957, Science.

[49]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[50]  Pierre F. J. Lermusiaux,et al.  Path planning in time dependent flow fields using level set methods , 2012, 2012 IEEE International Conference on Robotics and Automation.

[51]  Hissam Tawfik,et al.  Path planning in construction sites: performance evaluation of the Dijkstra, A*, and GA search algorithms , 2002, Adv. Eng. Informatics.

[52]  Yan Pailhas,et al.  Path Planning for Autonomous Underwater Vehicles , 2007, IEEE Transactions on Robotics.

[53]  J. Yamamoto,et al.  Properties and Applications of the Interpolation Variance Associated with Ordinary Kriging Estimates , 2008 .

[54]  Gaurav S. Sukhatme,et al.  An investigation on the accuracy of Regional Ocean Models through field trials , 2013, 2013 IEEE International Conference on Robotics and Automation.