Navnet: AUV Navigation Through Deep Sequential Learning

Achieving accurate navigation and localization is crucial for Autonomous Underwater Vehicle (AUV). Traditional navigation algorithms, such as Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF), require the system model and measurement model for state estimation to obtain the AUV position. However, this may introduce modeling errors and state estimation errors which will affect the final precision of AUV navigation system to a certain extent. To avoid these problems, in this paper, we proposed a deep framework — NavNet — by taking AUV navigation as a deep sequential learning problem. Firstly, the proposed NavNet can take raw sensor data at different frequencies as input, which benefits from the sequential learning capability of Recurrent Neural Network (RNN). Secondly, NavNet takes advantage of a simplified attention mechanism and Fully Connected (FC) layers to output AUV displacements per unit time, which accomplishes low-frequency AUV navigation by accumulation of it. More importantly, there is no need for the model building and state estimation with NavNet, which avoids the import of relevant errors. We compare the performance of NavNet to EKF and UKF using collected data by running Sailfish in the sea. Experimental results show that NavNet has an excellent performance in terms of both the navigation accuracy and fault tolerance. In addition, a reliable fusion strategy of NavNet and conventional method is applied to achieve high-frequency AUV navigation. The experimental results show that the proposed architecture can be a reliable supplement to limit the error growth of conventional algorithms.

[1]  Francisco Curado Teixeira,et al.  Geophysical Navigation of Autonomous Underwater Vehicles Using Geomagnetic Information , 2008 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Nak Yong Ko,et al.  Attitude estimation and DVL based navigation using low-cost MEMS AHRS for UUVs , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  S. Singh,et al.  The WHOI micro-modem: an acoustic communications and navigation system for multiple platforms , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[7]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[8]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[9]  Daniel P. W. Ellis,et al.  Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems , 2015, ArXiv.

[10]  Helder Araújo,et al.  Deep EndoVO: A recurrent convolutional neural network (RCNN) based visual odometry approach for endoscopic capsule robots , 2017, Neurocomputing.

[11]  Bruno Sinopoli,et al.  Vision based navigation for an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  Sajad Saeedi,et al.  AUV Navigation and Localization: A Review , 2014, IEEE Journal of Oceanic Engineering.

[13]  Marcel Rothenbeck,et al.  Use of REMUS 6000 AUVs in the search for the Air France Flight 447 , 2011, OCEANS'11 MTS/IEEE KONA.

[14]  Guoyuan Li,et al.  Dead Reckoning of Dynamically Positioned Ships: Using an Efficient Recurrent Neural Network , 2019, IEEE Robotics & Automation Magazine.

[15]  Dongbing Gu,et al.  UnDeepVO: Monocular Visual Odometry Through Unsupervised Deep Learning , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  Alireza Fathi,et al.  A Low-Cost Dead Reckoning Navigation System for an AUV Using a Robust AHRS: Design and Experimental Analysis , 2018, IEEE Journal of Oceanic Engineering.

[18]  M. Barisic,et al.  Sigma-point Unscented Kalman Filter used for AUV navigation , 2012, 2012 20th Mediterranean Conference on Control & Automation (MED).

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Bingbing Ni,et al.  HCP: A Flexible CNN Framework for Multi-Label Image Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Nikos Komodakis,et al.  Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[24]  Pere Ridao,et al.  EKF-SLAM for AUV navigation under probabilistic sonar scan-matching , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Xiao Feng,et al.  AUV SLAM and Experiments Using a Mechanical Scanning Forward-Looking Sonar , 2012, Sensors.

[26]  Erik Maehle,et al.  Sonar-based FastSLAM in an underwater environment using walls as features , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[27]  M. L. Incze,et al.  REP10 AUV: Shallow water operations with heterogeneous autonomous vehicles , 2011, OCEANS 2011 IEEE - Spain.

[28]  Sen Wang,et al.  VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem , 2017, AAAI.

[29]  B. Bett,et al.  Autonomous Underwater Vehicles (AUVs): Their past, present and future contributions to the advancement of marine geoscience , 2014 .

[30]  Giovanni Ulivi,et al.  An outdoor navigation system using GPS and inertial platform , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[31]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[32]  Sen Wang,et al.  DeepVO: Towards end-to-end visual odometry with deep Recurrent Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[34]  Pere Ridao,et al.  SLAM using an Imaging Sonar for Partially Structured Underwater Environments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Debashish Chakravarty,et al.  DeepVO: A Deep Learning approach for Monocular Visual Odometry , 2016, ArXiv.

[36]  Yuanyuan Zhao,et al.  Autonomous Underwater Vehicle Navigation , 2010, IEEE Journal of Oceanic Engineering.

[37]  Yong Yin,et al.  A model for vessel trajectory prediction based on long short-term memory neural network , 2019, Journal of Marine Engineering & Technology.

[38]  Paulo Oliveira,et al.  Study and implementation of an EKF GIB-based underwater positioning system , 2004 .

[39]  Anibal Matos,et al.  On the use of particle filters for terrain based navigation of sensor-limited AUVs , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[40]  Luigi Chisci,et al.  A comparison between EKF-based and UKF-based navigation algorithms for AUVs localization , 2015, OCEANS 2015 - Genova.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  T. Shimura,et al.  A tracking of AUV with integration of SSBL acoustic positioning and transmitted INS data , 2009, OCEANS 2009-EUROPE.

[43]  Y. Petillot,et al.  A particle filter approach for AUV localization , 2008, OCEANS 2008.

[44]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.