Underwater Loop-Closure Detection for Mechanical Scanning Imaging Sonar by Filtering the Similarity Matrix With Probability Hypothesis Density Filter

Robust and accurate estimation of position and attitude of a UUV (Unmanned Underwater Vehicle) from sonar scans is essential for simultaneous localization and mapping (SLAM). Both dead-reckoning based on the inertial navigation system and the motion parameter estimation based on the registration of the ultrasound scan sequence can contribute to the performance of the system. However, the rapidly-growing accumulated error tends to counteract the precise localization of the vehicle. In this paper, a method for loop-closure detection is proposed that adjusts the accumulated error for the underwater acoustic SLAM when the vehicle scans the underwater environment using an Mechanical Scanning Imaging Sonar (MSIS). Firstly, a similarity matrix for pairs of scans is constructed to represent the loop-closing tracks. In the registration step, two novel features, namely the intensity projection histograms and a polar gradient matrix, are extracted to calculate the translational and rotational parameters respectively. Secondly, the probability hypothesis density (PHD) filter is used to extract the possible loop-closure constraints from the similarity matrix, removing the random noise brought by accidental correlation and refining the concurrent loop-closing tracks resulted from long-range scanning. Lastly, the loop-closure constraints from the refined loop-closing tracks are fed into the GraphSLAM system to adjust the pose of each scan by constraint optimization. Experiments on the MSIS sonar images collected in structured and unstructured underwater environments validate the effectiveness of the proposed loop-closure detection method.

[1]  Pere Ridao Rodriguez,et al.  MSISpIC: A Probabilistic Scan Matching Algorithm Using a Mechanical Scanned Imaging Sonar , 2009 .

[2]  Ling Chen,et al.  Improving Localization Accuracy for an Underwater Robot With a Slow-Sampling Sonar Through Graph Optimization , 2015, IEEE Sensors Journal.

[3]  Jian Liu,et al.  Scan registration for underwater mechanical scanning imaging sonar using symmetrical Kullback–Leibler divergence , 2019, J. Electronic Imaging.

[4]  Pere Ridao,et al.  Scan matching SLAM in underwater environments , 2013, Autonomous Robots.

[5]  Cyrill Stachniss,et al.  Exploiting building information from publicly available maps in graph-based SLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Paul Newman,et al.  Detecting Loop Closure with Scene Sequences , 2007, International Journal of Computer Vision.

[7]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[8]  Y. Bar-Shalom Tracking and data association , 1988 .

[9]  Tim Bailey,et al.  Scan segments matching for pairwise 3D alignment , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Pere Ridao,et al.  Toward Autonomous Exploration in Confined Underwater Environments , 2016, J. Field Robotics.

[11]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[12]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[13]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[14]  B. Vo,et al.  Data Association and Track Management for the Gaussian Mixture Probability Hypothesis Density Filter , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Carlos Silvestre,et al.  Improving Aiding techniques for USBL Tightly-Coupled Inertial Navigation System , 2008 .

[16]  Franz S. Hover,et al.  Advanced perception, navigation and planning for autonomous in-water ship hull inspection , 2012, Int. J. Robotics Res..

[17]  Carlos Silvestre,et al.  TRIDENT: A Framework for Autonomous Underwater Intervention Missions with Dexterous Manipulation Capabilities , 2010 .

[18]  A. Sarma Maximum Likelihood Estimates and Cramer-Rao Bounds for Map-Matching Based Self-Localization , 2007, OCEANS 2007.

[19]  Christopher M. Clark,et al.  The Malta cistern mapping project: Underwater robot mapping and localization within ancient tunnel systems , 2010, J. Field Robotics.

[20]  Xiao Feng,et al.  Autonomous navigation based on unscented-FastSLAM using particle swarm optimization for autonomous underwater vehicles , 2015 .

[21]  Yasir Latif,et al.  Robust loop closing over time for pose graph SLAM , 2013, Int. J. Robotics Res..

[22]  Pere Ridao,et al.  Underwater SLAM in man-made structured environments , 2008 .

[23]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  David S. Wettergreen,et al.  Active localization on the ocean floor with multibeam sonar , 2008, OCEANS 2008.

[26]  Ye Li,et al.  AUV robust bathymetric simultaneous localization and mapping , 2018, Ocean Engineering.

[27]  Pere Ridao,et al.  Multibeam 3D Underwater SLAM with Probabilistic Registration , 2016, Sensors.

[28]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[29]  Eduard Vidal,et al.  Underwater caves sonar data set , 2017, Int. J. Robotics Res..

[30]  Stefan B. Williams,et al.  Autonomous underwater navigation and control , 2001, Robotica.

[31]  Michael Bosse,et al.  Map Matching and Data Association for Large-Scale Two-dimensional Laser Scan-based SLAM , 2008, Int. J. Robotics Res..

[32]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[33]  Marc Carreras,et al.  Autonomous detection, following and mapping of an underwater chain using sonar , 2017 .

[34]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[35]  Dirk Wollherr,et al.  IBuILD: Incremental bag of Binary words for appearance based loop closure detection , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Massimo Caccia,et al.  Forward looking sonar mosaicing for Mine Countermeasures , 2019, Annu. Rev. Control..

[37]  Antonios Gasteratos,et al.  Fast loop-closure detection using visual-word-vectors from image sequences , 2018, Int. J. Robotics Res..

[38]  David Wettergreen,et al.  Real‐Time SLAM with Octree Evidence Grids for Exploration in Underwater Tunnels , 2007, J. Field Robotics.