Loop-Closure Detection Based on 3D Point Cloud Learning for Self-Driving Industry Vehicles

Self-driving industry vehicle plays a key role in the industry automation and contributes to resolve the problems of the shortage and increasing cost in manpower. Place recognition and loop-closure detection are main challenges in the localization and navigation tasks, specially when industry vehicles work in large-scale complex environments, such as the logistics warehouse and the port terminal. In this paper, we resolve the loop-closure detection problem by developing a novel 3D point cloud learning network, an active super keyframe selection method and a coarse-to-fine sequence matching strategy. More specifically, we first propose a novel deep neural network to extract a global descriptors from the original large-scale 3D point cloud, then based on which, an environment analysis approach is presented to investigate the feature space distribution of the global descriptors and actively select several super keyframes. Finally, a coarse-to-fine sequence matching strategy, which includes a super keyframe based coarse matching stage and a local sequence matching stage, is presented to ensure the loop-closure detection accuracy and real-time performance simultaneously. The proposed network is evaluated in different datasets and obtains a substantial improvement against the state-of-the-art PointNetVLAD in place recognition tasks. Experiment results on a self-driving industry vehicle validate the effectiveness of the proposed loop-closure detection algorithm.

[1]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[2]  Boris Jutzi,et al.  Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features , 2014 .

[3]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[4]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Gim Hee Lee,et al.  PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Weiliang Xu,et al.  Stabilize an Unsupervised Feature Learning for LiDAR-based Place Recognition , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Ayoung Kim,et al.  Scan Context: Egocentric Spatial Descriptor for Place Recognition Within 3D Point Cloud Map , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[15]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[16]  Li He,et al.  M2DP: A novel 3D point cloud descriptor and its application in loop closure detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).