Pole-like Objects Mapping and Long-Term Robot Localization in Dynamic Urban Scenarios

Localization on 3D data is a challenging task for unmanned vehicles, especially in long-term dynamic urban scenarios. Due to the generality and long-term stability, the pole-like objects are very suitable as landmarks for unmanned vehicle localization in time-varing scenarios. In this paper, a long-term LiDAR-only localization algorithm based on semantic cluster map is proposed. At first, the Convolutional Neural Network(CNN) is used to infer the semantics of LiDAR point clouds. Combined with the point cloud segmentation, the longterm static objects pole/trunk in the scene are extracted and registered into a semantic cluster map. When the unmanned vehicle re-enters the environment again, the relocalization is completed by matching the clusters of the local map with the clusters of the global map. Furthermore, the continuous matching between the local and global maps stably outputs the global pose at 2Hz to correct the drift of the 3D LiDAR odometry. The proposed approach realizes localization in the long-term scenarios without maintaining the high-precision point cloud map. The experimental results on our campus dataset demonstrate that the proposed approach performs better in localization accuracy compared with the current stateof-the-art methods. The source of this paper is available at: http://www.github.com/HITSZ-NRSL/long-term-localization.

[1]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Haoyao Chen,et al.  ClusterMap Building and Relocalization in Urban Environments for Unmanned Vehicles , 2019, Sensors.

[3]  Cyrill Stachniss,et al.  Fast range image-based segmentation of sparse 3D laser scans for online operation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Cyrill Stachniss,et al.  RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Byungjae Park,et al.  1-Day Learning, 1-Year Localization: Long-Term LiDAR Localization Using Scan Context Image , 2019, IEEE Robotics and Automation Letters.

[6]  Cyrill Stachniss,et al.  SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Renaud Dubé,et al.  SegMatch: Segment based place recognition in 3D point clouds , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  R. Siegwart,et al.  A Partitioned Approach for Efficient Graph-Based Place Recognition , 2017 .

[9]  Roland Siegwart,et al.  Long-term 3D map maintenance in dynamic environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Ayoung Kim,et al.  Scan Context: Egocentric Spatial Descriptor for Place Recognition Within 3D Point Cloud Map , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Wolfram Burgard,et al.  Long-Term Urban Vehicle Localization Using Pole Landmarks Extracted from 3-D Lidar Scans , 2019, 2019 European Conference on Mobile Robots (ECMR).

[12]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Roland Siegwart,et al.  OneShot Global Localization: Instant LiDAR-Visual Pose Estimation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[15]  Wei Wang,et al.  LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[17]  Yong Liu,et al.  Semantic Graph Based Place Recognition for 3D Point Clouds , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Titus Cieslewski,et al.  Place Recognition in Semi-Dense Maps: Geometric and Learning-Based Approaches. , 2017, BMVC 2017.

[19]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[20]  Torsten Sattler,et al.  A Cross-Season Correspondence Dataset for Robust Semantic Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Ryan M. Eustice,et al.  University of Michigan North Campus long-term vision and lidar dataset , 2016, Int. J. Robotics Res..

[22]  Wolfram Burgard,et al.  Matching Geometry for Long-term Monocular Camera Localization , 2016 .

[23]  Konstantinos G. Derpanis,et al.  Overview of the RANSAC Algorithm , 2005 .