Point wise or Feature wise? Benchmark Comparison of Public Available LiDAR Odometry Algorithms in Urban Canyons

Robust and precise localization is essential for the autonomous system with navigation requirements. Light detection and ranging (LiDAR) odometry is extensively studied in the past decades to achieve this goal. Satisfactory accuracy can be achieved in scenarios with abundant environmental features using existing LiDAR odometry (LO) algorithms. Unfortunately, the performance of the LiDAR odometry is significantly degraded in urban canyons with numerous dynamic objects and complex environmental structures. Meanwhile, it is still not clear from the existing literature which LO algorithms perform well in such challenging environments. To fill this gap, this paper evaluates an array of popular and extensively studied LO pipelines using the datasets collected in urban canyons of Hong Kong. We present the results in terms of their positioning accuracy and computational efficiency. Three major factors dominating the performance of LO in urban canyons are concluded, including the ego-vehicle dynamic, moving objects, and degree of urbanization. According to our experiment results, point-wise achieves better accuracy in urban canyons while feature-wise achieves cost-efficiency and satisfactory positioning accuracy.

[1]  Li-Ta Hsu,et al.  Using Sky-pointing fish-eye camera and LiDAR to aid GNSS single-point positioning in urban canyons , 2020 .

[2]  Yasushi Makihara,et al.  Object recognition supported by user interaction for service robots , 2002, Object recognition supported by user interaction for service robots.

[3]  Masayoshi Tomizuka,et al.  UrbanLoco: A Full Sensor Suite Dataset for Mapping and Localization in Urban Scenes , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Wolfgang Straßer,et al.  Registration of colored 3D point clouds with a Kernel-based extension to the normal distributions transform , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Li-Ta Hsu,et al.  Correcting NLOS by 3D LiDAR and building height to improve GNSS single point positioning , 2019, Navigation.

[6]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[7]  Wei Liu,et al.  Points Registration for Roadside LiDAR Sensors , 2019, Transportation Research Record: Journal of the Transportation Research Board.

[8]  Ji Zhang,et al.  On degeneracy of optimization-based state estimation problems , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Guangming Xiong,et al.  CPFG-SLAM:a Robust Simultaneous Localization and Mapping based on LIDAR in Off-Road Environment , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[10]  E Li,et al.  SUSTech POINTS: A Portable 3D Point Cloud Interactive Annotation Platform System , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[11]  Giorgio Grisetti,et al.  NICP: Dense normal based point cloud registration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[14]  Shuji Oishi,et al.  Voxelized GICP for Fast and Accurate 3D Point Cloud Registration , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Li-Ta Hsu,et al.  Analysis and modeling GPS NLOS effect in highly urbanized area , 2017, GPS Solutions.

[17]  Max Q.-H. Meng,et al.  Autonomous mobile robot navigation in uneven and unstructured indoor environments , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Andrew Markham,et al.  A Survey on Deep Learning for Localization and Mapping: Towards the Age of Spatial Machine Intelligence , 2020, ArXiv.

[19]  Xinming Huang,et al.  A Survey on 3D LiDAR Localization for Autonomous Vehicles , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[20]  Jean-Emmanuel Deschaud,et al.  IMLS-SLAM: Scan-to-Model Matching Based on 3D Data , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Younggun Cho,et al.  Unsupervised Geometry-Aware Deep LiDAR Odometry , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Andreas Birk,et al.  Beyond points: Evaluating recent 3D scan-matching algorithms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Hao Xu,et al.  Revolution and rotation-based method for roadside LiDAR data integration , 2019 .

[24]  Xin Li,et al.  LO-Net: Deep Real-Time Lidar Odometry , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[26]  Ji Zhang,et al.  Low-drift and real-time lidar odometry and mapping , 2017, Auton. Robots.

[27]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[28]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[30]  Yaron Lipman,et al.  Point registration via efficient convex relaxation , 2016, ACM Trans. Graph..

[31]  Mia Hubert,et al.  Robust statistics for outlier detection , 2011, WIREs Data Mining Knowl. Discov..

[32]  Adam Herout,et al.  CNN for IMU assisted odometry estimation using velodyne LiDAR , 2017, 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[33]  Li-Ta Hsu,et al.  GNSS NLOS Exclusion Based on Dynamic Object Detection Using LiDAR Point Cloud , 2021, IEEE Transactions on Intelligent Transportation Systems.

[34]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .

[35]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[36]  Bo Yang,et al.  PointLoc: Deep Pose Regressor for LiDAR Point Cloud Localization , 2020, ArXiv.

[37]  Shinpei Kato,et al.  LIBRE: The Multiple 3D LiDAR Dataset , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[38]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[39]  Li-Ta Hsu,et al.  NLOS Correction/Exclusion for GNSS Measurement Using RAIM and City Building Models , 2015, Sensors.

[40]  Emanuele Menegatti,et al.  A portable three-dimensional LIDAR-based system for long-term and wide-area people behavior measurement , 2019, International Journal of Advanced Robotic Systems.

[41]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[42]  N. Kubo,et al.  UrbanNav:An Open-Sourced Multisensory Dataset for Benchmarking Positioning Algorithms Designed for Urban Areas , 2021, Proceedings of the 34th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2021).

[43]  E. Chung,et al.  Performance Evaluation on Map-Based NDT Scan Matching Localization Using Simulated Occlusion Datasets , 2021, IEEE Sensors Letters.

[44]  Hao Xu,et al.  Automatic Background Construction and Object Detection Based on Roadside LiDAR , 2020, IEEE Transactions on Intelligent Transportation Systems.

[45]  Yuan Tian,et al.  Vehicle Detection under Adverse Weather from Roadside LiDAR Data , 2020, Sensors.

[46]  Shaojie Shen,et al.  An Augmented Reality Interaction Interface for Autonomous Drone , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[47]  Tarik Taleb,et al.  Low-Altitude Unmanned Aerial Vehicles-Based Internet of Things Services: Comprehensive Survey and Future Perspectives , 2016, IEEE Internet of Things Journal.

[48]  Ming Liu,et al.  Tightly Coupled 3D Lidar Inertial Odometry and Mapping , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[49]  Zheng Fang,et al.  A Robust Laser-Inertial Odometry and Mapping Method for Large-Scale Highway Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[51]  Li-Ta Hsu,et al.  Performance Analysis of NDT-based Graph SLAM for Autonomous Vehicle in Diverse Typical Driving Scenarios of Hong Kong , 2018, Sensors.

[52]  Aleksandr V. Segal,et al.  Generalized-ICP , 2009, Robotics: Science and Systems.

[53]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[54]  Dietrich Paulus,et al.  MC2SLAM: Real-Time Inertial Lidar Odometry Using Two-Scan Motion Compensation , 2018, GCPR.

[55]  Lihua Xie,et al.  Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detection , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[56]  Lisa Stryjewski,et al.  40 years of boxplots , 2010 .