Ground Truth Generation for Quantitative Performance Evaluation of Localization Methods in Urban Areas

This paper presents an offline ground truth generation method using LIDAR(Light Detection and Ranging) scans and odometry. The generated ground truth allows quantitative evaluation of the performance of self-localization methods in urban areas where GNSS(Global Navigation Satellite System) cannot be trusted. The proposed method determines the vehicle pose (position and orientation) by aligning the LIDAR input with previously collected point cloud data. However, as alignment convergences are affected by the environment around the vehicle during each LIDAR scan, it can be erroneous. Incorrect estimates are removed and poses are interpolated by relying on odometry; which is locally accurate. A step by step optimization approach is adopted to yield the most accurate result. Experiments performed in a typical urban environment, with many buildings and surrounding obstacles, demonstrated the effectiveness of the proposed method.

[1]  Ryan M. Eustice,et al.  Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving , 2017, Int. J. Robotics Res..

[2]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[3]  Simon Lacroix,et al.  ICP-based pose-graph SLAM , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[4]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[5]  Eijiro Takeuchi,et al.  Localization based on multiple visual-metric maps , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[6]  Eijiro Takeuchi,et al.  Robust localization using 3D NDT scan matching with experimentally determined uncertainty and road marker matching , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[7]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Joachim Hertzberg,et al.  Evaluation of 3D registration reliability and speed - A comparison of ICP and NDT , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Eijiro Takeuchi,et al.  Autonomous driving based on accurate localization using multilayer LiDAR and dead reckoning , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[10]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .