Cost Effective Mobile Mapping System for Color Point Cloud Reconstruction

Survey-grade Lidar brands have commercialized Lidar-based mobile mapping systems (MMSs) for several years now. With this high-end equipment, the high-level accuracy quality of point clouds can be ensured, but unfortunately, their high cost has prevented practical implementation in autonomous driving from being affordable. As an attempt to solve this problem, we present a cost-effective MMS to generate an accurate 3D color point cloud for autonomous vehicles. Among the major processes for color point cloud reconstruction, we first synchronize the timestamps of each sensor. The calibration process between camera and Lidar is developed to obtain the translation and rotation matrices, based on which color attributes can be composed into the corresponding Lidar points. We also employ control points to adjust the point cloud for fine tuning the absolute position. To overcome the limitation of Global Navigation Satellite System/Inertial Measurement Unit (GNSS/IMU) positioning system, we utilize Normal Distribution Transform (NDT) localization to refine the trajectory to solve the multi-scan dispersion issue. Experimental results show that the color point cloud reconstructed by the proposed MMS has a position error in centimeter-level accuracy, meeting the requirement of high definition (HD) maps for autonomous driving usage.

[1]  Hyun Chul Roh,et al.  LiDAR configuration comparison for urban mapping system , 2017, 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[2]  Lei Zhang,et al.  Optimized LOAM Using Ground Plane Constraints and SegMatch-Based Loop Detection , 2019, Sensors.

[3]  Magdy Elbahnasawy,et al.  SLAM-based Pseudo-GNSS/INS localization system for indoor LiDAR mobile mapping systems , 2018, 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[4]  Huosheng Hu,et al.  Building an Omnidirectional 3-D Color Laser Ranging System Through a Novel Calibration Method , 2019, IEEE Transactions on Industrial Electronics.

[5]  Mark Cox,et al.  Colourising Point Clouds Using Independent Cameras , 2018, IEEE Robotics and Automation Letters.

[6]  Ryo Nakashima,et al.  Uncertainty-Based Adaptive Sensor Fusion for Visual-Inertial Odometry under Various Motion Characteristics , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Magdy Elbahnasawy,et al.  Simultaneous System Calibration of a Multi-LiDAR Multicamera Mobile Mapping Platform , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Zhigang Xu,et al.  Fusion of 3D LIDAR and Camera Data for Object Detection in Autonomous Vehicle Applications , 2020, IEEE Sensors Journal.

[10]  José Alberto Gonçalves,et al.  Sensor Integration in a Low Cost Land Mobile Mapping System , 2012, Sensors.

[11]  N. Yastikli.  Documentation of cultural heritage using digital photogrammetry and laser scanning , 2007 .

[12]  Karel Pavelka,et al.  AUTOMATIC CLASSIFICATION OF POINT CLOUDS FOR HIGHWAY DOCUMENTATION , 2018 .

[13]  Tsuyoshi Amano,et al.  Full color 3D point clouds from bird's-eye view using multi-view laser scanner and quadcopter , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[14]  Jinyong Jeong,et al.  LiDAR Intensity Calibration for Road Marking Extraction , 2018, 2018 15th International Conference on Ubiquitous Robots (UR).

[15]  N. Haala,et al.  Mobile LiDAR mapping for 3D point cloud collecation in urban areas : a performance test , 2008 .

[16]  Wan Wanggen,et al.  The Simplification of 3D color point cloud based on voxel , 2013 .

[17]  Nikorn Suttisangiam,et al.  Software-Based Timing Synchronization for Point Cloud Reconstruction , 2018, 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS).

[18]  Chun Liu,et al.  Registration of Vehicle-Borne Point Clouds and Panoramic Images Based on Sensor Constellations , 2017, Sensors.

[19]  Balazs Nagy,et al.  3D CNN-Based Semantic Labeling Approach for Mobile Laser Scanning Data , 2019, IEEE Sensors Journal.

[20]  Qing Zhu,et al.  Leveraging Photogrammetric Mesh Models for Aerial-Ground Feature Point Matching Toward Integrated 3D Reconstruction , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  Ruofei Zhong,et al.  The algorithm to generate color point-cloud with the registration between panoramic image and laser point-cloud , 2014 .

[22]  Hiroshi Mizoguchi,et al.  Generating 3D fundamental map by large-scale SLAM and graph-based optimization focused on road center line , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[23]  Bashar Alsadik,et al.  Active use of panoramic mobile mapping systems for as built surveying and heritage documentation , 2019 .

[24]  Zhaopeng Cui,et al.  OmniSLAM: Omnidirectional Localization and Dense Mapping for Wide-baseline Multi-camera Systems , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Young Hoon Jo,et al.  Three-Dimensional Digital Documentation of Cultural Heritage Site Based on the Convergence of Terrestrial Laser Scanning and Unmanned Aerial Vehicle Photogrammetry , 2019, ISPRS Int. J. Geo Inf..

[26]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[27]  Dieter Fritsch,et al.  Automatic Fusion of Digital Images and Laser Scanner Data for Heritage Preservation , 2012, EuroMed.

[28]  Wolfgang Neubauer,et al.  COMBINED HIGH RESOLUTION LASER SCANNING AND PHOTOGRAMMETRICAL DOCUMENTATION OF THE PYRAMIDS AT GIZA , 2005 .