Enhanced trajectory estimation of mobile laser scanners using aerial images

Abstract Multipath effects and signal obstruction by buildings in urban canyons can lead to inaccurate GNSS measurements and therefore errors in the estimated trajectory of Mobile Laser Scanning (MLS) systems; consequently, derived point clouds are distorted and lose spatial consistency. We obtain decimetre-level trajectory accuracy making use of corresponding points between the MLS data and aerial images with accurate exterior orientations instead of using ground control points. The MLS trajectory is estimated based on observation equations resulting from these corresponding points, the original IMU observations, and soft constraints on the pitch and yaw rotations of the vehicle. We analyse the quality of the trajectory enhancement under several conditions where the experiments were designed to test the influence of the number and quality of corresponding points and to test different settings for a B-spline representation of the vehicle trajectory. The method was tested on two independently acquired MLS datasets in Rotterdam by enhancing the trajectories and evaluating them using checkpoints. The RMSE values of the original GNSS/IMU based Kalman filter results at the checkpoints were 0.26 m, 0.30 m, and 0.47 m for the X-, Y- and Z-coordinates in the first dataset and 1.10 m, 1.51 m, and 1.81 m in the second dataset. The latter dataset was recorded with a lower quality IMU in an area with taller buildings. After trajectory adjustment these RMSE values were reduced to 0.09 m, 0.11 m, and 0.16 m for the first dataset and 0.12 m, 0.14 m, and 0.18 m for the second dataset. The results confirmed that, if sufficient tie points between the point cloud and aerial imagery are available, the method supports geo-referencing of MLS point clouds in urban canyons with a near-decimetre accuracy.

[1]  Juha Hyyppä,et al.  Benchmarking the Performance of Mobile Laser Scanning Systems Using a Permanent Test Field , 2012, Sensors.

[2]  Wolfram Burgard,et al.  Large scale graph-based SLAM using aerial images as prior information , 2009, Auton. Robots.

[3]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Xianfeng Huang,et al.  AUTOMATIC GEO-REFERENCING MOBILE LASER SCANNING DATA TO UAV IMAGES , 2015 .

[5]  Sebastian Thrun,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2007, Robotics: Science and Systems.

[6]  N. Haala,et al.  Mobile LiDAR mapping for 3D point cloud collecation in urban areas : a performance test , 2008 .

[7]  Yanlei Gu,et al.  Towards High-Definition 3D Urban Mapping: Road Feature-Based Registration of Mobile Mapping Systems and Aerial Imagery , 2017, Remote. Sens..

[8]  S. J. Oude Elberink,et al.  AN AUTOMATIC PROCEDURE FOR MOBILE LASER SCANNING PLATFORM 6DOF TRAJECTORY ADJUSTMENT , 2018 .

[9]  Kai-Wei Chiang,et al.  An intelligent navigator for seamless INS/GPS integrated land vehicle navigation applications , 2008, Appl. Soft Comput..

[10]  Antero Kukko Mobile Laser Scanning – System development, performance and applications , 2013 .

[11]  Per-Erik Forssén,et al.  Trajectory representation and landmark projection for continuous-time structure from motion , 2018, Int. J. Robotics Res..

[12]  Paul Timothy Furgale,et al.  Continuous-time batch estimation using temporal basis functions , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  George Vosselman,et al.  Automatic extraction of accurate 3D tie points for trajectory adjustment of mobile laser scanners using aerial imagery , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[14]  Ryan M. Eustice,et al.  Visual localization within LIDAR maps for automated urban driving , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  G. Hunter,et al.  DEVELOPMENT OF A COMMERCIAL LASER SCANNING MOBILE MAPPING SYSTEM-STREETMAPPER , 2006 .

[16]  V. Lehtola,et al.  INTEGRATING A LOW-COST MEMS IMU INTO A LASER-BASED SLAM FOR INDOOR MOBILE MAPPING , 2019 .

[17]  Fulvio Rinaudo,et al.  Multiple scan registration in LIDAR close-range applications , 2003 .

[18]  Yueming Zhao GPS/IMU Integrated System for Land Vehicle Navigation based on MEMS , 2011 .

[19]  Daniel Cremers,et al.  Real-time trajectory replanning for MAVs using uniform B-splines and a 3D circular buffer , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  C. Rizos,et al.  Improving Adaptive Kalman Estimation in GPS/INS Integration , 2007, Journal of Navigation.

[21]  Gabe Sibley,et al.  A Spline-Based Trajectory Representation for Sensor Fusion and Rolling Shutter Cameras , 2015, International Journal of Computer Vision.

[22]  Yanlei Gu,et al.  Factors to Evaluate Capability of Map for Vehicle Localization , 2018, IEEE Access.