FULLY AUTOMATIC FEATURE-BASED REGISTRATION OF MOBILE MAPPING AND AERIAL NADIR IMAGES FOR ENABLING THE ADJUSTMENT OF MOBILE PLATFORM LOCATIONS IN GNSS-DENIED URBAN ENVIRONMENTS

Abstract. Mobile Mapping (MM) has gained significant importance in the realm of high-resolution data acquisition techniques. MM is able to record georeferenced street-level data in a continuous (laser scanners) and/or discrete (cameras) fashion. MM’s georeferencing relies on a conjunction of Global Navigation Satellite Systems (GNSS), Inertial Measurement Units (IMU) and optionally on odometry sensors. While this technique does not pose a problem for absolute positioning in open areas, its reliability and accuracy may be diminished in urban areas where high-rise buildings and other tall objects can obstruct the direct line-of-sight between the satellite and the receiver unit. Consequently, multipath measurements or complete signal outages impede the MM platform’s localisation and may affect the accurate georeferencing of collected data. This paper presents a technique to recover correct orientation parameters for MM imaging platforms by utilising aerial images as an external georeferencing source. This is achieved by a fully automatic registration strategy which takes into account the overall differences between aerial and MM data, such as scale, illumination, perspective and content. Based on these correspondences, MM data can be verified and/or corrected by using an adjustment solution. The registration strategy is discussed and results in a success rate of about 95 %.

[1]  Li-Ta Hsu,et al.  GNSS/Onboard Inertial Sensor Integration With the Aid of 3-D Building Map for Lane-Level Vehicle Self-Localization in Urban Canyon , 2016, IEEE Transactions on Vehicular Technology.

[2]  P. Groves,et al.  GNSS multipath detection using three-frequency signal-to-noise measurements , 2016, GPS Solutions.

[3]  Paul D. Groves,et al.  A Portfolio Approach to NLOS and Multipath Mitigation in Dense Urban Areas , 2013 .

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  N. Haala,et al.  a Systematic Comparison of Direct and Image-Based Georeferencing in Challenging Urban Areas , 2016 .

[6]  K. Wallis Seasonal Adjustment and Relations Between Variables , 1974 .

[7]  G. Vosselman,et al.  LOW-LEVEL TIE FEATURE EXTRACTION OF MOBILE MAPPING DATA (MLS/IMAGES) AND AERIAL IMAGERY , 2016 .

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[9]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[10]  Andreas Schindler Vehicle Self-localization Using High-precision Digital Maps , 2013 .

[11]  Akihiro Yamamoto,et al.  Visual Odometry by Multi-frame Feature Integration , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[12]  Jen-Yu Han,et al.  Adaptive time-variant adjustment for the positioning errors of a mobile mapping platform in GNSS-hostile areas , 2017 .

[13]  G. Vosselman,et al.  ADVANCED TIE FEATURE MATCHING FOR THE REGISTRATION OF MOBILE MAPPING IMAGING DATA AND AERIAL IMAGERY , 2016 .

[14]  Claus Brenner,et al.  ACCURACY ASSESSMENT OF MOBILE MAPPING POINT CLOUDS USING THE EXISTING ENVIRONMENT AS TERRESTRIAL REFERENCE , 2016 .

[15]  Rachid Belaroussi,et al.  Map-aided localization with lateral perception , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[16]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Hyun Chul Roh,et al.  Accurate Mobile Urban Mapping via Digital Map-Based SLAM , 2016, Sensors.