ROBUST AND ACCURATE IMAGE-BASED GEOREFERENCING EXPLOITING RELATIVE ORIENTATION CONSTRAINTS

Abstract. Urban environments with extended areas of poor GNSS coverage as well as indoor spaces that often rely on real-time SLAM algorithms for camera pose estimation require sophisticated georeferencing in order to fulfill our high requirements of a few centimeters for absolute 3D point measurement accuracies. Since we focus on image-based mobile mapping, we extended the structure-from-motion pipeline COLMAP with georeferencing capabilities by integrating exterior orientation parameters from direct sensor orientation or SLAM as well as ground control points into bundle adjustment. Furthermore, we exploit constraints for relative orientation parameters among all cameras in bundle adjustment, which leads to a significant robustness and accuracy increase especially by incorporating highly redundant multi-view image sequences. We evaluated our integrated georeferencing approach on two data sets, one captured outdoors by a vehicle-based multi-stereo mobile mapping system and the other captured indoors by a portable panoramic mobile mapping system. We obtained mean RMSE values for check point residuals between image-based georeferencing and tachymetry of 2 cm in an indoor area, and 3 cm in an urban environment where the measurement distances are a multiple compared to indoors. Moreover, in comparison to a solely image-based procedure, our integrated georeferencing approach showed a consistent accuracy increase by a factor of 2–3 at our outdoor test site. Due to pre-calibrated relative orientation parameters, images of all camera heads were oriented correctly in our challenging indoor environment. By performing self-calibration of relative orientation parameters among respective cameras of our vehicle-based mobile mapping system, remaining inaccuracies from suboptimal test field calibration were successfully compensated.

[1]  Andrea Fusiello,et al.  Hierarchical structure-and-motion recovery from uncalibrated images , 2015, Comput. Vis. Image Underst..

[2]  Stephan Nebiker,et al.  STEREOVISION MOBILE MAPPING: SYSTEM DESIGN AND PERFORMANCE EVALUATION , 2012 .

[3]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Stephan Nebiker,et al.  INTEGRATED GEOREFERENCING OF STEREO IMAGE SEQUENCES CAPTURED WITH A STEREOVISION MOBILE MAPPING SYST , 2012 .

[5]  M. Rothermel,et al.  Benchmarking High Density Image Matching for Oblique Airborne Imagery , 2014 .

[6]  Stephan Nebiker,et al.  DEVELOPMENT OF A PORTABLE HIGH PERFORMANCE MOBILE MAPPING SYSTEM USING THE ROBOT OPERATING SYSTEM , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[8]  S. Nebiker,et al.  FUSION OF AIRBORNE AND TERRESTRIAL IMAGE-BASED 3D MODELLING FOR ROAD INFRASTRUCTURE MANAGEMENT VIS , 2012 .

[9]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Stephan Nebiker,et al.  Cloud-Based Geospatial 3D Image Spaces - A Powerful Urban Model for the Smart City , 2015, ISPRS Int. J. Geo Inf..

[11]  N. Haala,et al.  Mobile LiDAR mapping for 3D point cloud collecation in urban areas : a performance test , 2008 .

[12]  David Martin,et al.  Street View Motion-from-Structure-from-Motion , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  S. Blaser,et al.  DESIGN AND IMPLEMENTATION OF A NOVEL PORTABLE 360° STEREO CAMERASYSTEM WITH LOW-COST ACTION CAMERAS , 2017 .

[14]  Horst Bischof,et al.  Evaluations on multi-scale camera networks for precise and geo-accurate reconstructions from aerial and terrestrial images with user guidance , 2017, Comput. Vis. Image Underst..

[15]  Torsten Sattler,et al.  Comparative Evaluation of Hand-Crafted and Learned Local Features , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[17]  Juha Hyyppä,et al.  Comparison of the Selected State-Of-The-Art 3D Indoor Scanning and Point Cloud Generation Methods , 2017, Remote. Sens..

[18]  Stephan Nebiker,et al.  SYSTEM DESIGN, CALIBRATION AND PERFORMANCE ANALYSIS OF A NOVEL 360° STEREO PANORAMIC MOBILE MAPPING SYSTEM , 2017 .

[19]  Johannes L. Schonberger,et al.  Structure-from-motion for MAV image sequence analysis with photogrammetric applications , 2014 .

[20]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[21]  N. Haala,et al.  a Systematic Comparison of Direct and Image-Based Georeferencing in Challenging Urban Areas , 2016 .

[22]  Fabio Remondino,et al.  Aerial multi-camera systems: Accuracy and block triangulation issues , 2015 .

[23]  Pedro Arias,et al.  Review of mobile mapping and surveying technologies , 2013 .

[24]  P.L.H. Jende,et al.  FULLY AUTOMATIC FEATURE-BASED REGISTRATION OF MOBILE MAPPING AND AERIAL NADIR IMAGES FOR ENABLING THE ADJUSTMENT OF MOBILE PLATFORM LOCATIONS IN GNSS-DENIED URBAN ENVIRONMENTS , 2017 .

[25]  Lei Yan,et al.  RBA: Reduced Bundle Adjustment for oblique aerial photogrammetry , 2016 .

[26]  Norbert Pfeifer,et al.  EFFICIENT ORIENTATION AND CALIBRATION OF LARGE AERIAL BLOCKS OF MULTI-CAMERA PLATFORMS , 2016 .

[27]  Martin Rehak Integrated Sensor Orientation on Micro Aerial Vehicles , 2017 .

[28]  Mathias Rothermel,et al.  EVALUATION OF MATCHING STRATEGIES FOR IMAGE-BASED MOBILE MAPPING , 2015 .

[29]  Stefan Cavegn,et al.  Image-Based Mobile Mapping for 3D Urban Data Capture , 2016 .

[30]  Fabio Remondino,et al.  Investigation of indoor and outdoor performance of two portable mobile mapping systems , 2017, Optical Metrology.

[31]  Ana Paula Kersting,et al.  NEW METHOD FOR THE CALIBRATION OF MULTI-CAMERA MOBILE MAPPING SYSTEMS , 2012 .