Image-Based Mobile Mapping for 3D Urban Data Capture

Abstract Ongoing innovations in dense multi-view stereo image matching meanwhile allow for 3D data collection using image sequences captured from mobile mapping platforms even in complex and densely built-up areas. However, the extraction of dense and precise 3D point clouds from such street-level imagery presumes high quality georeferencing as a first processing step. While standard direct georeferencing solves this task in open areas, poor GNSS coverage in densely built-up areas and urban canyons frequently prevents sufficient accuracy and reliability. Thus, we use bundle block adjustment, which additionally integrates tie and control point information for precise georeferencing of our multi-camera mobile mapping system. Subsequently, this allows the adaption of a state-of-the-art dense image matching pipeline to provide a suitable 3D representation of the captured urban structures. In addition to the presentation of different processing steps, this paper also provides an evaluation of the achieved image-based 3D capture in a dense urban environment.

[1]  Andreas Geiger,et al.  Object scene flow for autonomous vehicles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Thomas P. Kersten,et al.  Documentation of Istanbul Historic Peninsula by Kinematic Terrestrial Laser Scanning , 2009 .

[3]  Stephan Nebiker,et al.  STEREOVISION MOBILE MAPPING: SYSTEM DESIGN AND PERFORMANCE EVALUATION , 2012 .

[4]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[5]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[6]  Marc Pollefeys,et al.  Efficient 3D reconstruction of large-scale urban environments from street-level video , 2011 .

[7]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  N. Haala,et al.  a Systematic Comparison of Direct and Image-Based Georeferencing in Challenging Urban Areas , 2016 .

[9]  Konrad Schindler,et al.  View-Consistent 3D Scene Flow Estimation over Multiple Frames , 2014, ECCV.

[10]  Mathias Rothermel,et al.  EVALUATION OF MATCHING STRATEGIES FOR IMAGE-BASED MOBILE MAPPING , 2015 .

[11]  Dieter Fritsch,et al.  Filtering of Point Clouds from Photogrammetric Surface Reconstruction , 2014 .

[12]  Norbert Haala,et al.  FAÇADE RECONSTRUCTION USING GEOMETRIC AND RADIOMETRIC POINT CLOUD INFORMATION , 2015 .

[13]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[14]  Stephan Nebiker,et al.  Cloud-Based Geospatial 3D Image Spaces - A Powerful Urban Model for the Smart City , 2015, ISPRS Int. J. Geo Inf..

[15]  Pedro Arias,et al.  Review of mobile mapping and surveying technologies , 2013 .

[16]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[17]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[18]  M. Rothermel,et al.  Benchmarking High Density Image Matching for Oblique Airborne Imagery , 2014 .