On Applications of Sequential Multi-view Dense Reconstruction from Aerial Images

Because of an increasing need and a rapid progress in the development of (unmanned) aerial vehicles and optical sensors that can be mounted onboard of these sensor platforms, there is also a considerable progress in 3D analysis of airand UAV-borne video sequences. This work presents a robust method for multi-camera dense reconstruction as well as two important applications: creation of dense point clouds with precise 3D coordinates and, in the case of videos with Nadir perspective, a context-based method for urban terrain modeling. This method, which represents the main contribution of this work, includes automatic generation of digital terrain models (DTM), extraction of building outlines, modeling and texturing roof surfaces. A simple interactive method for vegetation segmentation is described as well.

[1]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[2]  Uwe Stilla,et al.  SEGMENTATION OF LASER ALTIMETER DATA FOR BUILDING RECONSTRUCTION: DIFFERENT PROCEDURES AND COMPARISON , 2000 .

[3]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[4]  Michael Arens,et al.  Accurate Single Image Multi-modal Camera Pose Estimation , 2010, ECCV Workshops.

[5]  C. Heipke,et al.  Multi-view dense matching supported by triangular meshes , 2011 .

[6]  Andrew Zisserman,et al.  A PLANE-SWEEP STRATEGY FOR THE 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE IMAGES , 2000 .

[7]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[8]  Dimitri Bulatov,et al.  Towards Euclidean Reconstruction From Video Sequences , 2008, VISAPP.

[9]  H. Gross,et al.  3D-MODELING OF URBAN STRUCTURES , 2005 .

[10]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[11]  Franz Rottensteiner,et al.  Roof plane segmentation by combining multiple images and point clouds , 2010 .

[12]  HelmutMayer,et al.  AUTOMATED 3 D RECONSTRUCTION OF URBAN AREAS FROM NETWORKS OF WIDE-BASELINE IMAGE SEQUENCES , 2008 .

[13]  Leif Kobbelt,et al.  A survey of point-based techniques in computer graphics , 2004, Comput. Graph..

[14]  H. Hirschmüller.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[15]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[16]  Wei Zhang,et al.  Computationally Efficient Models of Urban and Natural Terrain by Non-Iterative Domain Decomposition for L1 Smoothing Splines , 2006 .

[17]  J. Lavery,et al.  Reconstruction and Texturing of 3D Urban Terrain from Uncalibrated Monocular Images Using L 1 Splines , 2010 .