Context-based urban terrain reconstruction from uav-videos for geoinformation applications

Urban terrain reconstruction has many applications in areas of civil engineering, urban planning, surveillance and defense research. Therefore the needs of covering ad-hoc demand and performing a close-range urban terrain reconstruction with miniaturized and relatively inexpensive sensor platforms are constantly growing. Using (miniaturized) unmanned aerial vehicles, (M)UAVs, represents one of the most attractive alternatives to conventional large-scale aerial imagery. We cover in this paper a four-step procedure of obtaining georeferenced 3D urban models from video sequences. The four steps of the procedure – orientation, dense reconstruction, urban terrain modeling and geo-referencing – are robust, straight-forward, and nearly fully-automatic. The two last steps – namely, urban terrain modeling from almost-nadir videos and co-registration of models 6ndash; represent the main contribution of this work and will therefore be covered with more detail. The essential substeps of the third step include digital terrain model (DTM) extraction, segregation of buildings from vegetation, as well as instantiation of building and tree models. The last step is subdivided into quasi- intrasensorial registration of Euclidean reconstructions and intersensorial registration with a geo-referenced orthophoto. Finally, we present reconstruction results from a real data-set and outline ideas for future work.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  J. B. Burns,et al.  Extracting straight lines , 1987 .

[4]  Przemyslaw Prusinkiewicz,et al.  Lindenmayer Systems, Fractals, and Plants , 1989, Lecture Notes in Biomathematics.

[5]  Jarek Rossignac,et al.  Multi-resolution 3D approximations for rendering complex scenes , 1993, Modeling in Computer Graphics.

[6]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[7]  George Vosselman,et al.  3D BUILDING MODEL RECONSTRUCTION FROM POINT CLOUDS AND GROUND PLANS , 2001 .

[8]  David Nister,et al.  Automatic Dense Reconstruction from Uncalibrated Video Sequences , 2001 .

[9]  Jiri Matas,et al.  Randomized RANSAC with T(d, d) test , 2002, BMVC.

[10]  O. Chum,et al.  2 Randomized RANSAC , 2002 .

[11]  Jiri Matas,et al.  Randomized RANSAC with Td, d test , 2004, Image Vis. Comput..

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[14]  H. Gross,et al.  3D-MODELING OF URBAN STRUCTURES , 2005 .

[15]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[16]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  H. Hirschmüller Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[18]  Gérard G. Medioni,et al.  Map-Enhanced UAV Image Sequence Registration , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[19]  H. Hirschmüller Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Ulrich Thoennessen,et al.  Online annotation of airborne surveillance and reconnaissance videos , 2008, 2008 11th International Conference on Information Fusion.

[21]  Dimitri Bulatov,et al.  Towards Euclidean Reconstruction From Video Sequences , 2008, VISAPP.

[22]  Eckart Michaelsen,et al.  A GOOGLE-earth based test bed for structural image-based UAV navigation , 2009, 2009 12th International Conference on Information Fusion.

[23]  Franz Rottensteiner,et al.  Roof plane segmentation by combining multiple images and point clouds , 2010 .

[24]  C. Heipke,et al.  Multi-view dense matching supported by triangular meshes , 2011 .