Context-based automatic reconstruction and texturing of 3D urban terrain for quick-response tasks

Highly detailed 3D urban terrain models are the base for quick response tasks with indispensable human participation, e.g., disaster management. Thus, it is important to automate and accelerate the process of urban terrain modeling from sensor data such that the resulting 3D model is semantic, compact, recognizable, and easily usable for training and simulation purposes. To provide essential geometric attributes, buildings and trees must be identified among elevated objects in digital surface models. After building ground-plan estimation and roof details analysis, images from oblique airborne imagery are used to cover building faces with up-to-date texture thus achieving a better recognizability of the model. The three steps of the texturing procedure are sensor pose estimation, assessment of polygons projected into the images, and texture synthesis. Free geographic data, providing additional information about streets, forest areas, and other topographic object types, suppress false alarms and enrich the reconstruction results.

[1]  Jochen Meidow.  Effcient Multiple Loop Adjustment for Computer Vision Tasks , 2012 .

[2]  Michael Arens,et al.  Real-time 2D video/3D LiDAR registration , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  C. Heipke,et al.  Context-based urban terrain reconstruction from uav-videos for geoinformation applications , 2012 .

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[6]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[7]  Sabry F. El-Hakim,et al.  A multi-sensor approach to creating accurate virtual environments 1 Revised version of a paper prese , 1998 .

[8]  F. Leberl,et al.  INTERPRETATION OF 2D AND 3D BUILDING DETAILS ON FACADES AND ROOFS , 2013 .

[9]  Jiann-Yeou Rau,et al.  Automatic roof model reconstruction from ALS data and 2D ground plans based on side projection and the TMR algorithm , 2011 .

[10]  Christian Beder,et al.  Incremental estimation without specifying a-priori covariance matrices for the novel parameters , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Andrew Zisserman,et al.  A PLANE-SWEEP STRATEGY FOR THE 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE IMAGES , 2000 .

[12]  Wolfgang Middelmann,et al.  An Efficient Parallel Algorithm for Graph-Based Image Segmentation , 2009, CAIP.

[13]  Dimitri Bulatov,et al.  Detection of Small Roof Details in Image Sequences , 2013, SCIA.

[14]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Anton Osokin,et al.  Fast Approximate Energy Minimization with Label Costs , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Norbert Haala,et al.  Dense Multi-Stereo Matching for High Quality Digital Elevation Models , 2012 .

[17]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[18]  John E. Lavery.  Shape-preserving approximation of multiscale univariate data by cubic L1 spline fits , 2004, Comput. Aided Geom. Des..

[19]  C. Brenner,et al.  3D URBAN GIS FROM LASER ALTIMETER AND 2D MAP DATA , 1997 .

[20]  H. Gross,et al.  3D-MODELING OF URBAN STRUCTURES , 2005 .

[21]  C. Heipke,et al.  Multi-view dense matching supported by triangular meshes , 2011 .

[22]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[23]  J. Lavery,et al.  Reconstruction and Texturing of 3D Urban Terrain from Uncalibrated Monocular Images Using L 1 Splines , 2010 .

[24]  Jan Boehm.  Multi-image fusion for occlusion-free faÇade texturing , 2004 .

[25]  Helmut Mayer.  3D Reconstruction and Visualization of Urban Scenes from Uncalibrated Wide-Baseline Image Sequences , 2008 .

[26]  Olof Henricsson,et al.  Analysis of image structures using color attributes and similarity relations , 1996 .

[27]  Vivek Verma,et al.  3D Building Detection and Modeling from Aerial LIDAR Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  Peter Solbrig,et al.  Ad-hoc model acquisition for combat simulation in urban terrain , 2012, Remote Sensing.

[29]  Florent Lafarge,et al.  A Hybrid Multiview Stereo Algorithm for Modeling Urban Scenes , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[32]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[33]  Klamer Schutte,et al.  Efficient trajectory bending with applications to loop closure , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Claus Brenner.  TOWARDS FULLY AUTOMATIC GENERATION OF CITY MODELS , 2000 .

[35]  Karsten Schulz,et al.  CONTEXT-BASED URBAN TERRAIN RECONSTRUCTION FROM IMAGES AND VIDEOS , 2012 .

[36]  Yoonseok Jwa,et al.  AN IMPLICIT REGULARIZATION FOR 3D BUILDING ROOFTOP MODELING USING AIRBORNE LIDAR DATA , 2012 .

[37]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[39]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  George Vosselman,et al.  Building Reconstruction by Target Based Graph Matching on Incomplete Laser Data: Analysis and Limitations , 2009, Sensors.

[42]  C. Brenner,et al.  A generative statistical approach to automatic 3D building roof reconstruction from laser scanning data , 2013 .