Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D

We propose a model-based approach to automated 3D extraction of buildings from aerial images. We focus on a reconstruction strategy that is not restricted to a small class of buildings. Therefore, we employ a generic modeling approach which relies on the well-defined combination of building part models. Building parts are classified by their roof type. Starting from low-level image features we combine data-driven and model-driven processes within a multilevel aggregation hierarchy, thereby using a tight coupling of 2D image and 3D object modeling and processing, ending up in complex 3D building estimations of shape and location. Due to the explicit representation of well-defined processing states in terms of model-based 2D and 3D descriptions at all levels of modeling and data aggregation, our approach reveals a great potential for reliable building extraction.

[1]  J FlynnPatrick,et al.  CAD-Based Computer Vision , 1991 .

[2]  Robert M. Haralick,et al.  A Metric for Comparing Relational Descriptions , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Wolfgang Förstner,et al.  A hybrid concept for 3D building acquisition , 1998 .

[4]  Michael J. Maher,et al.  Constraint Logic Programming: A Survey , 1994, J. Log. Program..

[5]  E. Baltsavias,et al.  Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) , 1995 .

[6]  K. Kanatani Group-Theoretical Methods in Image Understanding , 1990 .

[7]  Anil K. Jain,et al.  CAD-Based Computer Vision: From CAD Models to Relational Graphs , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[9]  Pedro Meseguer,et al.  Constraint Satisfaction Problems: An Overview , 1989, AI Commun..

[10]  Wolfgang Förstner,et al.  A Procedure for Segmenting Surfaces by Symbolic and Iconic Image Fusion , 1996, DAGM-Symposium.

[11]  Olaf Munkelt Aspect-Trees: Generation and Interpretation , 1995, Comput. Vis. Image Underst..

[12]  L. Gool,et al.  3D reconstruction of house roofs from multiple aerial images of urban areas , 1997 .

[13]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[14]  George Vosselman,et al.  Relational Matching , 1992, Lecture Notes in Computer Science.

[15]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[17]  Azriel Rosenfeld,et al.  From volumes to views: An approach to 3-D object recognition , 1992, CVGIP Image Underst..

[18]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[19]  Wolfgang Förstner,et al.  Semantic Modeling for the Acquisition of Topographic Information from Images and Maps: Smati 97 , 1997 .

[20]  Eugene C. Freuder,et al.  Heuristic Methods for Over-Constrained Constraint Satisfaction Problems , 1995, Over-Constrained Systems.

[21]  Robert B. Fisher,et al.  Recognition of Geons by Parametric Deformable Contour Models , 1996, ECCV.

[22]  Sven J. Dickinson,et al.  Integration of quantitative and qualitative techniques for deformable model fitting from orthographic, perspective, and stereo projections , 1993, 1993 (4th) International Conference on Computer Vision.

[23]  Uwe Weidner,et al.  An Approach to Building Extraction from Digital Surface Models , 1996 .

[24]  Anders Heyden,et al.  Consistency and correction of line-drawings, obtained by projections of piecewise planar objects , 1994, eccv 1994.

[25]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[26]  Volker Steinhage,et al.  On the Computation of Visual Events in Aspect Graph Generation , 1997, DAGM-Symposium.

[27]  Wolfgang Förstner,et al.  Models for photogrammetric building reconstruction , 1995, Comput. Graph..

[28]  Katsushi Ikeuchi,et al.  Recent Progress in CAD-Based Vision , 1995, Comput. Vis. Image Underst..

[29]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[30]  Richard J. Wallace,et al.  Partial Constraint Satisfaction , 1989, IJCAI.

[31]  Michael J. Maher,et al.  Over-Constrained Systems , 1995, Lecture Notes in Computer Science.

[32]  Wolfgang Förstner,et al.  Polymorphic grouping for image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[33]  Rina Dechter,et al.  Network-based heuristics for constraint satisfaction problems , 1988 .

[34]  Wolfgang Förstner,et al.  A Framework for Low Level Feature Extraction , 1994, ECCV.

[35]  Amir A. Amini,et al.  Snakes and Splines for Tracking Non-Rigid Heart Motion , 1996, ECCV.

[36]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[37]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[38]  Pascal Fua,et al.  Resegmentation using generic shape: Locating general cultural objects , 1987, Pattern Recognit. Lett..

[39]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[40]  Robert Bergevin,et al.  Generic Object Recognition: Building and Matching Coarse Descriptions from Line Drawings , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Armin B. Cremers,et al.  Using Constraints for the Identification of Buildings in Aerial Images , 1996 .

[42]  Frank Ade,et al.  Project AMOBE, Automation of digital terrain model generation and Mad-made OBject Extraction from aerial images: strategies, current status and future work , 1996 .

[43]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[44]  T. Kanade,et al.  The 3D MOSAIC scene understanding system: incremental reconstruction of 3D scenes for complex images , 1987 .

[45]  Larry S. Davis,et al.  Site model supported monitoring of aerial images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Kevin W. Bowyer,et al.  Aspect graphs: An introduction and survey of recent results , 1990, Int. J. Imaging Syst. Technol..