Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings

This paper surveys the state-of-the-art automatic object extraction techniques from aerial imagery. It focuses on building extraction approaches, which present the majority of the work in this area. After proposing well-defined criteria for their assessment, characteristic approaches are selected and assessed, based on their models and strategies. The assessment gives rise to a combined model and strategy covering the current knowledge in the field. The model comprises: the derivation of characteristic properties from the function of objects; three-dimensional geometry and material properties; scales and levels of abstraction/aggregation; local and global context. The strategy consists of grouping, focusing on different scales, context-based control and generation of evidence from structures of parts, and fusion of data and algorithms. Many ideas which have not been explored in depth lead to promising directions for further research.

[1]  Theodosios Pavlidis,et al.  Why progress in machine vision is so slow , 1992, Pattern Recognit. Lett..

[2]  Carsten Steger,et al.  Scale-space events and their link to abstraction for road extraction , 1998 .

[3]  J. Jolion.  Computer vision methodologies , 1994 .

[4]  Allen R. Hanson,et al.  The Ascender System: Automated Site Modeling from Multiple Aerial Images , 1998, Comput. Vis. Image Underst..

[5]  L. W. Fritz.  The era of commercial earth observation satellites , 1996 .

[6]  Uwe Stilla,et al.  Semantic Modelling of Man-Made Objects by Production Nets , 1997 .

[7]  Taejung Kim,et al.  Building Extraction Building Extraction and Verification from Spaceborne and Aerial Imagery using Image Understanding Fusion Techniques , 1995 .

[8]  Frank Ade,et al.  The Role of Artificial Intelligence in the Reconstruction of Man-made Objects from Aerial Images , 1997 .

[9]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[10]  Olivier Jamet,et al.  Vehicle detection on aerial images: a structural approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Luc Van Gool,et al.  Automatic Modeling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery , 1998, ECCV.

[12]  Håkan Wiman.  Least Squares Matching for Three Dimensional Building Reconstruction , 1997 .

[13]  Eberhard Gülch.  Application of Semi-Automatic Building Acquisition , 1997 .

[14]  Ramakant Nevatia,et al.  Including interaction in an automated modelling system , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[15]  Bernd Radig,et al.  Model-Based Road Extraction from Images , 1995 .

[16]  Pascal Fua,et al.  Resegmentation using generic shape: Locating general cultural objects , 1987, Pattern Recognit. Lett..

[17]  E. Baltsavias,et al.  Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) , 1995 .

[18]  Olof Henricsson,et al.  Analysis of image structures using color attributes and similarity relations , 1996 .

[19]  Gottfried Konecny,et al.  Mapping from digital satellite image data with special reference to MOMS-02 , 1996 .

[20]  Frederic Fol Leymarie,et al.  From Manual to Automatic Stereoplotting: Evaluation of Different Road Network Capture Processes , 1996 .

[21]  Uwe Weidner.  Digital Surface Models for Building Extraction , 1997 .

[22]  Christoph Hug,et al.  Extracting Artificial Surface Objects from Airborne Laser Scanner Data , 1997 .

[23]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[24]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[25]  Armin Gruen,et al.  TOBAGO — a topology builder for the automated generation of building models , 1997 .

[26]  C. Steger,et al.  Multi-Resolution, Semantic Objects, and Context for Road Extraction , 1997 .

[27]  G. Giraudon,et al.  High-resolution Stereo for the Detection of Buildings , 1995 .

[28]  Ralf Tönjes,et al.  Control of scene reconstruction using explicit knowledge , 1996, WACV.

[29]  Wolfgang Förstner,et al.  Models for photogrammetric building reconstruction , 1995, Comput. Graph..

[30]  Horst Bischof,et al.  Multispectral classification of Landsat-images using neural networks , 1992, IEEE Trans. Geosci. Remote. Sens..

[31]  Matthieu Cord,et al.  Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery , 1998, Comput. Vis. Image Underst..

[32]  James J. Pearson,et al.  A Testbed for the Evaluation of Feature Extraction Techniques in a Time Constrained Environment , 1997 .

[33]  Klamer Schutte,et al.  A model driven approach to extract buildings from multi-view aerial imagery , 1997 .

[34]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[35]  E. Baltsavias,et al.  Image-Based Reconstruction of Informal Settlements , 1997 .

[36]  Olof Henricsson,et al.  The Role of Color Attributes and Similarity Grouping in 3-D Building Reconstruction , 1998, Comput. Vis. Image Underst..

[37]  Claus Brenner,et al.  Interpretation of Urban Surface Models Using 2D Building Information , 1998, Comput. Vis. Image Underst..

[38]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[39]  E. Baltsavias,et al.  3-D Building Reconstruction with ARUBA: A Qualitative and Quantitative Evaluation , 1997 .

[40]  Yuan C. Hsieh,et al.  Performance analysis of object-space matching for building extraction using several images , 1995, Defense, Security, and Sensing.

[41]  Thomas O. Binford,et al.  Ignorance, myopia, and naiveté in computer vision systems , 1991, CVGIP Image Underst..

[42]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[43]  Pascal Fua,et al.  Imposing Hard Constraints on Soft Snakes , 1996, ECCV.

[44]  L. Stark,et al.  Dissertation Abstract , 1994, Journal of Cognitive Education and Psychology.

[45]  Takeo Kanade,et al.  The 3D MOSAIC Scene Understanding System , 1983, IJCAI.

[46]  Takashi Matsuyama,et al.  SIGMA: A Knowledge-Based Aerial Image Understanding System , 1990 .

[47]  Philippe Montesinos,et al.  An image analysis, application for aerial imagery interpretation , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[48]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[49]  Allen R. Hanson,et al.  Extracting surface textures and microstructures from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Robert T. Collins,et al.  Task driven perceptual organization for extraction of rooftop polygons , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[51]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  T. Kanade,et al.  The 3D MOSAIC scene understanding system: incremental reconstruction of 3D scenes for complex images , 1987 .

[53]  Ivan Laptev,et al.  Multi-scale and Snakes for Automatic Road Extraction , 1998, ECCV.

[54]  Henri Maitre,et al.  Three-Dimensional Description of Dense Urban Areas using Maps and Aerial Images , 1997 .

[55]  Henri Maitre,et al.  Above-Ground Objects in Urban Scenes from Medium Scale Aerial Imagery , 1997 .

[56]  John P. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Martial Hebert,et al.  Report on the 1996 International Workshop on Object Representation in Computer Vision , 1996, Object Representation in Computer Vision.

[58]  Oliver Grau,et al.  A scene analysis system for the generation of 3-D models , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[59]  Franz Quint.  MOSES: A Structural Approach to Aerial Image Understanding , 1997 .

[60]  Haihong Li,et al.  Linear Feature Extraction with 3-D LSB-Snakes , 1997 .

[61]  Ramakant Nevatia,et al.  A System for Building Detection from Aerial Images , 1997 .