Automatic building detection and 3D shape recovery from single monocular electro-optic imagery

The extraction of 3D building geometric information from high-resolution electro-optical imagery is becoming a key element in numerous geospatial applications. Indeed, producing 3D urban models is a requirement for a variety of applications such as spatial analysis of urban design, military simulation, and site monitoring of a particular geographic location. However, almost all operational approaches developed over the years for 3D building reconstruction are semiautomated ones, where a skilled human operator is involved in the 3D geometry modeling of building instances, which results in a time-consuming process. Furthermore, such approaches usually require stereo image pairs, image sequences, or laser scanning of a specific geographic location to extract the 3D models from the imagery. Finally, with current techniques, the 3D geometric modeling phase may be characterized by the extraction of 3D building models with a low accuracy level. This paper describes the Automatic Building Detection (ABD) system and embedded algorithms currently under development. The ABD system provides a framework for the automatic detection of buildings and the recovery of 3D geometric models from single monocular electro-optic imagery. The system is designed in order to cope with multi-sensor imaging of arbitrary viewpoint variations, clutter, and occlusion. Preliminary results on monocular airborne and spaceborne images are provided. Accuracy assessment of detected buildings and extracted 3D building models from single airborne and spaceborne monocular imagery of real scenes are also addressed. Embedded algorithms are evaluated for their robustness to deal with relatively dense and complicated urban environments.

[1]  J. Shan,et al.  CLASS-GUIDED BUILDING EXTRACTION FROM IKONOS IMAGERY , 2003 .

[2]  Hervé Le Men,et al.  Efficient Subgraph Isomorphism with 'A Priori' Knowledge (Application to 3D Reconstruction of Buildings for Cartography) , 2000, SSPR/SPR.

[3]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[4]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[5]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geospatial data and knowledge , 2002 .

[6]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems☆ , 2004 .

[7]  Ansgar Brunn,et al.  Extracting Buildings from Digital Surface models , 1997 .

[8]  G. Sohn,et al.  Extraction of buildings from high-resolution satellite data and airborne Lidar , 2000 .

[9]  Andrew Zisserman,et al.  A PLANE-SWEEP STRATEGY FOR THE 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE IMAGES , 2000 .

[10]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[12]  Curt H. Davis,et al.  A hierarchical fuzzy classification approach for high-resolution multispectral data over urban areas , 2003, IEEE Trans. Geosci. Remote. Sens..

[13]  Clive S. Fraser,et al.  Processing of Ikonos imagery for submetre 3D positioning and building extraction , 2002 .

[14]  Richard W. Christiansen,et al.  A shadow detection and removal algorithm for 2-D images , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[15]  Ramakant Nevatia,et al.  Automatic and interactive modeling of buildings in urban environments from aerial images , 2002, Proceedings. International Conference on Image Processing.

[16]  T. Toutin,et al.  3D MODELS FOR HIGH RESOLUTION IMAGES: EXAMPLES WITH QUICKBIRD, IKONOS AND EROS , 2002 .

[17]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[18]  Luc Van Gool,et al.  A probabilistic approach to roof extraction and reconstruction , 2002 .

[19]  Josiane Zerubia,et al.  Building extraction from digital elevation models , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[20]  A. Grün,et al.  Semi-automated approaches to site recording and modeling , 2000 .

[21]  D. Fritsch,et al.  AUTOMATIC 3D BUILDING RECONSTRUCTION USING PLANE-ROOF STRUCTURES , 2000 .

[22]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[23]  T. H. Kolbe,et al.  Integration of 2D and 3D reasoning for building reconstruction using a generic hierarchical model , 1997 .

[24]  Chad Hendrix,et al.  A Comparison of Urban Mapping Methods Using High-Resolution Digital Imagery , 2003 .