Evaluation of Automatic Building Detection Approaches Combining High Resolution Images and LiDAR Data

In this paper, two main approaches for automatic building detection and localization using high spatial resolution imagery and LiDAR data are compared and evaluated: thresholding-based and object-based classification. The thresholding-based approach is founded on the establishment of two threshold values: one refers to the minimum height to be considered as building, defined using the LiDAR data, and the other refers to the presence of vegetation, which is defined according to the spectral response. The other approach follows the standard scheme of object-based image classification: segmentation, feature extraction and selection, and classification, here performed using decision trees. In addition, the effect of the inclusion in the building detection process of contextual relations with the shadows is evaluated. Quality assessment is performed at two different levels: area and object. Area-level evaluates the building delineation performance, whereas object-level assesses the accuracy in the spatial location of individual buildings. The results obtained show a high efficiency of the evaluated methods for building detection techniques, in particular the thresholding-based approach, when the parameters are properly adjusted and adapted to the type of urban landscape considered.

[1]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Monocular Building Extraction From Aerial Imagery , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  D. Zaum ROBUST BUILDING DETECTION IN AERIAL IMAGES , 2005 .

[3]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[4]  Chi-Ren Shyu,et al.  Automated object extraction through simplification of the differential morphological profile for high-resolution satellite imagery , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[5]  J. Hyyppäb,et al.  A TEST OF 2D BUILDING CHANGE DETECTION METHODS: COMPARISON, EVALUATION AND PERSPECTIVES , 2008 .

[6]  M. J. Valadan Zoej,et al.  AUTOMATIC BUILDING DETECTION FROM LIDAR POINT CLOUD DATA , 2008 .

[7]  Christian Heipke,et al.  High Resolution Earth Imaging for Geospatial Information , 2012 .

[8]  Alexandre Bernardino,et al.  Acquisition of 3D regular prismatic models in urban environments from DSM and orthoimages , 2006, CompIMAGE.

[9]  Curt H. Davis,et al.  Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information , 2005, EURASIP J. Adv. Signal Process..

[10]  Tee-Ann Teo,et al.  Fusion of lidar data and optical imagery for building modeling , 2004 .

[11]  Xiaoling Chen,et al.  BUILDING BOUNDARY EXTRACTION FROM HIGH RESOLUTION IMAGERY AND LIDAR DATA , 2008 .

[12]  Masashi Matsuoka,et al.  LiDAR SIGNATURES TO UPDATE JAPANESE BUILDING INVENTORY DATABASE , 2004 .

[13]  P. Dare Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas , 2005 .

[14]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[15]  C. M. Gold,et al.  BUILDING RECONSTRUCTION USING LIDAR DATA , 2005 .

[16]  H.-Y. Li,et al.  A New Solution of Automatic Building Extraction in Remote Sensing Images , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[17]  Jinfei Wang,et al.  OBJECT-ORIENTED IMAGE CLASSIFICATION FOR URBAN BUILDING BOUNDARY EXTRACTION FROM IKONOS IMAGERY , 2007 .

[18]  G. Vozikisa,et al.  Advantages and Disadvantages of the Hough Transformation in the Frame of Automated Building Extraction , 2008 .

[19]  Li Zhang,et al.  An object-based two-stage method for a detailed classification of urban landscape components by integrating airborne LiDAR and color infrared image data: A case study of downtown Houston , 2009, 2009 Joint Urban Remote Sensing Event.

[20]  S. D. Mayungaa,et al.  SEMI-AUTOMATIC BUILDING EXTRACTION UTILIZING QUICKBIRD IMAGERY , 2005 .

[21]  N. Champion 2D BUILDING CHANGE DETECTION FROM HIGH RESOLUTION AERIAL IMAGES AND CORRELATION DIGITAL SURFACE MODELS , 2007 .

[22]  John Trinder,et al.  Building Detection Using LIDAR Data and Multispectral Images , 2003, DICTA.

[23]  D. Jie-shan,et al.  GENERALIZATION OF BUILDING POLYGONS EXTRACTED FROM IKONOS IMAGERY , 2002 .

[24]  Shu-Ching Chen,et al.  Automatic Construction of Building Footprints From Airborne LIDAR Data , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Fumio Yamazaki,et al.  AUTOMATIC DETECTION OF BUILDING PROPERTIES FROM AERIAL PHOTOGRAPHS USING COLOR AND 3D CONFIGURATION , 2001 .

[26]  Allan Aasbjerg Nielsen,et al.  Detection of buildings through multivariate analysis of spectral, textural, and shape based features , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Juha Hyyppä,et al.  CLASSIFICATION TREE BASED BUILDING DETECTION FROM LASER SCANNER AND AERIAL IMAGE DATA , 2007 .

[28]  Yoav Freund,et al.  Boosting a weak learning algorithm by majority , 1995, COLT '90.

[29]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[30]  Lu Hanqing,et al.  Building extraction in urban areas from satellite images using GIS data as prior information , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[31]  J. Weber,et al.  Automatic Building Extraction in VHR Images Using Advanced Morphological Operators , 2007, 2007 Urban Remote Sensing Joint Event.

[32]  Alberta Bianchin,et al.  Remote Sensing and Urban Analysis , 2008, Communication Systems and Applications.

[33]  D. Morin,et al.  BUILDING EXTRACTION FROM VERY HIGH SPATIAL RESOLUTION IMAGE , 2004 .

[34]  Zhengjun Liu,et al.  Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[35]  Brian Pilemann Olsen,et al.  AUTOMATIC CHANGE DETECTION FOR VALIDATION OF DIGITAL MAP DATABASES , 2004 .

[36]  Terry Caelli,et al.  Building Detection Using Bayesian Networks , 2000, Int. J. Pattern Recognit. Artif. Intell..

[37]  Victor J. D. Tsai,et al.  Automatic shadow detection and radiometric restoration on digital aerial images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[38]  Gu Haiyan,et al.  Fusion of High-resolution Aerial Imagery and Lidar Data for Object-oriented Urban Landcover Classification Based on Svm , 2007 .

[39]  J. Shan,et al.  CLASS-GUIDED BUILDING EXTRACTION FROM IKONOS IMAGERY , 2003 .

[40]  Hanqing Lu,et al.  Building extraction in urban areas from satellite images using GIS data as prior information , 2004, IEEE International Geoscience and Remote Sensing Symposium.

[41]  Tilman Bucher,et al.  Mapping and updating maps in dense urban regions using high resolution digital airborne imagery, surface models and object-based classification , 2008 .

[42]  G. Buyuksalih,et al.  OBJECT-ORIENTED IMAGE ANALYSIS AND SEMANTIC NETWORK FOR EXTRACTING THE ROADS AND BUILDINGS FROM IKONOS PAN-SHARPENED IMAGES , 2004 .

[43]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[44]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[45]  Curt H. Davis,et al.  Automated 2-D building footprint extraction from high-resolution satellite multispectral imagery , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[46]  Fevzi Karsli,et al.  BUILDING EXTRACTION FROM LASER SCANNING DATA , 2008 .

[47]  Hamid Ebadi,et al.  AUTOMATIC EXTRACTION OF BUILDING FEATURES FROM HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS , 2007 .

[48]  G. Sohn,et al.  Extraction of buildings from high-resolution satellite data and airborne Lidar , 2000 .

[49]  Hichem Sahli,et al.  A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Ruijin Ma DEM Generation and Building Detection from Lidar Data , 2005 .

[51]  Frederic Devernay,et al.  Using robust methods for automatic extraction of buildings , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[52]  Wei Liu,et al.  Building detection from high-resolution satellite image using probability model , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[53]  Josiane Zerubia,et al.  Automatic Building Extraction from DEMs using an Object Approach and Application to the 3D-city Modeling , 2008 .

[54]  Tee-Ann Teo,et al.  OBJECT-BASED BUILDING DETECTION FROM LIDAR DATA AND HIGH RESOLUTION SATELLITE IMAGERY , 2004 .

[55]  George Miliaresis,et al.  Segmentation and object-based classification for the extraction of the building class from LIDAR DEMs , 2007, Comput. Geosci..

[56]  G. Ambrosio,et al.  Detección de sombras en imágenes de satélite de alta resolución Quickbird , 2006 .

[57]  George Vosselman,et al.  Change detection for updating medium scale maps using laster altimetry , 2004 .

[58]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[59]  S. Y. Cui,et al.  BUILDING DETECTION AND RECOGNITION FROM HIGH RESOLUTION REMOTELY SENSED IMAGERY , 2008 .

[60]  Y. Jwa,et al.  Pseudo-Grid Based Building Extraction Using Airborne LIDAR Data , 2004 .

[61]  Txomin Hermosilla,et al.  Original papers: A feature extraction software tool for agricultural object-based image analysis , 2011 .

[62]  Brian C. Lovell,et al.  Building detection by Dempster-Shafer fusion of LIDAR data and multispectral aerial imagery , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[63]  Matthieu Cord,et al.  Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery , 1998, Comput. Vis. Image Underst..

[64]  P. Hofmann,et al.  Detecting informal settlements from QuickBird data in Rio de Janeiro using an object based approach , 2008 .

[65]  David J. Harding,et al.  Topographic mapping from space , 2009, Optical Engineering + Applications.

[66]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[67]  H. Maas,et al.  KNOWLEDGE-BASED BUILDING DETECTION BASED ON LASER SCANNER DATA AND TOPOGRAPHIC MAP INFORMATION , 2002 .

[68]  Zhongming Zhao,et al.  Urban building extraction from high-resolution satellite panchromatic image using clustering and edge detection , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[69]  Yi Lin,et al.  THE CONSTRUCTION OF ANTI-SYMMETRICAL WAVELET AND BUILDING EXTRACTION FROM REMOTE SENSING IMAGERY , 2008 .

[70]  Mustafa Turker,et al.  Building Detection From High-Resolution Satellite Imagery Using Adaptive Fuzzy-Genetic Approach , 2008 .

[71]  Kyung-Ok Kim,et al.  The use of voting strategy for building extraction from high resolution satellite images , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[72]  Pai-Hui Hsu,et al.  Building Detection and Structure Line Extraction from Airborne LiDAR Data , 2007 .

[73]  Ernest L. Hall,et al.  Texture Measures for Automatic Classification of Pulmonary Disease , 1972, IEEE Transactions on Computers.

[74]  Ali Özgün Ok ROBUST DETECTION OF BUILDINGS FROM A SINGLE COLOR AERIAL IMAGE , 2008 .

[75]  Mustafa Turker,et al.  AUTOMATIC BUILDING DETECTION AND DELINEATION FROM HIGH RESOLUTION SPACE IMAGES USING MODEL-BASED APPROACH , 2006 .

[76]  Ramakant Nevatia,et al.  Uncertain Reasoning and Learning for Feature Grouping , 1999, Comput. Vis. Image Underst..

[77]  Jie Shan,et al.  Quality of Building Extraction from IKONOS Imagery , 2005 .

[78]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[79]  Thomas Voegtle,et al.  3D modelling of buildings using laser scanning and spectral information , 2000 .

[80]  Richard W. Christiansen,et al.  A shadow detection and removal algorithm for 2-D images , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[81]  K. Palaniappan,et al.  AUTOMATIC OBJECT EXTRACTION FROM FULL DIFFERENTIAL MORPHOLOGICAL PROFILE IN URBAN IMAGERY FOR EFFICIENT OBJECT INDEXING AND RETRIEVALS , 2005 .

[82]  Yun Zhang,et al.  Semi-Automatic Building Extraction Utilizing QuickBird Imagery , 2005 .

[83]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[84]  AUTOMATIC DETECTION OF CHANGES FROM LASER SCANNER AND AERIAL IMAGE DATA FOR UPDATING BUILDING MAPS , 2004 .

[85]  Michel JORDAN,et al.  Building Detection from High Resolution Digital Elevation Models in Urban Areas , 2002 .

[86]  M. Matsuoka,et al.  SHADOW ANALYSIS IN ASSISTING DAMAGE DETECTION DUE TO EARTHQUAKES FROM QUICKBIRD IMAGERY , 2004 .

[87]  David Declercq,et al.  Three-dimensional building detection and modeling using a statistical approach , 2001, IEEE Trans. Image Process..

[88]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[89]  Jianping Wu,et al.  Automated derivation of urban building density information using airborne LiDAR data and object-based method , 2010 .