A Multi-Scale Filtering Building Index for Building Extraction in Very High-Resolution Satellite Imagery

Building extraction plays a significant role in many high-resolution remote sensing image applications. Many current building extraction methods need training samples while it is common knowledge that different samples often lead to different generalization ability. Morphological building index (MBI), representing morphological features of building regions in an index form, can effectively extract building regions especially in Chinese urban regions without any training samples and has drawn much attention. However, some problems like the heavy computation cost of multi-scale and multi-direction morphological operations still exist. In this paper, a multi-scale filtering building index (MFBI) is proposed in the hope of overcoming these drawbacks and dealing with the increasing noise in very high-resolution remote sensing image. The profile of multi-scale average filtering is averaged and normalized to generate this index. Moreover, to fully utilize the relatively little spectral information in very high-resolution remote sensing image, two scenarios to generate the multi-channel multi-scale filtering index (MMFBI) are proposed. While no high-resolution remote sensing image building extraction dataset is open to the public now and the current very high-resolution remote sensing image building extraction datasets usually contain samples from the Northern American or European regions, we offer a very high-resolution remote sensing image building extraction datasets in which the samples contain multiple building styles from multiple Chinese regions. The proposed MFBI and MMFBI outperform MBI and the currently used object based segmentation method on the dataset, with a high recall and F-score. Meanwhile, the computation time of MFBI and MBI is compared on three large-scale very high-resolution satellite image and the sensitivity analysis demonstrates the robustness of the proposed method.

[1]  Qi Bi,et al.  Building Change Detection Based on Multi-Scale Filtering and Grid Partition , 2018, 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[2]  L. Eklundh,et al.  A Comparative analysis of standardised and unstandardised Principal Component Analysis in remote sensing , 1993 .

[3]  W. Barragán,et al.  AUTOMATIC GENERATION OF BUILDING MAPPING USING DIGITAL, VERTICAL AND AERIAL HIGH RESOLUTION PHOTOGRAPHS AND LIDAR POINT CLOUDS , 2016 .

[4]  Yun Zhang,et al.  Optimisation of building detection in satellite images by combining multispectral classification and texture filtering , 1999 .

[5]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[6]  Ali Ozgun Ok,et al.  Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts , 2013 .

[7]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[8]  Shiyong Cui,et al.  BUILDING EXTRACTION FROM REMOTE SENSING DATA USING FULLY CONVOLUTIONAL NETWORKS , 2017 .

[9]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[10]  Jon Atli Benediktsson,et al.  Generalized Differential Morphological Profiles for Remote Sensing Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Liangpei Zhang,et al.  An Efficient and Robust Integrated Geospatial Object Detection Framework for High Spatial Resolution Remote Sensing Imagery , 2017, Remote. Sens..

[12]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Xin Huang,et al.  A Multidirectional and Multiscale Morphological Index for Automatic Building Extraction from Multispectral GeoEye-1 Imagery , 2011 .

[14]  Jiangye Yuan,et al.  Building Extraction at Scale Using Convolutional Neural Network: Mapping of the United States , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[16]  Liangpei Zhang,et al.  A New Building Extraction Postprocessing Framework for High-Spatial-Resolution Remote-Sensing Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Lorenzo Bruzzone,et al.  Histogram based attribute profiles for classification of very high resolution remote sensing images , 2016, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[18]  Chiew Ping Yew Pseudo-Urbanization? Competitive government behavior and urban sprawl in China , 2012 .

[19]  Payman Moallem,et al.  Building extraction from high-resolution satellite images in urban areas: recent methods and strategies against significant challenges , 2016 .

[20]  Xin Huang,et al.  A multiscale urban complexity index based on 3D wavelet transform for spectral–spatial feature extraction and classification: an evaluation on the 8-channel WorldView-2 imagery , 2012 .

[21]  Clive S. Fraser,et al.  An Automatic and Threshold-Free Performance Evaluation System for Building Extraction Techniques From Airborne LIDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[23]  Haigang Sui,et al.  Detecting Damaged Building Regions Based on Semantic Scene Change from Multi-Temporal High-Resolution Remote Sensing Images , 2017, ISPRS Int. J. Geo Inf..

[24]  Jie Shan,et al.  A comprehensive review of earthquake-induced building damage detection with remote sensing techniques , 2013 .

[25]  Yanfei Zhong,et al.  A spectral–structural bag-of-features scene classifier for very high spatial resolution remote sensing imagery , 2016 .

[26]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Xin Xu,et al.  Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery , 2017, Remote. Sens..

[28]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[29]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[31]  Xin Huang,et al.  Automated Detection of Buildings from Heterogeneous VHR Satellite Images for Rapid Response to Natural Disasters , 2017, Remote. Sens..

[32]  Liangpei Zhang,et al.  Scene Classification Based on the Multifeature Fusion Probabilistic Topic Model for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Payman Moallem,et al.  Automatic building extraction in dense urban areas through GeoEye multispectral imagery , 2014 .

[34]  Qian Zhang,et al.  A Morphological Building Detection Framework for High-Resolution Optical Imagery Over Urban Areas , 2016, IEEE Geoscience and Remote Sensing Letters.

[35]  Mohammad Awrangjeb,et al.  Effective Generation and Update of a Building Map Database Through Automatic Building Change Detection from LiDAR Point Cloud Data , 2015, Remote. Sens..

[36]  Pierre Alliez,et al.  Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[37]  Guojun Lu,et al.  An Automatic Building Extraction and Regularisation Technique Using LiDAR Point Cloud Data and Orthoimage , 2016, Remote. Sens..

[38]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jianfa Shen,et al.  Estimating Urbanization Levels in Chinese Provinces in 1982—2000 , 2006 .

[40]  Tao Zhang,et al.  Monitoring of Urban Impervious Surfaces Using Time Series of High-Resolution Remote Sensing Images in Rapidly Urbanized Areas: A Case Study of Shenzhen , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Xiaopeng Zhang,et al.  Building Extraction from Remotely Sensed Images by Integrating Saliency Cue , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Yiming Yan,et al.  Building Extraction Based on an Optimized Stacked Sparse Autoencoder of Structure and Training Samples Using LIDAR DSM and Optical Images , 2017, Sensors.

[43]  Jie Shan,et al.  Urban building extraction through object-based image classification assisted by digital surface model and zoning map , 2016 .

[44]  R. Attarzadeh,et al.  Object-Based Rule Sets and Its Transferability for Building Extraction from High Resolution Satellite Imagery , 2018, Journal of the Indian Society of Remote Sensing.

[45]  Francis L Martin,et al.  Understanding and harnessing the health effects of rapid urbanization in China. , 2011, Environmental science & technology.

[46]  Kenneth Grogan,et al.  A Review of the Application of Optical and Radar Remote Sensing Data Fusion to Land Use Mapping and Monitoring , 2016, Remote. Sens..

[47]  Nikolaos Doulamis,et al.  Deep convolutional neural networks for building extraction from orthoimages and dense image matching point clouds , 2017 .

[48]  Qinhuo Liu,et al.  Monitoring urban expansion with remote sensing in China , 2001 .

[49]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[50]  Yerach Doytsher,et al.  MONOCULAR RIGHT-ANGLE BUILDING HYPOTHESIS GENERATION IN REGULARIZED URBAN AREAS BY POSE CLUSTERING , 2003 .

[51]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Zhiyong Lv,et al.  Delineation of Built-Up Areas from Very High-Resolution Satellite Imagery Using Multi-Scale Textures and Spatial Dependence , 2018, Remote. Sens..

[53]  Martin Herold,et al.  The spatiotemporal form of urban growth: measurement, analysis and modeling , 2003 .

[54]  Nikos Paragios,et al.  Recognition-Driven Two-Dimensional Competing Priors Toward Automatic and Accurate Building Detection , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[56]  Jia Liu,et al.  Unified Partial Configuration Model Framework for Fast Partially Occluded Object Detection in High-Resolution Remote Sensing Images , 2018, Remote. Sens..

[57]  Norbert Haala,et al.  An update on automatic 3D building reconstruction , 2010 .

[58]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[60]  Prasad S. Thenkabail,et al.  Fast Segmentation and Classification of Very High Resolution Remote Sensing Data Using SLIC Superpixels , 2017 .

[61]  Rongjun Qin,et al.  Multi-level monitoring of subtle urban changes for the megacities of China using high-resolution multi-view satellite imagery , 2017 .