A Comprehensive Evaluation of Approaches for Built-up Area Extraction from Landsat OLI Images Using Massive Samples

Detailed built-up area information is valuable for mapping complex urban environments. Although a large number of classification algorithms about built-up areas have been developed, they are rarely tested from the perspective of feature engineering and feature learning. Therefore we launched a unique investigation to provide a full test of the OLI imagery for 15-m resolution built-up area classification in 2015, in Beijing, China. Training a classifier requires many sample points, and we propose a method based on the ESA's 38-meter global built-up area data of 2014, Open Street Map and MOD13Q1-NDVI to achieve rapid and automatic generation of a large number of sample points. Our aim is to examine the influence of a single pixel and image patch under traditional feature engineering and modern feature learning strategies. In feature engineering, we consider spectra, shape and texture as the input features, and SVM, random forest (RF) and AdaBoost as the classification algorithms. In feature learning, the convolution neural network (CNN) is used as the classification algorithm. In total, 26 built-up land cover maps were produced. Experimental results show that: (1) the approaches based on feature learning are generally better than those based on feature engineering in terms of classification accuracy, and the performance of ensemble classifiers e.g., RF, is comparable to that of CNN. Two dimensional CNN and the 7 neighborhood RF have the highest classification accuracy of nearly 91%. (2) Overall, the classification effect and accuracy based on image patches are better than those based on single pixels. The features that can highlight the information of the target category (for example, PanTex and EMBI) can help improve classification accuracy.

[1]  Ashok Samal,et al.  Automatic Building Detection From High-Resolution Satellite Images Based on Morphology and Internal Gray Variance , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Huadong Guo,et al.  A Global Human Settlement Layer From Optical HR/VHR RS Data: Concept and First Results , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  N. C. Strugnell,et al.  First operational BRDF, albedo nadir reflectance products from MODIS , 2002 .

[4]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[5]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[6]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[7]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[8]  Tao Tang,et al.  Man-Made Target Detection from Polarimetric SAR Data via Nonstationarity and Asymmetry , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[10]  Wei You,et al.  Detecting the Boundaries of Urban Areas in India: A Dataset for Pixel-Based Image Classification in Google Earth Engine , 2016, Remote. Sens..

[11]  Robert C. Balling,et al.  Using Landsat and nighttime lights for supervised pixel-based image classification of urban land cover , 2018 .

[12]  Hao Wu,et al.  Global mapping of artificial surfaces at 30-m resolution , 2016, Science China Earth Sciences.

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Jie Wang,et al.  Comparison of Classification Algorithms and Training Sample Sizes in Urban Land Classification with Landsat Thematic Mapper Imagery , 2014, Remote. Sens..

[15]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[16]  Tao Tang,et al.  Built-up Area Extraction from PolSAR Imagery with Model-Based Decomposition and Polarimetric Coherence , 2016, Remote. Sens..

[17]  Yi Su,et al.  Unsupervised polarimetric SAR urban area classification based on model-based decomposition with cross scattering , 2016 .

[18]  Jing Li,et al.  A Strategy of Rapid Extraction of Built-Up Area Using Multi-Seasonal Landsat-8 Thermal Infrared Band 10 Images , 2017, Remote. Sens..

[19]  Gérard Dedieu,et al.  Assessing the robustness of Random Forests to map land cover with high resolution satellite image time series over large areas , 2016 .

[20]  Ping Zhong,et al.  A Multiple Conditional Random Fields Ensemble Model for Urban Area Detection in Remote Sensing Optical Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Konstantinos Karantzalos,et al.  Deep Learning-Based Man-Made Object Detection from Hyperspectral Data , 2015, ISVC.

[22]  Jin Chen,et al.  Global land cover mapping at 30 m resolution: A POK-based operational approach , 2015 .

[23]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Xin Huang,et al.  A Multidirectional and Multiscale Morphological Index for Automatic Building Extraction from Multispectral GeoEye-1 Imagery , 2011 .

[25]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[26]  Costas Panagiotakis,et al.  Curvilinear Structure Enhancement and Detection in Geophysical Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[28]  Xia Li,et al.  A Normalized Urban Areas Composite Index (NUACI) Based on Combination of DMSP-OLS and MODIS for Mapping Impervious Surface Area , 2015, Remote. Sens..

[29]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Jordi Inglada,et al.  Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features , 2007 .

[31]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[32]  Hankui K. Zhang,et al.  Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ data , 2013 .

[33]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[34]  Alan H. Strahler,et al.  Global land cover mapping from MODIS: algorithms and early results , 2002 .

[35]  Curt H. Davis,et al.  Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information , 2005, EURASIP J. Adv. Signal Process..

[36]  Josiane Zerubia,et al.  Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Lin Wang,et al.  Urban Built-Up Area Boundary Extraction and Spatial-Temporal Characteristics Based on Land Surface Temperature Retrieval , 2018, Remote. Sens..

[38]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[39]  Hong Tang,et al.  DropBand: A Simple and Effective Method for Promoting the Scene Classification Accuracy of Convolutional Neural Networks for VHR Remote Sensing Imagery , 2018, IEEE Geoscience and Remote Sensing Letters.

[40]  Xiangguo Lin,et al.  An Index Based on Joint Density of Corners and Line Segments for Built-Up Area Detection from High Resolution Satellite Imagery , 2017, ISPRS Int. J. Geo Inf..

[41]  Xiaoping Liu,et al.  High-resolution multi-temporal mapping of global urban land using Landsat images based on the Google Earth Engine Platform , 2018 .

[42]  Doreen S. Boyd,et al.  Mapping Complex Urban Land Cover from Spaceborne Imagery: The Influence of Spatial Resolution, Spectral Band Set and Classification Approach , 2016, Remote. Sens..

[43]  Jay Gao,et al.  Use of normalized difference built-up index in automatically mapping urban areas from TM imagery , 2003 .

[44]  Shihong Du,et al.  Learning multiscale and deep representations for classifying remotely sensed imagery , 2016 .

[45]  Xiaohua Tong,et al.  Optimized Sample Selection in SVM Classification by Combining with DMSP-OLS, Landsat NDVI and GlobeLand30 Products for Extracting Urban Built-Up Areas , 2017, Remote. Sens..

[46]  Hanqiu Xu,et al.  A new index for delineating built‐up land features in satellite imagery , 2008 .

[47]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.