Urban Area Detection in Very High Resolution Remote Sensing Images Using Deep Convolutional Neural Networks

Detecting urban areas from very high resolution (VHR) remote sensing images plays an important role in the field of Earth observation. The recently-developed deep convolutional neural networks (DCNNs), which can extract rich features from training data automatically, have achieved outstanding performance on many image classification databases. Motivated by this fact, we propose a new urban area detection method based on DCNNs in this paper. The proposed method mainly includes three steps: (i) a visual dictionary is obtained based on the deep features extracted by pre-trained DCNNs; (ii) urban words are learned from labeled images; (iii) the urban regions are detected in a new image based on the nearest dictionary word criterion. The qualitative and quantitative experiments on different datasets demonstrate that the proposed method can obtain a remarkable overall accuracy (OA) and kappa coefficient. Moreover, it can also strike a good balance between the true positive rate (TPR) and false positive rate (FPR).

[1]  Yihua Tan,et al.  Unsupervised Detection of Built-Up Areas From Multiple High-Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[2]  Yihua Tan,et al.  Cauchy Graph Embedding Optimization for Built-Up Areas Detection From High-Resolution Remote Sensing Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Jacob Goldberger,et al.  Urban-Area Segmentation Using Visual Words , 2009, IEEE Geoscience and Remote Sensing Letters.

[4]  Alfred Stein,et al.  Detection of Informal Settlements from VHR Images Using Convolutional Neural Networks , 2017, Remote. Sens..

[5]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[6]  Igor Sevo,et al.  Convolutional Neural Network Based Automatic Object Detection on Aerial Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[7]  Ying Yu,et al.  Accurate Urban Area Detection in Remote Sensing Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[8]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[9]  Yi Li,et al.  Built-Up Area Detection From Satellite Images Using Multikernel Learning, Multifield Integrating, and Multihypothesis Voting , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Priyakant Sinha,et al.  Urban Built-up Area Extraction and Change Detection of Adama Municipal Area using Time-Series Landsat Images , 2016 .

[11]  Jamie Sherrah,et al.  Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery , 2016, ArXiv.

[12]  Tamás Szirányi,et al.  Improved Harris Feature Point Set for Orientation-Sensitive Urban-Area Detection in Aerial Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Yue Li,et al.  The Detection of Built-up Areas in High-Resolution SAR Images Based on Deep Neural Networks , 2017, ICIG.

[14]  Yihua Tan,et al.  Urban area detection using multiple Kernel Learning and graph cut , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Guoliang Fan,et al.  Non-rigid Point Set Registration with Global-Local Topology Preservation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Robinson Piramuthu,et al.  Fashion apparel detection: The role of deep convolutional neural network and pose-dependent priors , 2014, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[20]  Qingquan Li,et al.  Representation of Block-Based Image Features in a Multi-Scale Framework for Built-Up Area Detection , 2016, Remote. Sens..

[21]  Cem Ünsalan,et al.  Urban Area Detection Using Local Feature Points and Spatial Voting , 2010, IEEE Geoscience and Remote Sensing Letters.

[22]  Y. Murayama,et al.  Classification and change detection of built-up lands from Landsat-7 ETM+ and Landsat-8 OLI/TIRS imageries: A comparative assessment of various spectral indices , 2015 .

[23]  Yihua Tan,et al.  Unsupervised Multilayer Feature Learning for Satellite Image Scene Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[24]  Paolo Gamba,et al.  Urban Area Extent Extraction in Spaceborne HR and VHR Data Using Multi-Resolution Features , 2014, Sensors.

[25]  Shihong Du,et al.  Scene classification using multi-scale deeply described visual words , 2016 .

[26]  Jon Atli Benediktsson,et al.  Decision Fusion for the Classification of Urban Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[28]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[29]  Jefersson Alex dos Santos,et al.  Do deep features generalize from everyday objects to remote sensing and aerial scenes domains? , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  Guoliang Fan,et al.  Articulated and Generalized Gaussian Kernel Correlation for Human Pose Estimation , 2016, IEEE Transactions on Image Processing.

[31]  Yongjun Zhang,et al.  Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Sameer Antani,et al.  Local-global classifier fusion for screening chest radiographs , 2017, Medical Imaging.

[33]  Jiayi Ma,et al.  Hyperspectral Image Classification With Robust Sparse Representation , 2016, IEEE Geoscience and Remote Sensing Letters.

[34]  Andrea Manno-Kovacs,et al.  Building Detection From Monocular VHR Images by Integrated Urban Area Knowledge , 2015, IEEE Geoscience and Remote Sensing Letters.

[35]  Yansheng Li,et al.  Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration , 2017, Inf. Sci..

[36]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Chen Zheng,et al.  Urban area detection from high-spatial resolution remote sensing imagery using Markov random field-based region growing , 2014 .

[38]  David Stutz,et al.  Neural Codes for Image Retrieval , 2015 .

[39]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[40]  Jiayi Ma,et al.  Robust Topological Navigation via Convolutional Neural Network Feature and Sharpness Measure , 2017, IEEE Access.

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[43]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[44]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[47]  A. Thomson,et al.  A cluster-based method to map urban area from DMSP/OLS nightlights , 2014 .

[48]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.

[49]  Wei Su,et al.  Textural and local spatial statistics for the object‐oriented classification of urban areas using high resolution imagery , 2008 .

[50]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[51]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.