A Futuristic Deep Learning Framework Approach for Land Use-Land Cover Classification Using Remote Sensing Imagery

Our aim is to propose a new deep learning framework approach which uses an ensemble of convolutional neural network (CNN) for land use-land cover mapping. Every CNN layer was fed with diverse combination of multispectral and geospatial satellite bands provided by Sentinel 2 satellite imagery (spatial resolution of 10 m), topographic and derived texture parameters, of New Delhi (28.6139° N, 77.2090° E) region, India. Several classes were identified like forest, parking, residential areas, slums, wasteland, water bodies. It was observed that our proposed framework outperformed with classification accuracy of 89.43%, compared to the current state-of-the-art algorithms (support vector machine (SVM), K-nearest neighbor (KNN), and random forest (RF)). Accuracy assessment was done by means of following statistic measures (precision, recall, specificity, and area under curve (AUC)) and receiver operating characteristic (ROC) curve.

[1]  Giorgos Mountrakis,et al.  A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research , 2016 .

[2]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[3]  Imdad Ali Rizvi,et al.  Object-Based Image Analysis of High-Resolution Satellite Images Using Modified Cloud Basis Function Neural Network and Probabilistic Relaxation Labeling Process , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Nataliia Kussul,et al.  Geospatial Intelligence and Data Fusion Techniques for Sustainable Development Problems , 2015, ICTERI.

[5]  Yann LeCun,et al.  Large-scale Learning with SVM and Convolutional for Generic Object Categorization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  S. Sachin Kumar,et al.  Deep Model for Classification of Hyperspectral image using Restricted Boltzmann Machine , 2014, ICONIAAC '14.

[7]  Johannes R. Sveinsson,et al.  Random Forests for land cover classification , 2006, Pattern Recognit. Lett..

[8]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[10]  Andrey Yu. Shelestov,et al.  Land Cover Changes Analysis Based on Deep Machine Learning Technique , 2016 .

[11]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Qi Li,et al.  Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features , 2016, Remote. Sens..

[14]  Ye Zhang,et al.  Classification of hyperspectral image based on deep belief networks , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Yoshihiko Mochizuki,et al.  Surface object recognition with CNN and SVM in Landsat 8 images , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[20]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Luisa Verdoliva,et al.  Marker-Controlled Watershed-Based Segmentation of Multiresolution Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Shihong Du,et al.  Learning multiscale and deep representations for classifying remotely sensed imagery , 2016 .

[24]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[25]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[26]  Martino Pesaresi,et al.  Improved Textural Built-Up Presence Index for Automatic Recognition of Human Settlements in Arid Regions With Scattered Vegetation , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Xiaogang Wang,et al.  Joint Deep Learning for Pedestrian Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[29]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.