Comparing Fully Deep Convolutional Neural Networks for Land Cover Classification with High-Spatial-Resolution Gaofen-2 Images

Land cover is an important variable of the terrestrial ecosystem that provides information for natural resources management, urban sprawl detection, and environment research. To classify land cover with high-spatial-resolution multispectral remote sensing imagery is a difficult problem due to heterogeneous spectral values of the same object on the ground. Fully convolutional networks (FCNs) are a state-of-the-art method that has been increasingly used in image segmentation and classification. However, a systematic quantitative comparison of FCNs on high-spatial-multispectral remote imagery was not yet performed. In this paper, we adopted the three FCNs (FCN-8s, Segnet, and Unet) for Gaofen-2 (GF2) satellite imagery classification. Two scenes of GF2 with a total of 3329 polygon samples were used in the study area and a systematic quantitative comparison of FCNs was conducted with red, green, blue (RGB) and RGB+near infrared (NIR) inputs for GF2 satellite imagery. The results showed that: (1) The FCN methods perform well in land cover classification with GF2 imagery, and yet, different FCNs architectures exhibited different results in mapping accuracy. The FCN-8s model performed best among the Segnet and Unet architectures due to the multiscale feature channels in the upsampling stage. Averaged across the models, the overall accuracy (OA) and Kappa coefficient (Kappa) were 5% and 0.06 higher, respectively, in FCN-8s when compared with the other two models. (2) High-spatial-resolution remote sensing imagery with RGB+NIR bands performed better than RGB input at mapping land cover, and yet the advantage was limited; the OA and Kappa only increased an average of 0.4% and 0.01 in the RGB+NIR bands. (3) The GF2 imagery provided an encouraging result in estimating land cover based on the FCN-8s method, which can be exploited for large-scale land cover mapping in the future.

[1]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Laure Tougne,et al.  Automatic Land Cover Reconstruction From Historical Aerial Images: An Evaluation of Features Extraction and Classification Algorithms , 2019, IEEE Transactions on Image Processing.

[3]  Giorgos Mountrakis,et al.  Meta-analysis of deep neural networks in remote sensing: A comparative study of mono-temporal classification to support vector machines , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[4]  Konstantinos Karantzalos,et al.  Detailed Land Cover Mapping from Multitemporal Landsat-8 Data of Different Cloud Cover , 2018, Remote. Sens..

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Lingfeng Wang,et al.  Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[8]  Shihua Li,et al.  Object-Oriented Method Combined with Deep Convolutional Neural Networks for Land-Use-Type Classification of Remote Sensing Images , 2019, Journal of the Indian Society of Remote Sensing.

[9]  Joanne C. White,et al.  Satellite-based time series land cover and change information to map forest area consistent with national and international reporting requirements , 2020 .

[10]  Panagiotis Tsakalides,et al.  Deep Learning for Multilabel Land Cover Scene Categorization Using Data Augmentation , 2019, IEEE Geoscience and Remote Sensing Letters.

[11]  Eleni Kroupi,et al.  Deep convolutional neural networks for land-cover classification with Sentinel-2 images , 2019 .

[12]  Subhasis Chaudhuri,et al.  Graph convolutional network for multi-label VHR remote sensing scene recognition , 2019, Neurocomputing.

[13]  Ronald Kemker,et al.  Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[14]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[15]  W. Cohen,et al.  MODIS tasselled cap: land cover characteristics expressed through transformed MODIS data , 2007 .

[16]  Patrick Hostert,et al.  A Pixel-Based Landsat Compositing Algorithm for Large Area Land Cover Mapping , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[18]  Maximilian Lange,et al.  Introducing APiC for regionalised land cover mapping on the national scale using Sentinel-2A imagery , 2020 .

[19]  Bin Chen,et al.  Stable classification with limited sample: transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017. , 2019, Science bulletin.

[20]  L. Hauser,et al.  Uncovering the spatio-temporal dynamics of land cover change and fragmentation of mangroves in the Ca Mau peninsula, Vietnam using multi-temporal SPOT satellite imagery (2004–2013) , 2017 .

[21]  Xin Pan,et al.  VPRS-Based Regional Decision Fusion of CNN and MRF Classifications for Very Fine Resolution Remotely Sensed Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jin Chen,et al.  Global land cover mapping at 30 m resolution: A POK-based operational approach , 2015 .

[23]  Ying Zhu,et al.  Image Mosaicking Approach for a Double-Camera System in the GaoFen2 Optical Remote Sensing Satellite Based on the Big Virtual Camera , 2017, Sensors.

[24]  Eric W. Gill,et al.  A new fully convolutional neural network for semantic segmentation of polarimetric SAR imagery in complex land cover ecosystem , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.