Performance evaluation of convolutional neural network at hyperspectral and multispectral resolution for classification

Convolutional Neural Network (CNN) has established as an effective deep learning model for hyperspectral image classification by considering both spectral and spatial information. In this study, the performance of two-dimensional (2D) CNN architecture is evaluated at hyperspectral and multispectral resolution. Two types of multispectral data are analyzed viz., original and transformed multispectral data. Hyperspectral bands are transformed to spectral resolution of multispectral bands by averaging the reflectances of specific hyperspectral narrow bands which are falling within the spectral ranges of multispectral bands. The well-known Pavia University dataset and a new dataset of Pear orchard are investigated in this study. In case of Pear orchard dataset, classification is performed with both types of multispectral data. All the experiments are carried out with the same 2D CNN architecture. In case of Pavia University dataset, hyperspectral and transformed multispectral data achieve OA(%) of 94.29±1.28 and 94.27±2.01 respectively considering 20% samples as training. In case of Pear orchard dataset, hyperspectral, multispectral and transformed multispectral data achieve OA(%) of 91.59±0.89, 88.65±1.35, and 93.24±0.16 respectively considering 20% samples as training. It is evident that transformed multispectral data, which comprises of inherent hyperspectral information, provides similar or better performance compared to hyperspectral data. Further, with the use of 3D CNN architecture, classification performance improves in case of Pavia University dataset, whereas it remains statistically similar in case of Pear orchard dataset. The present promising results illustrates the performance of CNN even in small dataset which is comparable to several published state-of-the art results on the same dataset.

[1]  M. Govender,et al.  A comparison of satellite hyperspectral and multispectral remote sensing imagery for improved classification and mapping of vegetation , 2019, Water SA.

[2]  Bo Huang,et al.  Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery , 2018, Remote Sensing of Environment.

[3]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Tao Liu,et al.  Deep convolutional neural network training enrichment using multi-view object-based analysis of Unmanned Aerial systems imagery for wetlands classification , 2018 .

[5]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yun Shi,et al.  3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images , 2018, Remote. Sens..

[7]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[8]  Chris Roelfsema,et al.  Mapping seagrass species, cover and biomass in shallow waters : An assessment of satellite multi-spectral and airborne hyper-spectral imaging systems in Moreton Bay (Australia) , 2008 .

[9]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[11]  Ying Li,et al.  Hyperspectral Classification Based on Lightweight 3-D-CNN With Transfer Learning , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Ben Somers,et al.  Multitemporal Chlorophyll Mapping in Pome Fruit Orchards from Remotely Piloted Aircraft Systems , 2019, Remote. Sens..

[14]  Nicolas Audebert,et al.  Deep Learning for Classification of Hyperspectral Data: A Comparative Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[15]  P. Gamba,et al.  URBAN LAND COVER MAPPING USING HYPERSPECTRAL AND MULTISPECTRAL VHR SENSORS: SPATIAL VERSUS SPECTRAL RESOLUTION , 2005 .

[16]  D. Nagesh Kumar,et al.  Spectral-spatial classification of hyperspectral data with mutual information based segmented stacked autoencoder approach , 2018 .

[17]  K. Wayne Forsythe,et al.  COMPARING HYPERSPECTRAL AND MULTISPECTRAL IMAGERY FOR LAND CLASSIFICATION OF THE LOWER DON RIVER, TORONTO , 2013 .

[18]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Yun Zhang,et al.  Very Deep Convolutional Neural Networks for Complex Land Cover Mapping Using Multispectral Remote Sensing Imagery , 2018, Remote. Sens..