A Comparison Between Support Vector Machine (SVM) and Convolutional Neural Network (CNN) Models For Hyperspectral Image Classification

This study presents a methodology model for the spectral classification of hyperspectral images. The applied methodology, first extracts neighbouring spatial regions via a suitable statistical support vector machine (SVM-Linear) architecture, support vector machine radial basis function (SVM-RBF) and Deep Learning (DL) architecture that comprises principal component analysis (PCA) and convolutional neural networks (CNN) and then applies a soft max classifier. PCA is introduced to reduce the high spectral dimensionality, noise, and redundant information of the input image. The SVM-Linear, SVM-RBF and CNN model is used to extract useful high-level features automatically given that it provides results comparable with each other, including hyperspectral image classification. However, because the CNN, SVM models alone may fail to extract features with different scales and to tolerate the large-scale variance of image objects, the presented methodology uses PCA optimization for spatial regions to construct features that can be then used by the SVM and CNN model to classify hyperspectral images. Experimental results obtained in the classification of the Hyperspec-VNIR Chikusei datasets show that the performance of the presented model is competitive with that of other DL and traditional machine-learning methods. The best overall accuracy of the presented methodology for the Hyperspec-VNIR Chikusei datasets is 98.84 % in SVM-RBF model.

[1]  Berrin A. Yanikoglu,et al.  Deep Learning With Attribute Profiles for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[2]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[3]  Ronald Kemker,et al.  Self-Taught Feature Learning for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jocelyn Chanussot,et al.  Multiple Kernel Learning for Hyperspectral Image Classification: A Review , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Naoto Yokoya,et al.  Random Forest Ensembles and Extended Multiextinction Profiles for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Peijun Du,et al.  Mid-Level Feature Representation via Sparse Autoencoder for Remotely Sensed Scene Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Geoffrey E. Hinton,et al.  Application of Deep Belief Networks for Natural Language Understanding , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[10]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Xiaorui Ma,et al.  Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning , 2016 .

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Xiao Xiang Zhu,et al.  A Self-Improving Convolution Neural Network for the Classification of Hyperspectral Data , 2016, IEEE Geoscience and Remote Sensing Letters.

[14]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.