Deep support vector machine for hyperspectral image classification

Abstract To improve on the robustness of traditional machine learning approaches, emphasis has recently shifted to the integration of such methods with Deep Learning techniques. However, the classification problems, complexity and inconsistency in several spectral classifiers developed for hyperspectral images are some reasons warranting further research. This study investigates the application of Deep Support Vector Machine (DSVM) for hyperspectral image classification. Two hyperspectral images, Indian Pines and University of Pavia are used as tentative test beds for the experiment. The DSVM is implemented with four kernel functions: Exponential Radial Basis Function (ERBF), Gaussian Radial Basis Function (GRBF), neural and polynomial. Stand-alone Support Vector Machines form the interconnecting weights of the entire network. The network is trained with one hundred input datasets, and the interconnecting weights of the network are initialised using the regularisation parameter of the model. Numerical results show that the classification accuracies of the DSVM for Indian Pines and University of Pavia based on each DSVM kernel functions are: ERBF (98.87%, 98.16%), GRBF (98.90%, 98.47%), neural (98.41%, 97.27%), and polynomial (99.24%, 98.79%). By comparing the DSVM algorithm against well-known classifiers, Support Vector Machine (SVM), Deep Neural Network (DNN), Gaussian Mixture Model (GMM), K Nearest Neighbour (KNN), and K Means (KM) classifiers, the mean classification accuracies for Indian Pines and University of Pavia are: DSVM (98.86%, 98.17%), SVM (76.03%, 73.52%), DNN (94.45%, 93.79%), GMM (76.82%, 78.35%), KNN (76.87%, 78.80%), and KM (21.65%, 18.18%). These results indicate that the DSVM outperformed the other classification algorithms. The high accuracy obtained with the DSVM validates its efficacy as state-of-the-art algorithm for hyperspectral image classification.

[1]  Jie Xu,et al.  Multi-model ensemble with rich spatial information for object detection , 2020, Pattern Recognit..

[2]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[3]  Xitao Fan,et al.  Evaluating the Performance of the K-fold Cross-Validation Approach for Model Selection in Growth Mixture Modeling , 2018, Structural Equation Modeling: A Multidisciplinary Journal.

[4]  David O'Sullivan.  Complexity science and human geography , 2004 .

[5]  O. Okwuashi.  The Application of Geographic Information Systems Cellular Automata Based Models to Land Use Change Modelling of Lagos, Nigeria , 2011 .

[6]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[8]  Yu Zhang,et al.  Guided filter based Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IIKI.

[9]  Zhong-ren Peng,et al.  LandSys: an agent-based Cellular Automata model of land use change developed for transportation analysis , 2012 .

[10]  Sungzoon Cho,et al.  Constructing a multi-class classifier using one-against-one approach with different binary classifiers , 2015, Neurocomputing.

[11]  C. Ndehedehe,et al.  Assessing land water storage dynamics over South America , 2020 .

[12]  Yu Li,et al.  Hyperspectral images classification with convolutional neural network and textural feature using limited training samples , 2019, Remote Sensing Letters.

[13]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Christopher E. Ndehedehe,et al.  Tide modelling using support vector machine regression , 2016 .

[15]  Chenming Li,et al.  Deep Belief Network for Spectral–Spatial Classification of Hyperspectral Remote Sensor Data , 2019, Sensors.

[16]  Marco Diana,et al.  A study of tour-based mode choice based on a Support Vector Machine classifier , 2018, Transportation Planning and Technology.

[17]  Wei Li,et al.  Hyperspectral image classification by AdaBoost weighted composite kernel extreme learning machines , 2018, Neurocomputing.

[18]  Fateme Nateghi Haredasht,et al.  Supervised Fuzzy Partitioning , 2018, Pattern Recognit..

[19]  A. Poursaee.  Application of agent-based paradigm to model corrosion of steel in concrete environment , 2018 .

[20]  T. Moughal.  Hyperspectral image classification using Support Vector Machine , 2013 .

[21]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[22]  Christopher Leckie,et al.  High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning , 2016, Pattern Recognit..

[23]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[25]  Paul M. Mather,et al.  Support vector machines for classification in remote sensing , 2005 .

[26]  Zhenwei Shi,et al.  MugNet: Deep learning for hyperspectral image classification using limited samples , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[27]  Jun Li,et al.  Active Learning With Convolutional Neural Networks for Hyperspectral Image Classification Using a New Bayesian Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Seyed Amir Naghibi,et al.  A comparative study of landslide susceptibility maps produced using support vector machine with different kernel functions and entropy data mining models in China , 2018, Bulletin of Engineering Geology and the Environment.

[29]  Behnaz Bigdeli,et al.  A Multiple SVM System for Classification of Hyperspectral Remote Sensing Data , 2013, Journal of the Indian Society of Remote Sensing.

[30]  Lijun Xie,et al.  A regularized ensemble framework of deep learning for cancer detection from multi-class, imbalanced training data , 2018, Pattern Recognit..

[31]  Huchuan Lu,et al.  Deep visual tracking: Review and experimental comparison , 2018, Pattern Recognit..

[32]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote-sensing data with primal SVM for small-sized training dataset problem☆ , 2008 .

[33]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[34]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[35]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.