Linear vs. Nonlinear Extreme Learning Machine for Spectral-Spatial Classification of Hyperspectral Images

As a new machine learning approach, the extreme learning machine (ELM) has received much attention due to its good performance. However, when directly applied to hyperspectral image (HSI) classification, the recognition rate is low. This is because ELM does not use spatial information, which is very important for HSI classification. In view of this, this paper proposes a new framework for the spectral-spatial classification of HSI by combining ELM with loopy belief propagation (LBP). The original ELM is linear, and the nonlinear ELMs (or Kernel ELMs) are an improvement of linear ELM (LELM). However, based on lots of experiments and much analysis, it is found that the LELM is a better choice than nonlinear ELM for the spectral-spatial classification of HSI. Furthermore, we exploit the marginal probability distribution that uses the whole information in the HSI and learns such a distribution using the LBP. The proposed method not only maintains the fast speed of ELM, but also greatly improves the accuracy of classification. The experimental results in the well-known HSI data sets, Indian Pines, and Pavia University, demonstrate the good performance of the proposed method.

[1]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[2]  Pedram Ghamisi,et al.  Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jun Li,et al.  ${{\rm E}^{2}}{\rm LMs}$ : Ensemble Extreme Learning Machines for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Jinchang Ren,et al.  Monte Carlo Convex Hull Model for classification of traditional Chinese paintings , 2016, Neurocomputing.

[5]  Francisco Argüello,et al.  ELM-based spectral–spatial classification of hyperspectral images using extended morphological profiles and composite feature mappings , 2015 .

[6]  Yicong Zhou,et al.  Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chen Chen,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine , 2014, Remote. Sens..

[8]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Danwei Wang,et al.  Sparse Extreme Learning Machine for Classification , 2014, IEEE Transactions on Cybernetics.

[10]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Shutao Li,et al.  Spectral-Spatial Hyperspectral Image Classification Using Superpixel and Extreme Learning Machines , 2014, CCPR.

[13]  Jon Atli Benediktsson,et al.  Effective Denoising and Classification of Hyperspectral Images Using Curvelet Transform and Singular Spectrum Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Stephen Marshall,et al.  Effective Feature Extraction and Data Reduction in Remote Sensing Using Hyperspectral Imaging [Applications Corner] , 2014, IEEE Signal Processing Magazine.

[15]  Stephen Marshall,et al.  Singular spectrum analysis for improving hyperspectral imaging based beef eating quality evaluation , 2015, Comput. Electron. Agric..

[16]  José M. Bioucas-Dias,et al.  Evaluation of bayesian hyperspectral image segmentation with a discriminative class learning , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Sanjiv Kumar,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[18]  Shutao Li,et al.  Novel Two-Dimensional Singular Spectrum Analysis for Effective Feature Extraction and Data Classification in Hyperspectral Imaging , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jun Wang,et al.  Fast Implementation of Singular Spectrum Analysis for Effective Feature Extraction in Hyperspectral Imaging , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[21]  Zhe Liu,et al.  Structured covariance principal component analysis for real-time onsite feature extraction and dimensionality reduction in hyperspectral imaging. , 2014, Applied optics.

[22]  Cong Zhang,et al.  Hyperspectral Image Classification with Spatial Filtering and ℓ2,1 Norm , 2017, Sensors.

[23]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[24]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[25]  Junwei Han,et al.  Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing , 2014 .

[26]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[27]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[29]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  David Menotti,et al.  Combining Multiple Classification Methods for Hyperspectral Data Interpretation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[32]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[34]  Liang Xiao,et al.  Supervised Spectral–Spatial Hyperspectral Image Classification With Weighted Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Yuliya Tarabalka,et al.  Dynamic Ensemble Selection Approach for Hyperspectral Image Classification With Joint Spectral and Spatial Information , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Jon Atli Benediktsson,et al.  Classification of multisource and hyperspectral data based on decision fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[37]  Antonio J. Plaza,et al.  Semi-supervised hyperspectral image classification based on a Markov random field and sparse multinomial logistic regression , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[38]  Zexuan Zhu,et al.  A fast pruned-extreme learning machine for classification problem , 2008, Neurocomputing.

[39]  Yicong Zhou,et al.  Extreme Learning Machine With Composite Kernels for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Aleksandra Pizurica,et al.  A Robust Sparse Representation Model for Hyperspectral Image Classification † , 2017, Sensors.

[41]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[43]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[44]  Lawrence Carin,et al.  Sparse multinomial logistic regression: fast algorithms and generalization bounds , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Gerhard Lakemeyer,et al.  Exploring artificial intelligence in the new millennium , 2003 .

[46]  Saurabh Prasad,et al.  Non-Uniform Random Feature Selection and Kernel Density Scoring With SVM Based Ensemble Classification for Hyperspectral Image Analysis , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Peijun Du,et al.  Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging , 2016, Neurocomputing.

[48]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  Feilong Cao,et al.  A study on effectiveness of extreme learning machine , 2011, Neurocomputing.