A Spectral-Spatial Domain-Specific Convolutional Deep Extreme Learning Machine for Supervised Hyperspectral Image Classification

Spectral-spatial feature extraction is of great importance to hyperspectral image (HSI) classification. Different from the traditional feature extraction methods, deep learning models such as convolutional neural network (CNN) can learn the spectral-spatial discriminative feature automatically. However, deep learning models usually need to construct a large and complicated network and the training is time-consuming. To deal with these issues, in this paper, a spectral-spatial domain-specific convolutional deep extreme learning machine (ELM), named S2CDELM, is proposed for HSI classification. At first, by using the conception of local receptive filed (LRF), a spectral-spatial convolutional learning module with two branches is constructed for spectral and spatial feature extraction respectively. Specifically, the convolutional learning module is constructed by using random convolutional nodes but without back propagation, in which a spectral branch and a spatial branch are designed respectively. Then the extracted features are concatenated and fed to a fully connected stacked ELM network to further exploit spectral-spatial information for classification. As the convolutional filters and input weights of ELM are randomly generated, the whole framework is compact, simple and fast to construct. Experimental results on popular HSI benchmark data sets demonstrate that S2CDELM can provide satisfactory classification performance and a fast learning speed in comparison with several state-of-the-art classifiers.

[1]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[2]  Chi-Man Vong,et al.  Local Receptive Fields Based Extreme Learning Machine , 2015, IEEE Computational Intelligence Magazine.

[3]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Qingquan Li,et al.  A 3-D Gabor Phase-Based Coding and Matching Framework for Hyperspectral Imagery Classification , 2018, IEEE Transactions on Cybernetics.

[5]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[6]  Leiguang Wang,et al.  A Markov random field integrating spectral dissimilarity and class co-occurrence dependency for remote sensing image classification optimization , 2017 .

[7]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[8]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.

[10]  Deyu Meng,et al.  Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network , 2017, IEEE Transactions on Image Processing.

[11]  Jonathan Cheung-Wai Chan,et al.  Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[14]  Le Zhang,et al.  Visual Tracking With Convolutional Random Vector Functional Link Network , 2017, IEEE Transactions on Cybernetics.

[15]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yan Yang,et al.  Dimension Reduction With Extreme Learning Machine , 2016, IEEE Transactions on Image Processing.

[17]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Chen Chen,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine , 2014, Remote. Sens..

[19]  Qian Du,et al.  Kernel Collaborative Representation With Tikhonov Regularization for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[20]  Shutao Li,et al.  From Subpixel to Superpixel: A Novel Fusion Framework for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Peijun Du,et al.  Multikernel Adaptive Collaborative Representation for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Bing Liu,et al.  Supervised Deep Feature Extraction for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Fuchun Sun,et al.  Multi-Modal Local Receptive Field Extreme Learning Machine for object recognition , 2016, IJCNN.

[24]  Glenn Healey,et al.  Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Lorenzo Bruzzone,et al.  Two-Stream Deep Architecture for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Qian Du,et al.  Deep Kernel Extreme-Learning Machine for the Spectral-Spatial Classification of Hyperspectral Imagery , 2018, Remote. Sens..

[28]  Zhijing Yang,et al.  Local Block Multilayer Sparse Extreme Learning Machine for Effective Feature Extraction and Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Alfred Stein,et al.  Recurrent Multiresolution Convolutional Networks for VHR Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Faxian Cao,et al.  Extreme Learning Machine With Enhanced Composite Feature for Spectral-Spatial Hyperspectral Image Classification , 2018, IEEE Access.

[32]  Qingquan Li,et al.  Local Binary Pattern-Based Hyperspectral Image Classification With Superpixel Guidance , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[34]  Jianyu Chen,et al.  Supervised classification of hyperspectral images using local-receptive-fields-based kernel extreme learning machine , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[35]  Miki Haseyama,et al.  Estimation of Deterioration Levels of Transmission Towers via Deep Learning Maximizing Canonical Correlation Between Heterogeneous Features , 2018, IEEE Journal of Selected Topics in Signal Processing.

[36]  Yong Dou,et al.  Classification of Hyperspectral Remote Sensing Image Using Hierarchical Local-Receptive-Field-Based Extreme Learning Machine , 2016, IEEE Geoscience and Remote Sensing Letters.

[37]  Qian Du,et al.  Firefly-Algorithm-Inspired Framework With Band Selection and Extreme Learning Machine for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[39]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Xizhao Wang,et al.  A review on neural networks with random weights , 2018, Neurocomputing.

[41]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[42]  Wei Li,et al.  Hyperspectral image classification by AdaBoost weighted composite kernel extreme learning machines , 2018, Neurocomputing.

[43]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[44]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.