Multiscale Context-Aware Ensemble Deep KELM for Efficient Hyperspectral Image Classification

Recently, multiscale spatial features have been widely utilized to improve the hyperspectral image (HSI) classification performance. However, fixed-size neighborhood involving the contextual information probably leads to misclassifications, especially for the boundary pixels. Additionally, it has been demonstrated that deep neural network (DNN) is practical to extract representative features for the classification tasks. Nevertheless, under the condition of high dimensionality versus small sample sizes, DNN tends to be over-fitting and it is generally time-consuming due to the deep-level feature learning process. To alleviate the aforementioned issues, we propose a multiscale context-aware ensemble deep kernel extreme learning machine (MSC-EDKELM) for efficient HSI classification. First, the scene of the HSI data set is over-segmented in multiscale via using the adaptive superpixel segmentation technique. Second, superpixel pattern (SP) and attentional neighboring superpixel pattern (ANSP) are generated by leveraging the superpixel maps, which can automatically comprise local and global contextual information, respectively. Afterward, an ensemble deep kernel extreme learning machine (EDKELM) is presented to investigate the deep-level characteristics in the SP and ANSP. Finally, the category of each pixel is accurately determined by the decision fusion and weighted output layer fusion strategy. Experimental results on four real-world HSI data sets demonstrate that the proposed frameworks outperform some classic and state-of-the-art methods with high computational efficiency, which can be employed to serve real-time applications.

[1]  Jing Zhao,et al.  Hyperspectral imagery classification with cascaded support vector machines and multi-scale superpixel segmentation , 2020, International Journal of Remote Sensing.

[2]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[3]  Shihong Du,et al.  Learning multiscale and deep representations for classifying remotely sensed imagery , 2016 .

[4]  Qian Du,et al.  Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[5]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Lianru Gao,et al.  Multi-scale superpixel spectral–spatial classification of hyperspectral images , 2016 .

[7]  Jiuwen Cao,et al.  Kernel-Based Multilayer Extreme Learning Machines for Representation Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Ye Zhang,et al.  Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  J. Benediktsson,et al.  New Frontiers in Spectral-Spatial Hyperspectral Image Classification: The Latest Advances Based on Mathematical Morphology, Markov Random Fields, Segmentation, Sparse Representation, and Deep Learning , 2018, IEEE Geoscience and Remote Sensing Magazine.

[11]  Shutao Li,et al.  Gaussian Pyramid Based Multiscale Feature Fusion for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jiasong Zhu,et al.  Collaborative Representation-Based Multiscale Superpixel Fusion for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Ying Zhang,et al.  The Advanced Hyperspectral Imager: Aboard China's GaoFen-5 Satellite , 2019, IEEE Geoscience and Remote Sensing Magazine.

[16]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Aizhu Zhang,et al.  Deep Fusion of Localized Spectral Features and Multi-scale Spatial Features for Effective Classification of Hyperspectral Images , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[18]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jun Li,et al.  Advanced Spectral Classifiers for Hyperspectral Images: A review , 2017, IEEE Geoscience and Remote Sensing Magazine.

[20]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[22]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Bin Song,et al.  HCNN-PSI: A hybrid CNN with partial semantic information for space target recognition , 2020, Pattern Recognit..

[24]  Wenju Wang,et al.  A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification , 2018, Remote. Sens..

[25]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Qian Du,et al.  Deep Prototypical Networks With Hybrid Residual Attention for Hyperspectral Image Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[28]  José M. Bioucas-Dias,et al.  Bayesian Hyperspectral Image Segmentation With Discriminative Class Learning , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[31]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Chen Chen,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine , 2014, Remote. Sens..

[33]  Mercedes Eugenia Paoletti,et al.  Deep learning classifiers for hyperspectral imaging: A review , 2019 .

[34]  Naoto Yokoya,et al.  CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[36]  Lianru Gao,et al.  Multiscale Spatial-Spectral Convolutional Network with Image-Based Framework for Hyperspectral Imagery Classification , 2019, Remote. Sens..

[37]  Qian Du,et al.  Deep Kernel Extreme-Learning Machine for the Spectral-Spatial Classification of Hyperspectral Imagery , 2018, Remote. Sens..

[38]  Jinlong Yang,et al.  Region-Based Relaxed Multiple Kernel Collaborative Representation for Hyperspectral Image Classification , 2017, IEEE Access.

[39]  Nicolas Audebert,et al.  Deep Learning for Classification of Hyperspectral Data: A Comparative Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[40]  Yicong Zhou,et al.  Extreme Learning Machine With Composite Kernels for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[42]  Wilfried Philips,et al.  Multiscale Superpixel-Level Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[43]  Sicong Liu,et al.  Classification of VHR Multispectral Images Using ExtraTrees and Maximally Stable Extremal Region-Guided Morphological Profile , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[45]  Jun Zhou,et al.  On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[47]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[48]  Zhijing Yang,et al.  Local Block Multilayer Sparse Extreme Learning Machine for Effective Feature Extraction and Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.