Label Propagation Ensemble for Hyperspectral Image Classification

The imbalance between limited labeled pixels and high dimensionality of hyperspectral data can easily give rise to Hughes phenomenon. Semisupervised learning (SSL) methods provide promising solutions to address the aforementioned issue. Graph-based SSL algorithms, also called label propagation methods, have obtained increasing attention in hyperspectral image (HSI) classification. However, the graphs constructed by utilizing the geometrical structure similarity of samples are unreliable due to the high dimensionality and complexity of the HSIs, especially for the case of very limited labeled pixels. Our motivation is to construct label propagation ensemble (LPE) model, then use the decision fusion of multiple label propagations to obtain pseudolabeled pixels with high classification confidence. In LPE, random subspace method is introduced to partition the feature space into multiple subspaces, then several label propagation models are constructed on corresponding subspaces, finally the results of different label propagation models are fused at decision level, and only the unlabeled pixels whose label propagation results are the same will be assigned with pseudolabels. Meanwhile extreme learning machine classifiers are trained on the labeled and pseudolabeled samples during the iteration. Compared with traditional label propagation methods, our proposed method can deal with the situation of very limited labeled samples by providing pseudolabeled pixels with high classification confidence, consequently, the accurate base classifiers are obtained. To demonstrate the effectiveness of the proposed method, LPE is compared with several state-of-the-art methods on four hyperspectral datasets. In addition, the method that only use label propagation is investigated to show the importance of ensemble technique in LPE. The experimental results demonstrate that the proposed method can provide competitive solution for HSI classification.

[1]  Jun Li,et al.  Sparse Graph Regularization for Hyperspectral Remote Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zhi-Hua Zhou When semi-supervised learning meets ensemble learning , 2011 .

[3]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Edoardo Pasolli,et al.  Ensemble Multiple Kernel Active Learning For Classification of Multisource Remote Sensing Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Horst Bischof,et al.  Semi-Supervised Random Forests , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Xia Xu,et al.  Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[10]  Hui Lin,et al.  Classification of Hyperspectral Images by Gabor Filtering Based Deep Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Wei Li,et al.  Laplacian Regularized Collaborative Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Shuying Li,et al.  Active-Learning-Incorporated Deep Transfer Learning for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Naoto Yokoya,et al.  Random Forest Ensembles and Extended Multiextinction Profiles for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Wen Zhang,et al.  The linear neighborhood propagation method for predicting long non-coding RNA-protein interactions , 2018, Neurocomputing.

[15]  Qingshan Liu,et al.  Matrix-Based Discriminant Subspace Ensemble for Hyperspectral Image Spatial–Spectral Feature Fusion , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yuliya Tarabalka,et al.  Dynamic Ensemble Selection Approach for Hyperspectral Image Classification With Joint Spectral and Spatial Information , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Yan Guo,et al.  Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bo Du,et al.  Dimensionality Reduction and Classification of Hyperspectral Images Using Ensemble Discriminative Local Metric Learning , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  David A. Landgrebe,et al.  The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon , 1994, IEEE Trans. Geosci. Remote. Sens..

[20]  Antonio J. Plaza,et al.  Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[21]  Zhi-Hua Zhou,et al.  Improve Computer-Aided Diagnosis With Machine Learning Techniques Using Undiagnosed Samples , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Ying Wang,et al.  Semi-supervised classification for hyperspectral imagery based on spatial-spectral Label Propagation , 2014 .

[23]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[25]  Shutao Li,et al.  PCA-Based Edge-Preserving Features for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[27]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jinping Wang,et al.  KNN-Based Representation of Superpixels for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Xianming Liu,et al.  Hyperspectral Image Classification in the Presence of Noisy Labels , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jinping Wang,et al.  Hyperspectral Image Classification via Weighted Joint Nearest Neighbor and Sparse Representation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Wei Feng,et al.  Weight-Based Rotation Forest for Hyperspectral Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[33]  Ning Zhang,et al.  CoinNet: Copy Initialization Network for Multispectral Imagery Semantic Segmentation , 2019, IEEE Geoscience and Remote Sensing Letters.

[34]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[35]  Tin Kam Ho,et al.  Nearest Neighbors in Random Subspaces , 1998, SSPR/SPR.

[36]  Li Ma,et al.  Spatial and class structure regularized sparse representation graph for semi-supervised hyperspectral image classification , 2018, Pattern Recognit..

[37]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[38]  Saeid Homayouni,et al.  Semi-supervised classification of hyperspectral image using random forest algorithm , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[39]  Qian Du,et al.  GPU Parallel Implementation of Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Licheng Jiao,et al.  Classification of Hyperspectral Images Based on Multiclass Spatial–Spectral Generative Adversarial Networks , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Yang Yu,et al.  Ensembling local learners ThroughMultimodal perturbation , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[44]  Ying Wang,et al.  A label propagation method using spatial-spectral consistency for hyperspectral image classification , 2016 .

[45]  Maurice Borgeaud,et al.  Kernel Low-Rank and Sparse Graph for Unsupervised and Semi-Supervised Classification of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Onisimo Mutanga,et al.  Random Forests Unsupervised Classification: The Detection and Mapping of Solanum mauritianum Infestations in Plantation Forestry Using Hyperspectral Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Deyu Meng,et al.  Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network , 2017, IEEE Transactions on Image Processing.

[48]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Li Ma,et al.  Probabilistic class structure regularized sparse representation graph for semi-supervised hyperspectral image classification , 2017, Pattern Recognit..

[50]  Guo Cao,et al.  Cascaded Random Forest for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[51]  Farid Melgani,et al.  Nearest Neighbor Classification of Remote Sensing Images With the Maximal Margin Principle , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Cheng Wang,et al.  Semisupervised Hyperspectral Image Classification via Laplacian Least Squares Support Vector Machine in Sum Space and Random Sampling , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[53]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[54]  Wei Li,et al.  Discriminant Analysis of Hyperspectral Imagery Using Fast Kernel Sparse and Low-Rank Graph , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[56]  Peijun Du,et al.  Combining Morphological Attribute Profiles via an Ensemble Method for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[57]  Min Han,et al.  Ensemble of extreme learning machine for remote sensing image classification , 2015, Neurocomputing.

[58]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Shuyuan Yang,et al.  Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Bo Du,et al.  Domain Adaptation for Remote Sensing Image Classification: A Low-Rank Reconstruction and Instance Weighting Label Propagation Inspired Algorithm , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Qian Du,et al.  Firefly-Algorithm-Inspired Framework With Band Selection and Extreme Learning Machine for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[62]  Tie Qiu,et al.  Remote Sensing Image Classification Based on Ensemble Extreme Learning Machine With Stacked Autoencoder , 2017, IEEE Access.

[63]  Qingshan Liu,et al.  Cascaded Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Saeid Homayouni,et al.  Spectral–Spatial Semisupervised Hyperspectral Classification Using Adaptive Neighborhood , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[65]  Jon Atli Benediktsson,et al.  A Novel Technique for Optimal Feature Selection in Attribute Profiles Based on Genetic Algorithms , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Qian Du,et al.  Collaborative Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[67]  Li Ma,et al.  Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification , 2016, Pattern Recognit. Lett..

[68]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.