Semi-supervised classification for hyperspectral imagery based on spatial-spectral Label Propagation

Abstract Graph-based classification algorithms have gained increasing attention in semi-supervised classification. Nevertheless, the graph cannot fully represent the inherent spatial distribution of the data. In this paper, a new classification methodology based on the spatial-spectral Label Propagation is proposed for semi-supervised classification of hyperspectral imagery. The spatial information was used in two aspects: on the one hand, the spatial features extracted by a 2-D Gabor filter were stacked with spectral features; on the other hand, the width of the Gaussian function, which was used to construct graph, was determined with an adaptive method. Subsequently, the unlabeled samples from the spatial neighbors of the labeled samples were selected and the spatial graph was constructed based on spatial smoothness. Finally, labels were propagated from labeled samples to unlabeled samples with spatial-spectral graph to update the training set for a basic classifier (e.g., Support Vector Machine, SVM). Experiments on four hyperspectral datasets show that the proposed Spatial-Spectral Label Propagation based on the SVM (SS-LPSVM) can effectively represent the spatial information in the framework of semi-supervised learning and consistently produces greater classification accuracy than the standard SVM, the Laplacian Support Vector Machine (LapSVM), Transductive Support Vector Machine (TSVM) and the Spatial-Contextual Semi-Supervised Support Vector Machine (SCS 3 VM).

[1]  Hamid R. Rabiee,et al.  Supervised neighborhood graph construction for semi-supervised classification , 2012, Pattern Recognit..

[2]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[3]  Lorenzo Bruzzone,et al.  A Novel Context-Sensitive Semisupervised SVM Classifier Robust to Mislabeled Training Samples , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  LinLin Shen,et al.  MutualBoost learning for selecting Gabor features for face recognition , 2006, Pattern Recognit. Lett..

[5]  Francesca Bovolo,et al.  A Novel Technique for Subpixel Image Classification Based on Support Vector Machine , 2010, IEEE Transactions on Image Processing.

[6]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[8]  John A. Richards,et al.  Managing the Spectral-Spatial Mix in Context Classification Using Markov Random Fields , 2008, IEEE Geoscience and Remote Sensing Letters.

[9]  Tong Zhang,et al.  Two-view feature generation model for semi-supervised learning , 2007, ICML '07.

[10]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Luis Gómez-Chova,et al.  Semisupervised Image Classification With Laplacian Support Vector Machines , 2008, IEEE Geoscience and Remote Sensing Letters.

[12]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Martial Hebert,et al.  Semi-Supervised Self-Training of Object Detection Models , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[14]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[15]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[16]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[17]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[18]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression , 2013, IEEE Geoscience and Remote Sensing Letters.

[19]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Images Using Minimum Spanning Forest Grown From Automatically Selected Markers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[21]  S.J.S. Sant'Anna,et al.  An innovative support vector machine based method for contextual image classification , 2014 .

[22]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[23]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[24]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[25]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[26]  Glenn Healey,et al.  Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas using morphological preprocessing and independent component analysis , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[28]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Gu Yan-feng.  The Research of Simplification of Structure of Multi-class Classifier of Support Vector Machine , 2005 .

[30]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[32]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[33]  David A. Landgrebe,et al.  The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon , 1994, IEEE Trans. Geosci. Remote. Sens..

[34]  Thomas G. Dietterich.  Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[35]  Rui Zhang,et al.  Semi-Supervised Hyperspectral Image Classification Using Spatio-Spectral Laplacian Support Vector Machine , 2014, IEEE Geoscience and Remote Sensing Letters.

[36]  Masayuki Karasuyama,et al.  Multiple Graph Label Propagation by Sparse Integration , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[38]  LinLin Shen,et al.  Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[39]  J. Benediktsson,et al.  Remotely Sensed Image Classification Using Sparse Representations of Morphological Attribute Profiles , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Bor-Chen Kuo,et al.  Spatial information based support vector machine for hyperspectral image classification , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Xuelong Li,et al.  Semisupervised Dimensionality Reduction and Classification Through Virtual Label Regression , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Lawrence Carin,et al.  Sparse multinomial logistic regression: fast algorithms and generalization bounds , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  LinLin Shen,et al.  Gabor wavelets and General Discriminant Analysis for face identification and verification , 2007, Image Vis. Comput..

[44]  Glenn Healey,et al.  Hyperspectral texture recognition using a multiscale opponent representation , 2003, IEEE Trans. Geosci. Remote. Sens..

[45]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[46]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[47]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[48]  Mikhail Belkin,et al.  Semi-Supervised Learning on Riemannian Manifolds , 2004, Machine Learning.

[49]  Zhi-Hua Zhou,et al.  Semi-supervised learning using label mean , 2009, ICML '09.

[50]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .