Probabilistic class structure regularized sparse representation graph for semi-supervised hyperspectral image classification

Abstract Graph-based semi-supervised learning (SSL), which performs well in hyperspectral image classification with a small amount of labeled samples, has drawn a lot of attention in the past few years. The key step of graph-based SSL is to construct a good graph to represent original data structures. Among the existing graph construction methods, sparse representation (SR) based methods have shown impressive performance on graph-based SSL. However, most SR based methods fail to take into consideration the class structure of data. In SSL, we can obtain a probabilistic class structure, which implies the probabilistic relationship between each sample and each class, of the whole data by utilizing a small amount of labeled samples. Such class structure information can help SR model to yield a more discriminative coefficients, which motivates us to exploit this class structure information in order to learn a discriminative graph. In this paper, we present a discriminative graph construction method called probabilistic class structure regularized sparse representation (PCSSR) approach, by incorporating the class structure information into the SR model, PCSSR can learn a discriminative graph from the data. A class structure regularization is developed to make use of the probabilistic class structure, and therefore to improve the discriminability of the graph. We formulate our problem as a constrained sparsity minimization problem and solve it by the alternating direction method with adaptive penalty (ADMAP). The experimental results on Hyperion and AVIRIS hyperspectral data show that our method outperforms state of the art.

[1]  Li Ma,et al.  Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification , 2016, Pattern Recognit. Lett..

[2]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[3]  Qiong Jackson,et al.  An adaptive classifier design for high-dimensional data analysis with a limited training data set , 2001, IEEE Trans. Geosci. Remote. Sens..

[4]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[5]  Lin Zhao,et al.  Blind spectral unmixing based on sparse component analysis for hyperspectral remote sensing imagery , 2016 .

[6]  Hamid R. Rabiee,et al.  Supervised neighborhood graph construction for semi-supervised classification , 2012, Pattern Recognit..

[7]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[8]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[9]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[10]  Jun Li,et al.  Improved hyperspectral image classification by active learning using pre-designed mixed pixels , 2016, Pattern Recognit..

[11]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[12]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[13]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Shuigeng Zhou,et al.  Learning Sparse Representations from Datasets with Uncertain Group Structures: Model, Algorithm and Applications , 2015, AAAI.

[15]  Cheng Shi,et al.  Superpixel-based 3D deep neural networks for hyperspectral image classification , 2018, Pattern Recognit..

[16]  Zoubin Ghahramani,et al.  Learning from labeled and unlabeled data with label propagation , 2002 .

[17]  Liang-Tien Chia,et al.  Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding, and Applications , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Xin Yu,et al.  Spatial Regularized Local Manifold Learning for Classification of Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[21]  Ran He,et al.  Nonnegative sparse coding for discriminative semi-supervised learning , 2011, CVPR 2011.

[22]  Yi Shen,et al.  Learning group-based sparse and low-rank representation for hyperspectral image classification , 2016, Pattern Recognit..

[23]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.

[24]  Hanspeter Pfister,et al.  Semi-supervised learning with explicit relationship regularization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Ling Shao,et al.  A Multigraph Representation for Improved Unsupervised/Semi-supervised Learning of Human Actions , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[28]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[29]  G. Shaw,et al.  Signal processing for hyperspectral image exploitation , 2002, IEEE Signal Process. Mag..

[30]  René Vidal,et al.  Subspace Clustering , 2011, IEEE Signal Processing Magazine.

[31]  Jiangtao Peng,et al.  Regularized set-to-set distance metric learning for hyperspectral image classification , 2016, Pattern Recognit. Lett..

[32]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[33]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[34]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[35]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Bernhard Schölkopf,et al.  Transductive Classification via Local Learning Regularization , 2007, AISTATS.

[37]  Jun Guo,et al.  An Evaluation on Different Graphs for Semi-supervised Learning , 2011, IScIDE.

[38]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[39]  Liangpei Zhang,et al.  Semisupervised Subspace-Based DNA Encoding and Matching Classifier for Hyperspectral Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Donato Malerba,et al.  A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data , 2017, Pattern Recognit..

[41]  Lin Li,et al.  Spectral-spatial hyperspectral image ensemble classification via joint sparse representation , 2016, Pattern Recognit..

[42]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[43]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[44]  Yong Peng,et al.  Enhanced low-rank representation via sparse manifold adaption for semi-supervised learning , 2015, Neural Networks.

[45]  Chun Chen,et al.  Graph Regularized Sparse Coding for Image Representation , 2011, IEEE Transactions on Image Processing.

[46]  Nenghai Yu,et al.  Non-negative low rank and sparse graph for semi-supervised learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Jinhui Tang,et al.  Constructing a Nonnegative Low-Rank and Sparse Graph With Data-Adaptive Features , 2014, IEEE Transactions on Image Processing.

[48]  Zhang Liangpei,et al.  Spatial-Spectral Unsupervised Convolutional Sparse Auto-Encoder Classifier for Hyperspectral Imagery , 2017 .

[49]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[50]  Bernt Schiele,et al.  Multi-graph Based Semi-supervised Learning for Activity Recognition , 2009, 2009 International Symposium on Wearable Computers.

[51]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Jon Atli Benediktsson,et al.  Joint bilateral filtering and spectral similarity-based sparse representation: A generic framework for effective feature extraction and data classification in hyperspectral imaging , 2017, Pattern Recognit..

[53]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[54]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[55]  Changxin Gao,et al.  A discriminant sparse representation graph-based semi-supervised learning for hyperspectral image classification , 2015, Multimedia Tools and Applications.

[56]  Yan Guo,et al.  Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Huan Xu,et al.  Noisy Sparse Subspace Clustering , 2013, J. Mach. Learn. Res..

[58]  Yuan Yan Tang,et al.  Manifold-Based Sparse Representation for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[59]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.