Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery

Recently, sparse graph-based discriminant analysis (SGDA) has been developed for the dimensionality reduction and classification of hyperspectral imagery. In SGDA, a graph is constructed by ℓ1-norm optimization based on available labeled samples. Different from traditional methods (e.g., k-nearest neighbor with Euclidean distance), weights in an ℓ1-graph derived via a sparse representation can automatically select more discriminative neighbors in the feature space. However, the sparsity-based graph represents each sample individually, lacking a global constraint on each specific solution. As a consequence, SGDA may be ineffective in capturing the global structures of data. To overcome this drawback, a sparse and low-rank graph-based discriminant analysis (SLGDA) is proposed. Low-rank representation has been proved to be capable of preserving global data structures, although it may result in a dense graph. In SLGDA, a more informative graph is constructed by combining both sparsity and low rankness to maintain global and local structures simultaneously. Experimental results on several different multiple-class hyperspectral-classification tasks demonstrate that the proposed SLGDA significantly outperforms the state-of-the-art SGDA.

[1]  Nenghai Yu,et al.  Non-negative low rank and sparse graph for semi-supervised learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Partha Pratim Talukdar,et al.  Graph-Based Semi-Supervised Learning , 2014, Graph-Based Semi-Supervised Learning.

[4]  Changsheng Xu,et al.  Inductive Robust Principal Component Analysis , 2012, IEEE Transactions on Image Processing.

[5]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[6]  Fei Wang,et al.  Graph-based semi-supervised learning , 2009, Artificial Life and Robotics.

[7]  Antonio J. Plaza,et al.  Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[8]  Qian Du,et al.  Gabor-Filtering-Based Nearest Regularized Subspace for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  James E. Fowler,et al.  Decision Fusion in Kernel-Induced Spaces for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  YanShuicheng,et al.  Learning with l1-graph for image analysis , 2010 .

[11]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[12]  Jon Atli Benediktsson,et al.  Intrinsic Image Decomposition for Feature Extraction of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Licheng Jiao,et al.  A simplified low rank and sparse graph for semi-supervised learning , 2014, Neurocomputing.

[15]  G. Shaw,et al.  Signal processing for hyperspectral image exploitation , 2002, IEEE Signal Process. Mag..

[16]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[18]  James E. Fowler,et al.  Noise-Adjusted Subspace Discriminant Analysis for Hyperspectral Imagery Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[19]  Qian Du,et al.  Combined sparse and collaborative representation for hyperspectral target detection , 2015, Pattern Recognit..

[20]  Wei Li,et al.  Wavelet-based nearest-regularized subspace for noise-robust hyperspectral image classification , 2014 .

[21]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[22]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[23]  Trac D. Tran,et al.  Abundance Estimation for Bilinear Mixture Models via Joint Sparse and Low-Rank Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[25]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[26]  Antonio J. Plaza,et al.  Anomaly Detection in Hyperspectral Images Based on Low-Rank and Sparse Representation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[28]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Weiyue Li,et al.  Low-rank and sparse matrix decomposition-based anomaly detection for hyperspectral imagery , 2014 .

[30]  Qian Du,et al.  Hyperspectral Image Classification Using Band Selection and Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[32]  Qian Du,et al.  Semisupervised Band Clustering for Dimensionality Reduction of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[33]  Qian Du,et al.  Collaborative Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Hamid R. Rabiee,et al.  Supervised neighborhood graph construction for semi-supervised classification , 2012, Pattern Recognit..

[35]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[36]  Qian Du,et al.  Particle Swarm Optimization-Based Hyperspectral Dimensionality Reduction for Urban Land Cover Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[39]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[40]  Qian Du,et al.  Modified Fisher's Linear Discriminant Analysis for Hyperspectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[41]  Qian Du,et al.  Semisupervised Discriminant Analysis for Hyperspectral Imagery With Block-Sparse Graph , 2015, IEEE Geoscience and Remote Sensing Letters.

[42]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[44]  George Michailidis,et al.  Graph-Based Semisupervised Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.