Tensor Low-Rank Discriminant Embedding for Hyperspectral Image Dimensionality Reduction

Recently, low-rank embedding (LRE) has yielded satisfactory results in dimensionality reduction (DR), for which low-rank representation and projection learning are integrated into one model to generate robust low-dimensional features. However, LRE requires to convert samples into vectors even if the data naturally appear in high-order form. Furthermore, LRE fails to take the label information into consideration. To address these problems, this paper proposes a novel supervised DR method based on multilinear algebra, i.e., the algebra of tensors. By the motivation of extending LRE into tensor space and simultaneously combining the tensor discriminant analysis, we establish tensor low-rank discriminant embedding (TLRDE) model for hyperspectral image (HSI) DR. The model of TLRDE is solved by an alternative iteration algorithm, whose convergence is also mathematically proven. The proposed TLRDE method employs the tensor representation to preserve the intrinsic geometrical structure, uses low-rank reconstruction to uncover the potential relationship among the data points, and combines label information to enhance the discriminability of features. Moreover, the proposed TLRDE does not suffer from the small sample size problem. The experimental results on three real HSI data sets validate the effectiveness of our proposed TLRDE method.

[1]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[2]  Chengzhi Deng,et al.  Orthogonal Nonnegative Matrix Factorization Combining Multiple Features for Spectral–Spatial Dimensionality Reduction of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Wei Li,et al.  Discriminant Analysis of Hyperspectral Imagery Using Fast Kernel Sparse and Low-Rank Graph , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[7]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[8]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[10]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[11]  Licheng Jiao,et al.  Hyperspectral Band Selection Using Improved Classification Map , 2017, IEEE Geoscience and Remote Sensing Letters.

[12]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[15]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[16]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[17]  Liangpei Zhang,et al.  Tensor Discriminative Locality Alignment for Hyperspectral Image Spectral–Spatial Feature Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[19]  William J. Emery,et al.  Tensor locality preserving projection for hyperspectral image classification , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Daoqiang Zhang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[23]  Qiang Zhang,et al.  Joint segmentation and reconstruction of hyperspectral data with compressed measurements. , 2011, Applied optics.

[24]  Jon Atli Benediktsson,et al.  Multiple Spectral–Spatial Classification Approach for Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[26]  Qian Du,et al.  Modified Tensor Locality Preserving Projection for Dimensionality Reduction of Hyperspectral Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[27]  Qi Wang,et al.  Hyperspectral Band Selection by Multitask Sparsity Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jon Atli Benediktsson,et al.  Support Tensor Machines for Classification of Hyperspectral Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[30]  YanShuicheng,et al.  Learning with l1-graph for image analysis , 2010 .

[31]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[32]  Shiming Xiang,et al.  Discriminant Tensor Spectral–Spatial Feature Extraction for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[33]  Aleksandra Pizurica,et al.  Semisupervised Local Discriminant Analysis for Feature Extraction in Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[35]  Filiberto Pla,et al.  Spectral–Spatial Pixel Characterization Using Gabor Filters for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[36]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Wai Keung Wong,et al.  Low-Rank Embedding for Robust Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[38]  Qian Du,et al.  Collaborative Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Changsheng Xu,et al.  General Subspace Learning With Corrupted Training Data Via Graph Embedding , 2013, IEEE Transactions on Image Processing.

[40]  Michele Dalponte,et al.  Tree Species Classification in Boreal Forests With Hyperspectral Data , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Changsheng Xu,et al.  Inductive Robust Principal Component Analysis , 2012, IEEE Transactions on Image Processing.

[42]  Johannes R. Sveinsson,et al.  Hyperspectral Feature Extraction Using Total Variation Component Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[44]  Xiuping Jia,et al.  Wavelet Packet Analysis and Gray Model for Feature Extraction of Hyperspectral Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[45]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Qian Du,et al.  Optimized Hyperspectral Band Selection Using Particle Swarm Optimization , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.