Sparse matrix transform-based linear discriminant analysis for hyperspectral image classification

Due to the high dimensionality of hyperspectral image (HSI), dimension reduction or feature extraction is usually needed before the HSI classification. Traditional linear discriminant analysis (LDA) method for feature extraction usually encounters difficulty because the available training samples in HSI classification are limited, which causes the singularity of data scatter matrix. In this paper, we propose a sparse matrix transform-based LDA (SMT-LDA) algorithm for the HSI classification. By using SMT, the total scatter matrix used in LDA can be constrained to have an eigen-decomposition where the eigenvectors can be sparsely parametrized by a limited number of Givens rotations. In this way, the estimated scatter matrix is always positive definite and well conditioned even in the case of limited training samples. The proposed SMT-LDA method is compared with regularized LDA and PCA-LDA methods on two benchmark hyperspectral data sets. Experimental results indicate that the performance of the proposed method is overall superior to these methods, especially for small-sample-size classification.

[1]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[2]  Prabir Bhattacharya,et al.  A criterion for measuring the separability of clusters and its applications to principal component analysis , 2011, Signal Image Video Process..

[3]  Yong-Qing Cheng,et al.  An Efficient Algorithm for Foley-Sammon Optimal Set of Discriminant Vectors by Algebraic Method , 1992, Int. J. Pattern Recognit. Artif. Intell..

[4]  M. Borengasser,et al.  Hyperspectral Remote Sensing: Principles and Applications , 2007 .

[5]  Ying Wang,et al.  Improved SDA based on mixed weighted Mahalanobis distance , 2014, Signal, Image and Video Processing.

[6]  Charles A. Bouman,et al.  Sparse Matrix Transform for Hyperspectral Image Processing , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Yen-Po Lee Palm vein recognition based on a modified $$\text{(2D)}^{2}\text{ LDA}$$ , 2015, Signal Image Video Process..

[8]  David J. Kriegman,et al.  Recognition using class specific linear projection , 1997 .

[9]  Yicong Zhou,et al.  Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Charles A. Bouman,et al.  The Sparse Matrix Transform for Covariance Estimation and Analysis of High Dimensional Signals , 2011, IEEE Transactions on Image Processing.

[11]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[12]  Charles A. Bouman,et al.  Covariance Estimation for High Dimensional Data Vectors Using the Sparse Matrix Transform , 2008, NIPS.

[13]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[14]  J. Friedman Regularized Discriminant Analysis , 1989 .

[15]  Yuan Yan Tang,et al.  Error Analysis of Coefficient-Based Regularized Algorithm for Density-Level Detection , 2013, Neural Computation.

[16]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[17]  Jiangtao Peng Sparse matrix transform based weight updating in partial least squares regression , 2014, Journal of Mathematical Chemistry.

[18]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Fadi Dornaika,et al.  Exponential Local Discriminant Embedding and Its Application to Face Recognition , 2013, IEEE Transactions on Cybernetics.

[20]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[21]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[22]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.