Sparse Representations for Hyperspectral Data Classification

We investigate the use of sparse principal components for representing hyperspectral imagery when performing feature selection. For conventional multispectral data with low dimensionality, dimension reduction can be achieved by using traditional feature selection techniques for producing a subset of features that provide the highest class separability, or by feature extraction techniques via linear transformation. When dealing with hyperspectral data, feature selection is a time consuming task, often requiring exhaustive search of all the feature subset combinations. Instead, feature extraction technique such as PCA is commonly used. Unfortunately, PCA usually involves non-zero linear combinations or 'loadings' of all of the data. Sparse principal components are the sets of sparse vectors spanning a low-dimensional space that explain most of the variance present in the data. Our experiments show that sparse principal components having low-dimensionality still characterize the variance in the data. Sparse data representations are generally desirable for hyperspectral images because sparse representations help in human understanding and in classification.

[1]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[2]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[3]  Jorge Cadima Departamento de Matematica Loading and correlations in the interpretation of principle compenents , 1995 .

[4]  George A. Lampropoulos,et al.  Fusion of hyperspectral data using segmented PCT for color representation and classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[6]  Alexandre d'Aspremont,et al.  Optimal Solutions for Sparse Principal Component Analysis , 2007, J. Mach. Learn. Res..

[7]  Michael I. Jordan,et al.  A Direct Formulation for Sparse Pca Using Semidefinite Programming , 2004, SIAM Rev..

[8]  Alexandre d'Aspremont,et al.  Full regularization path for sparse principal component analysis , 2007, ICML '07.

[9]  R. Maitra,et al.  Supplement to “ A k-mean-directions Algorithm for Fast Clustering of Data on the Sphere ” published in the Journal of Computational and Graphical Statistics , 2009 .

[10]  I. Jolliffe,et al.  A Modified Principal Component Technique Based on the LASSO , 2003 .

[11]  Gert R. G. Lanckriet,et al.  Sparse eigen methods by D.C. programming , 2007, ICML '07.

[12]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[13]  Qian Du,et al.  Segmented PCA-based compression for hyperspectral image analysis , 2004, SPIE Optics East.

[14]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[15]  John A. Richards,et al.  Segmented principal components transformation for efficient hyperspectral remote-sensing image display and classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[16]  Fuan Tsai,et al.  Spectrally segmented principal component analysis of hyperspectral imagery for mapping invasive plant species , 2007 .

[17]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[18]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .