Dimensionality Reduction of Hyperspectral Data via Spectral Feature Extraction

This paper proposes an innovative spectral feature extraction (SFE) method called prototype space (PS) feature extraction (PSFE) based only on class spectra. The main novelties of the proposed SFE lie in the following: representing channels in a new space called PS, where they are characterized in terms of reflection properties of classes; and proposing uncertainty, angle, and distance measures to distinguish highly correlated and informative channels. Having clustered the channels by Fuzzy C-Means (FCM) in PS, highly correlated and isolated channels are separated by an uncertainty measure. Consequently, PSFE is built by a linear combination of spectra weighted by class membership values of channels that fall in each cluster. Furthermore, we will enrich PSFE with informative channels which are outlier channels identified through their angle and distance with respect to diagonal and cluster centers in PS. In contrast to the previous SFE methods, PSFE substitutes the search strategies with FCM clustering to find relevant channels. Moreover, instead of optimizing separability criteria, the accuracy of classification over a subset of training data is used to decide which disjoint optical region yields maximum accuracy. According to how class spectra are obtained, PSFE incorporates four approaches: knowledge based, supervised, semisupervised, and unsupervised. The latter three PSFE approaches are assessed in two main cases including with and without informative channels and compared with the conventional feature extraction methods. Experimental results demonstrated higher overall accuracy of PSFE compared to its conventional counterparts with limited sample sizes.

[1]  Robert P. W. Duin,et al.  Feature Shaving for Spectroscopic Data , 2004, SSPR/SPR.

[2]  Masoud Nikravesh,et al.  Feature Extraction - Foundations and Applications , 2006, Feature Extraction.

[3]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Gabriele Moser,et al.  Extraction of Spectral Channels From Hyperspectral Images for Classification Purposes , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Bor-Chen Kuo,et al.  Nonparametric weighted feature extraction for classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Adolfo Martínez Usó,et al.  Comparison of Unsupervised Band Selection Methods for Hyperspectral Imaging , 2007, IbPRIA.

[8]  Bor-Chen Kuo,et al.  A robust classification procedure based on mixture classifiers and nonparametric weighted feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[9]  M. Bressan,et al.  Nonparametric discriminant analysis and nearest neighbor classification , 2003, Pattern Recognit. Lett..

[10]  Mingyi He,et al.  Band selection based on feature weighting for classification of hyperspectral data , 2005, IEEE Geoscience and Remote Sensing Letters.

[11]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[12]  Qiong Jackson,et al.  An adaptive method for combined covariance estimation and classification , 2002, IEEE Trans. Geosci. Remote. Sens..

[13]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[14]  Robert P. W. Duin,et al.  Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[16]  David A. Landgrebe,et al.  Hyperspectral data analysis and supervised feature reduction via projection pursuit , 1999, IEEE Trans. Geosci. Remote. Sens..

[17]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[18]  Joydeep Ghosh,et al.  Best-bases feature extraction algorithms for classification of hyperspectral data , 2001, IEEE Trans. Geosci. Remote. Sens..

[19]  Mahesh Pal,et al.  Support vector machine‐based feature selection for land cover classification: a case study with DAIS hyperspectral data , 2006 .

[20]  Robert P. W. Duin,et al.  Selection/Extraction of Spectral Regions for Autofluorescence Spectra Measured in the Oral Cavity , 2004, SSPR/SPR.

[21]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[22]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[23]  P. K Varshney,et al.  Advanced image processing techniques for remotely sensed hyperspectral data : with 128 figures and 30 tables , 2004 .

[24]  Bor-Chen Kuo,et al.  A covariance estimator for small sample size classification problems and its application to feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[25]  Kezhi Mao,et al.  Feature subset selection for support vector machines through discriminative function pruning analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Adolfo Martínez Usó,et al.  Clustering-based multispectral band selection using mutual information , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[27]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Lorenzo Bruzzone,et al.  A new search algorithm for feature selection in hyperspectral remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[29]  David A. Landgrebe,et al.  HYPERSPECTRAL DATA ANALYSIS AND FEATURE REDUCTION VIA PROJECTION PURSUIT , 1999 .

[30]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[31]  Robert P. W. Duin,et al.  Effectiveness of Spectral Band Selection/Extraction Techniques for Spectral Data , 2006, SSPR/SPR.

[32]  Robert P. W. Duin,et al.  Bagging, Boosting and the Random Subspace Method for Linear Classifiers , 2002, Pattern Analysis & Applications.

[33]  Luis O. Jimenez-Rodriguez,et al.  Unsupervised Linear Feature-Extraction Methods and Their Effects in the Classification of High-Dimensional Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.