A kernel-based feature extraction method for hyperspectral image classification

Most studies showed that most hyperspectral image classification encountered the Hughes phenomenon due to the redundant features, especially in the small sample size problem. Feature extraction method such as linear discriminant analysis (LDA), nonparametric weighted feature extraction (NWFE) is a preprocessing step before classification and used to combine and reduce the original features into a new feature space based on the between-class and with-class separability. Then, the classifier such as the nonlinear support vector machine (SVM) is trained and classifies the unknown samples. However, the separability measurement of LDA and NWFE is for the original space not the kernel-induced feature space. In this study, a kernel-based feature extraction method is proposed. The corresponding transformation matrix for dimension reduction is based on the class separability in the kernel-induced feature space which was proposed in our previous study. Experimental results on the Indian Pine Site dataset show that the proposed method improves the classification performance of the SVM on the small sample size problem.

[1]  Paul Geladi,et al.  Techniques and applications of hyperspectral image analysis , 2007 .

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[4]  Lorenzo Bruzzone,et al.  A Novel Context-Sensitive Semisupervised SVM Classifier Robust to Mislabeled Training Samples , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[5]  V. Torczon,et al.  A GLOBALLY CONVERGENT AUGMENTED LAGRANGIAN ALGORITHM FOR OPTIMIZATION WITH GENERAL CONSTRAINTS AND SIMPLE BOUNDS , 2002 .

[6]  Chein-I Chang,et al.  Hyperspectral Data Exploitation , 2007 .

[7]  Bor-Chen Kuo,et al.  A Kernel-Based Feature Selection Method for SVM With RBF Kernel for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Nicholas I. M. Gould,et al.  A globally convergent Lagrangian barrier algorithm for optimization with general inequality constraints and simple bounds , 1997, Math. Comput..

[10]  Ludmila I. Kuncheva,et al.  Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chin-Teng Lin,et al.  An Automatic Method for Selecting the Parameter of the Normalized Kernel Function to Support Vector Machines , 2010, 2010 International Conference on Technologies and Applications of Artificial Intelligence.

[12]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[13]  Chein-I. Chang Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[14]  Bor-Chen Kuo,et al.  Feature Extractions for Small Sample Size Classification Problem , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[15]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[16]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[17]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[18]  Chin-Teng Lin,et al.  An automatic method for selecting the parameter of the RBF kernel function to support vector machines , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[19]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[20]  Jeng-Shyang Pan,et al.  Geometrically invariant image watermarking using Polar Harmonic Transforms , 2012, Inf. Sci..

[21]  Bor-Chen Kuo,et al.  Nonparametric weighted feature extraction for classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[22]  W. Marsden I and J , 2012 .

[23]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[24]  Alan Julian Izenman,et al.  Modern Multivariate Statistical Techniques , 2008 .

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.