Marginal discriminant analysis using support vectors for dimensionality reduction of hyperspectral data

ABSTRACT Feature extraction (FE) is an efficient pre-processing step in hyperspectral image (HSI) classification. This article proposes a novel supervised FE method based on graph embedding framework (GEF). This method, which is called marginal discriminant analysis using support vectors (MDSV), can be used as a linear dimensionality reduction approach. The proposed method constructs inner and support graphs to capture both global and local structures of data points. The global geometrical structure of data in each class is described by the inner graph. The support graph uses support vectors (SVs) to detect the local inter-class structure of different classes. Incorporating these graphs enables MDSV to maximize the margin between classes in the projected space. Implementation of MDSV on four benchmark hyperspectral datasets confirms its efficiency as an appropriate pre-processing method before classification of HSIs.

[1]  Maryam Imani,et al.  Feature Extraction Using Attraction Points for Classification of Hyperspectral Images in a Small Sample Size Situation , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  H. Ghassemian,et al.  Feature space discriminant analysis for hyperspectral data feature reduction , 2015 .

[3]  Bor-Chen Kuo,et al.  Nonparametric weighted feature extraction for classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  WenAn Tan,et al.  Gabor feature-based face recognition using supervised locality preserving projection , 2007, Signal Process..

[5]  Hassan Ghassemian,et al.  Nonparametric feature extraction for classification of hyperspectral images with limited training samples , 2016 .

[6]  Lina Yang,et al.  Local and Global Geometric Structure Preserving and Application to Hyperspectral Image Classification , 2015 .

[7]  H. Ghassemian,et al.  Ridge regression-based feature extraction for hyperspectral data , 2015 .

[8]  K. Fukunaga.  Chapter 11 – CLUSTERING , 1990 .

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Jianmin Zhao,et al.  Gabor Feature Based Face Recognition Using Supervised Locality Preserving Projection , 2006, ACIVS.

[11]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[12]  Hassan Ghassemian,et al.  Rational function approximation for feature reduction in hyperspectral data , 2016 .

[13]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[14]  G. Foody.  Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[15]  Paul M. Mather,et al.  Support vector machines for classification in remote sensing , 2005 .

[16]  Yicong Zhou,et al.  Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Maryam Imani,et al.  Binary coding based feature extraction in remote sensing high dimensional data , 2016, Inf. Sci..

[18]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[19]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Quanxue Gao,et al.  Joint Global and Local Structure Discriminant Analysis , 2013, IEEE Transactions on Information Forensics and Security.

[21]  K. Fukunaga,et al.  Nonparametric Discriminant Analysis , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .