A non-negative sparse semi-supervised dimensionality reduction algorithm for hyperspectral data

Abstract A non-negative sparse semi-supervised dimensionality reduction algorithm is proposed for hyperspectral data by making adequate use of a few labeled samples and a large number of unlabeled samples. The objective function of the proposed algorithm consists of two terms: (1) a discriminant item is designed to analyze a few labeled samples from the global viewpoint, which can assess the separability between surface objects; (2) a regularization term is used to build a non-negative sparse representation graph based on the unlabeled samples, which can adaptively find an adjacency graph for each sample and then find valuable samples with huge information volume from the original hyperspectral data. Based on the objective function and the maximum margin criterion, a dimensionality reduction algorithm, the non-negative sparse semi-supervised maximum margin algorithm, is proposed. Experimental results on the ROSIS University and AVIRIS 92AV3C hyperspectral data sets show that the proposed algorithm can effectively utilize the unlabeled samples to achieve higher overall classification accuracy and Kappa coefficient when compared with some representative supervised, unsupervised and semi-supervised dimensionality reduction algorithms.

[1]  Thierry Bouwmans,et al.  Background subtraction via incremental maximum margin criterion: a discriminative subspace approach , 2012, Machine Vision and Applications.

[2]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[3]  Daoqiang Zhang,et al.  Semi-Supervised Dimensionality Reduction ∗ , 2007 .

[4]  Feiping Nie,et al.  A unified framework for semi-supervised dimensionality reduction , 2008, Pattern Recognit..

[5]  Wei Liang,et al.  A Graph Based Subspace Semi-supervised Learning Framework for Dimensionality Reduction , 2008, ECCV.

[6]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[7]  George W. Irwin,et al.  MISEP Method for Postnonlinear Blind Source Separation , 2007, Neural Computation.

[8]  Yang-Lang Chang,et al.  Band selection for hyperspectral images based on impurity function , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Wai Keung Wong.  Discover latent discriminant information for dimensionality reduction: Non-negative Sparseness Preserving Embedding , 2012, Pattern Recognit..

[10]  Haytham Elghazel,et al.  Feature Selection for Unsupervised Learning Using Random Cluster Ensembles , 2010, 2010 IEEE International Conference on Data Mining.

[11]  De-Shuang Huang,et al.  Using FCMC, FVS, and PCA techniques for feature extraction of multispectral images , 2005, IEEE Geosci. Remote. Sens. Lett..

[12]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[13]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Chein-I Chang,et al.  Progressive dimensionality reduction by transform for hyperspectral imagery , 2011, Pattern Recognit..

[15]  De-Shuang Huang,et al.  Extracting nonlinear features for multispectral images by FCMC and KPCA , 2005, Digit. Signal Process..

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[18]  Xiaoyang Tan,et al.  Sparsity preserving discriminant analysis for single training image face recognition , 2010, Pattern Recognit. Lett..

[19]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[20]  Michael G. Pecht,et al.  Health Monitoring of Cooling Fans Based on Mahalanobis Distance With mRMR Feature Selection , 2012, IEEE Transactions on Instrumentation and Measurement.

[21]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[22]  颜露新,et al.  Spectral deconvolution and feature extraction with robust adaptive tikhonov regularization , 2013 .

[23]  Chao Wang,et al.  Feature extraction using constrained maximum variance mapping , 2008, Pattern Recognit..

[24]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Norimichi Tsumura,et al.  Principal component analysis for dental shade color. , 2012, Dental materials : official publication of the Academy of Dental Materials.

[26]  Jian Li,et al.  Semi-supervised feature selection under logistic I-RELIEF framework , 2008, 2008 19th International Conference on Pattern Recognition.

[27]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[28]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  U. D. Annakkage,et al.  Prediction of the Transient Stability Boundary Using the Lasso , 2013, IEEE Transactions on Power Systems.