Weighted Feature Space Representation with Kernel for Image Classification

The kernel method is a very effective and popular method to extract features from data such as images. A novel method is presented to enhance traditional kernel method for face image representation in this paper, which is very suitable to treat the high-dimensional datasets. The proposed method is called weighted kernel representation-based method (WKRBM) in this paper. WKRBM assumes that the test sample can be expressed by all the training samples and linear solution in the mapping space. It uses the obtained linear combination to recognize face images. In particular, the coefficients of a linear combination can be set as the optimal weight that is an important factor to obtain better performance for image classification. The rationale, characteristics, and advantages of the proposed method are presented. The analysis describes that WKRBM outperforms collaborative representation-based kernel method for image recognition. Extensive experimental results illustrate that WKRBM has partial properties of sparsity, which is effective to recognize images.

[1]  David Zhang,et al.  Individualized learning for improving kernel Fisher discriminant analysis , 2016, Pattern Recognit..

[2]  Jingyu Yang,et al.  Optimal FLD algorithm for facial feature extraction , 2001, SPIE Optics East.

[3]  Ming-Hsuan Yang,et al.  Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[4]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[5]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[6]  Stephen A. Billings,et al.  Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm , 2002, Neural Networks.

[7]  Marc Teboulle,et al.  A fast Iterative Shrinkage-Thresholding Algorithm with application to wavelet-based image deblurring , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Jian Yang,et al.  Why can LDA be performed in PCA transformed space? , 2003, Pattern Recognit..

[9]  David Zhang,et al.  A fast kernel-based nonlinear discriminant analysis for multi-class problems , 2006, Pattern Recognit..

[10]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[11]  Konstantinos N. Plataniotis,et al.  Face recognition using kernel direct discriminant analysis algorithms , 2003, IEEE Trans. Neural Networks.

[12]  Yong-Qing Cheng,et al.  An Efficient Algorithm for Foley-Sammon Optimal Set of Discriminant Vectors by Algebraic Method , 1992, Int. J. Pattern Recognit. Artif. Intell..

[13]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[14]  David Zhang,et al.  A method for speeding up feature extraction based on KPCA , 2007, Neurocomputing.

[15]  Gavin C. Cawley,et al.  Efficient leave-one-out cross-validation of kernel fisher discriminant classifiers , 2003, Pattern Recognit..

[16]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Gunnar Rätsch,et al.  A Mathematical Programming Approach to the Kernel Fisher Algorithm , 2000, NIPS.

[18]  Hui Li,et al.  KCRC-LCD: Discriminative kernel collaborative representation with locality constrained dictionary for visual categorization , 2014, Pattern Recognit..

[19]  Seyed Ali Ghorashi,et al.  Compressive Sensing-Based PSD Map Construction in Cognitive Radio Networks , 2014 .

[20]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[22]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[23]  Yong Xu,et al.  Feature space-based human face image representation and recognition , 2012 .

[24]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[25]  Josef Kittler,et al.  Multi-label classification using stacked spectral kernel discriminant analysis , 2016, Neurocomputing.

[26]  Gunnar Rätsch,et al.  Constructing Descriptive and Discriminative Nonlinear Features: Rayleigh Coefficients in Kernel Feature Spaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Sheng Chen,et al.  Regression based D-optimality experimental design for sparse kernel density estimation , 2010, Neurocomputing.

[28]  Guoqiang Wang,et al.  Embedded Manifold-Based Kernel Fisher Discriminant Analysis for Face Recognition , 2016, Neural Processing Letters.

[29]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[30]  Iickho Song,et al.  A computationally efficient scheme for feature extraction with kernel discriminant analysis , 2016, Pattern Recognit..

[31]  Jian Yang,et al.  Robust sparse coding for face recognition , 2011, CVPR 2011.