Sparse data-dependent kernel principal component analysis based on least squares support vector machine for feature extraction and recognition

Kernel learning is widely used in many areas, and many methods are developed. As a famous kernel learning method, kernel principal component analysis (KPCA) endures two problems in the practical applications. One is that all training samples need to be stored for the computing the kernel matrix during kernel learning. Second is that the kernel and its parameter have the heavy influence on the performance of kernel learning. In order to solve the above problem, we present a novel kernel learning namely sparse data-dependent kernel principal component analysis through reducing the training samples with sparse learning-based least squares support vector machine and adaptive self-optimizing kernel structure according to the input training samples. Experimental results on UCI datasets, ORL and YALE face databases, and Wisconsin Breast Cancer database show that it is feasible to improve KPCA on saving consuming space and optimizing kernel structure.

[1]  Konstantinos N. Plataniotis,et al.  Face recognition using kernel direct discriminant analysis algorithms , 2003, IEEE Trans. Neural Networks.

[2]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[3]  Seng-Fong Lin,et al.  A HIERARCHICAL FACE RECOGNITION SCHEME , 2010 .

[4]  Lei Wang,et al.  A criterion for optimizing kernel parameters in KBDA for image retrieval , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[5]  W. N. Street,et al.  Computer-derived nuclear features distinguish malignant from benign breast cytology. , 1995, Human pathology.

[6]  Siham Ouamour,et al.  Speaker Clustering of Stereo Audio Documents Based on Sequential Gathering Process , 2010, J. Inf. Hiding Multim. Signal Process..

[7]  Ming-Hsuan Yang,et al.  Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  Pengfei Shi,et al.  Uncorrelated discriminant vectors using a kernel method , 2005, Pattern Recognit..

[9]  Jian Huang,et al.  Kernel machine-based one-parameter regularized Fisher discriminant method for face recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Mahantapas Kundu,et al.  Complementary Features Combined in a MLP-based System to Recognize Handwritten Devnagari Character , 2011, J. Inf. Hiding Multim. Signal Process..

[13]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[14]  Jeng-Shyang Pan,et al.  Kernel optimization-based discriminant analysis for face recognition , 2009, Neural Computing and Applications.

[15]  Ioannis Pitas,et al.  Statistical Analysis of Human Facial Expressions , 2010, J. Inf. Hiding Multim. Signal Process..

[16]  Si Wu,et al.  Improving support vector machine classifiers by modifying kernel functions , 1999, Neural Networks.

[17]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.