PCA-based feature extraction using class information

Feature extraction is necessary to classify a data with large dimension such as image data. It is important that the obtained features include the maximum information of input data. The representative methods for feature extraction are PCA, ICA, LDA and MLP etc. PCA, LDA are unsupervised type algorithms, and LDA, MLP are supervised type algorithms. Supervised type algorithms are more suitable for feature extraction because of using input data with class information. In this paper, we suggest the feature extraction scheme which uses class information to extract features by PCA. We test our algorithm using Yale face database and analyze the performance to compare with other algorithms.

[1]  I. Jolliffe Principal Component Analysis , 2002 .

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Gregory Piatetsky-Shapiro,et al.  Advances in Knowledge Discovery and Data Mining , 2004, Lecture Notes in Computer Science.

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  Hongjun Lu,et al.  Effective Data Mining Using Neural Networks , 1996, IEEE Trans. Knowl. Data Eng..

[6]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Chong-Ho Choi,et al.  Feature Extraction Based on ICA for Binary Classification Problems , 2003, IEEE Trans. Knowl. Data Eng..

[8]  Witold Pedrycz,et al.  Data Mining Methods for Knowledge Discovery , 1998, IEEE Trans. Neural Networks.

[9]  Terrence J. Sejnowski,et al.  Blind separation and blind deconvolution: an information-theoretic approach , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Narendra Ahuja,et al.  Face recognition using feature extraction based on independent component analysis , 2002, Proceedings. International Conference on Image Processing.

[11]  Huan Liu,et al.  A connectionist approach to generating oblique decision trees , 1999, IEEE Trans. Syst. Man Cybern. Part B.