Ensemble based face recognition using discriminant PCA Features

Principal Component Analysis (PCA) is one of the most widely used subspace projection technique for face recognition. In subspace methods like PCA, feature selection is fundamental to obtain better face recognition. However, the problem of finding a subset of features from a high dimensional feature set is NP-hard. Therefore, to solve the feature selection problem, heuristic methods such as evolutionary algorithms are gaining importance. In many face recognition applications, due to the small sample size (SSS) problem, it is difficult to construct a single strong classifier. Recently, ensemble learning in face recognition is gaining significance due to its ability to overcome the SSS problem. In this paper, the NP-hard problem of finding the best subset of the extracted PCA features for face recognition is solved by using the differential evolution (DE) algorithm and is referred to as FS-DE. The feature subset is obtained by maximizing the class separation in the training data. We also present an ensemble based approach for face recognition (En-FR), where different subsets of PCA features are obtained by maximizing the distance between a subset of classes of the training data instead of whole classes. The subsets of the classes are obtained by bagging and overlap each other. Each subset of the PCA features selected is used for face recognition and all the outputs are combined by a simple majority voting. The proposed algorithms, FS-DE and En-FR, are evaluated on four wellknown face databases and the performance is compared with the PCA and Fisher's LDA algorithms.

[1]  Yangsheng Wang,et al.  Boosting Gabor Feature Classifier for Face Recognition Using Random Subspace , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[2]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[3]  Mengjie Zhang,et al.  Dimensionality reduction in face detection: A genetic programming approach , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[4]  Yangsheng Wang,et al.  Boosting in Random Subspaces for Face Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Chengjun Liu,et al.  Evolutionary Pursuit and Its Application to Face Recognition , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Xiaogang Wang,et al.  Random Sampling for Subspace Face Recognition , 2006, International Journal of Computer Vision.

[7]  Xiaogang Wang,et al.  Using random subspace to combine multiple features for face recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[8]  Aaron K. Baughman Evolutionary facial feature selection , 2008, GECCO '08.

[9]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[10]  Yanqing Zhang,et al.  A genetic algorithm-based method for feature subset selection , 2008, Soft Comput..

[11]  Konstantinos N. Plataniotis,et al.  Ensemble-based discriminant learning with boosting for face recognition , 2006, IEEE Transactions on Neural Networks.

[12]  David Zhang,et al.  Bagging Evolutionary Feature Extraction Algorithm for Classification , 2007, Third International Conference on Natural Computation (ICNC 2007).

[13]  Hui Kong,et al.  Ensemble LDA for Face Recognition , 2006, ICB.

[14]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[15]  H. Moghaddam,et al.  Feature Subset Selection for Face Detection Using Genetic Algorithms and Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[16]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[18]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[19]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[20]  Weiguo Gong,et al.  Regularized Kernel Locality Preserving Discriminant Analysis for Face Recognition , 2010, ACIVS.

[21]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[22]  Hanqing Lu,et al.  An Improved Random Sampling LDA for Face Recognition , 2008, 2008 Congress on Image and Signal Processing.

[23]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[26]  Majid Nili Ahmadabadi,et al.  Directed Random Subspace Method for Face Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[27]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.