FACE RECOGNITION USING PARTICLE SWARM OPTIMIZATION-BASED SELECTED FEATURES

Feature selection (FS) is a global optimization problem in machine learning, which reduces the number of features, removes irrelevant, noisy and redundant data, and results in acceptable recognition accuracy. It is the most important step that affects the performance of a pattern recognition system. This paper presents a novel feature selection algorithm based on particle swarm optimization (PSO). PSO is a computational paradigm based on the idea of collaborative behavior inspired by the social behavior of bird flocking or fish schooling. The algorithm is applied to coefficients extracted by two feature extraction techniques: the discrete cosine transforms (DCT) and the discrete wavelet transform (DWT). The proposed PSO-based feature selection algorithm is utilized to search the feature space for the optimal feature subset where features are carefully selected according to a well defined discrimination criterion. Evolution is driven by a fitness function defined in terms of maximizing the class separation (scatter index). The classifier performance and the length of selected feature vector are considered for performance evaluation using the ORL face database. Experimental results show that the PSO-based feature selection algorithm was found to generate excellent recognition results with the minimal set of selected features.

[1]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[2]  J. Sergent.  Microgenesis of Face Perception , 1986 .

[3]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[6]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[7]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[8]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[9]  Christine Podilchuk,et al.  Face recognition using DCT-based feature vectors , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[10]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[11]  Xiaobo Li,et al.  Experiments in simple one-dimensional lossy image compression schemes , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[12]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[13]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[14]  Chengjun Liu,et al.  Evolutionary Pursuit and Its Application to Face Recognition , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hongbin Zhang,et al.  Feature selection using tabu search method , 2002, Pattern Recognit..

[16]  A.S. Samra,et al.  Face recognition using wavelet transform, fast Fourier transform and discrete cosine transform , 2003, 2003 46th Midwest Symposium on Circuits and Systems.

[17]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[18]  ZhangYankun,et al.  Efficient face recognition method based on DCT and LDA , 2004 .

[19]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.

[20]  Brijesh Verma,et al.  FACE RECOGNITION: A NEW FEATURE SELECTION AND CLASSIFICATION TECHNIQUE , 2004 .

[21]  Bo Wang,et al.  Face recognition by fast independent component analysis and genetic algorithm , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[22]  Meng Joo Er,et al.  High-speed face recognition based on discrete cosine transform and RBF neural networks , 2005, IEEE Transactions on Neural Networks.

[23]  A. A. El-Harby,et al.  Face Recognition: A Literature Review , 2008 .

[24]  Dong-Sun Kim,et al.  Embedded face recognition based on fast genetic algorithm for intelligent digital photography , 2006, IEEE Transactions on Consumer Electronics.

[25]  Pascal Frossard,et al.  Classification-Specific Feature Sampling for Face Recognition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[26]  Ming Yu,et al.  New Face Recognition Method Based on DWT/DCT Combined Feature Selection , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[27]  Li-Yeh Chuang,et al.  Feature Selection using PSO-SVM , 2007, IMECS.

[28]  Zhenhong Jia,et al.  Human Face Recognition Based on Principal Component Analysis and Particle Swarm Optimization-BP Neural Network   , 2007, Third International Conference on Natural Computation (ICNC 2007).

[29]  Hong Yan,et al.  Wavelets and Face Recognition , 2007 .

[30]  Allen Y. Yang,et al.  Feature Selection in Face Recognition: A Sparse Representation Perspective , 2007 .

[31]  Karim Faez,et al.  Face Recognition System Using Ant Colony Optimization-Based Selected Features , 2007, 2007 IEEE Symposium on Computational Intelligence in Security and Defense Applications.

[32]  Leonardo Vidal Batista,et al.  Face recognition using DCT coefficients selection , 2008, SAC '08.