Particle swarm optimization for human face recognition

Feature selection (FS) is a global optimization problem in machine learning that reduces the number of features, removes irrelevant, noisy and redundant data, and results in acceptable recognition accuracy. It is the most important step that affects the performance of a pattern recognition system. This paper presents a novel feature selection algorithm based on particle swarm optimization (PSO). The algorithm is applied to coefficients extracted by two feature extraction techniques: the discrete cosine transform (DCT) and the discrete wavelet transform (DWT). The proposed PSO-based feature selection algorithm is utilized to search the feature space for the optimal feature subset where features are carefully selected according to a well defined discrimination criterion. Evolution is driven by a fitness function defined in terms of maximizing the class separation (scatter index). The classifier performance and the length of selected feature vector are considered for performance evaluation using the ORL face database. Experimental results show that the PSO-based feature selection algorithm was found to generate excellent recognition results with the minimal set of selected features.

[1]  Chengjun Liu,et al.  Evolutionary Pursuit and Its Application to Face Recognition , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Liu Chong-qing,et al.  Efficient face recognition method based on DCT and LDA , 2004 .

[3]  J. Sergent.  Microgenesis of Face Perception , 1986 .

[4]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[5]  Zhenhong Jia,et al.  Human Face Recognition Based on Principal Component Analysis and Particle Swarm Optimization-BP Neural Network   , 2007, Third International Conference on Natural Computation (ICNC 2007).

[6]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[7]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[8]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[9]  Karim Faez,et al.  Face Recognition System Using Ant Colony Optimization-Based Selected Features , 2007, 2007 IEEE Symposium on Computational Intelligence in Security and Defense Applications.

[10]  Hongbin Zhang,et al.  Feature selection using tabu search method , 2002, Pattern Recognit..

[11]  Hong Yan,et al.  Wavelets and Face Recognition , 2007 .

[12]  Meng Joo Er,et al.  High-speed face recognition based on discrete cosine transform and RBF neural networks , 2005, IEEE Transactions on Neural Networks.

[13]  A. A. El-Harby,et al.  Face Recognition: A Literature Review , 2008 .

[14]  Leonardo Vidal Batista,et al.  Face recognition using DCT coefficients selection , 2008, SAC '08.

[15]  Allen Y. Yang,et al.  Feature Selection in Face Recognition: A Sparse Representation Perspective , 2007 .

[16]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Dong-Sun Kim,et al.  Embedded face recognition based on fast genetic algorithm for intelligent digital photography , 2006, IEEE Transactions on Consumer Electronics.

[18]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[19]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[20]  A.S. Samra,et al.  Face recognition using wavelet transform, fast Fourier transform and discrete cosine transform , 2003, 2003 46th Midwest Symposium on Circuits and Systems.

[21]  Brijesh Verma,et al.  FACE RECOGNITION: A NEW FEATURE SELECTION AND CLASSIFICATION TECHNIQUE , 2004 .

[22]  Ming Yu,et al.  New Face Recognition Method Based on DWT/DCT Combined Feature Selection , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[23]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[24]  Li-Yeh Chuang,et al.  Feature Selection using PSO-SVM , 2007, IMECS.

[25]  Christine Podilchuk,et al.  Face recognition using DCT-based feature vectors , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[26]  Pascal Frossard,et al.  Classification-Specific Feature Sampling for Face Recognition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[27]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[28]  Xiaobo Li,et al.  Experiments in simple one-dimensional lossy image compression schemes , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[29]  Bo Wang,et al.  Face recognition by fast independent component analysis and genetic algorithm , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[30]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[31]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.