Face recognition under varying expressions and illumination using particle swarm optimization

Abstract Social networks generate enormous amounts of visual data. Mining of such data in recommender systems is extremely important. User profiling is carried out in recommender systems to build the holistic persona of the user. Identification and grouping of images in these systems is carried out using face recognition. It is one of the most appropriate biometric features in such situations. Ever since the first use of face recognition in security and surveillance systems, researchers have developed many methods with improved accuracy. Face recognition under variant illumination is still an open issue and diverging facial expressions reduces the accuracy even further. State of the art methods produced an average accuracy of 90%.In this study, a computationally intelligent and efficient method based on particle swarm optimization (PSO) is developed. It utilizes the features extracted from texture and wavelet domain. Discrete Wavelet Transform provides the advantage of extracting relevant features and thereby reducing computational time and an increase in recognition accuracy rate. We apply particle swarm optimization technique to select informative wavelet sub-band. Furthermore, the proposed technique uses Discrete Fourier Transform to compensate the translational variance problem of the discrete wavelet transform. The proposed method has been tested on the CK, MMI and JAFFE databases. Experimental results are compared with existing techniques and the results indicate that the proposed technique is more robust to illumination and variation in expressions, average accuracy obtained over the CK, MMI and JAFFE datasets is 98.6%, 95.5%, and 98.8% respectively.

[1]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[2]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[3]  Andrew Beng Jin Teoh,et al.  Fusion of Locally Linear Embedding and Principal Component Analysis for Face Recognition (FLLEPCA) , 2005, ICAPR.

[4]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[5]  David Zhang,et al.  A Fourier-LDA approach for image recognition , 2005, Pattern Recognit..

[6]  Mohammed Bennamoun,et al.  A spatio-temporal RBM-based model for facial expression recognition , 2016, Pattern Recognit..

[7]  David J. Kriegman,et al.  Recognition using class specific linear projection , 1997 .

[8]  Chulhee Lee,et al.  Multiscale morphology based illumination normalization with enhanced local textures for face recognition , 2016, Expert Syst. Appl..

[9]  Lin Ma,et al.  Multimodal learning for facial expression recognition , 2015, Pattern Recognit..

[10]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[11]  Shiguang Shan,et al.  Learning Expressionlets on Spatio-temporal Manifold for Dynamic Facial Expression Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  K. R. Venugopal,et al.  FRDF: Face Recognition Using Fusion of DTCWT and FFT Features☆ , 2015 .

[14]  Zhenghua Zhou,et al.  A novel face recognition method: Using random weight networks and quasi-singular value decomposition , 2015, Neurocomputing.

[15]  Manish Kumar,et al.  Face Recognition Using Principle Component Analysis, Eigenface and Neural Network , 2010, 2010 International Conference on Signal Acquisition and Processing.

[16]  Tardi Tjahjadi,et al.  A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences , 2015, Pattern Recognit..

[17]  Mita Nasipuri,et al.  A Comparative Study of Human thermal face recognition based on Haar wavelet transform (HWT) and Local Binary Pattern (LBP) , 2013, ArXiv.

[18]  Qiang Ji,et al.  Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Kishor M. Bhurchandi,et al.  Expression invariant face recognition using local binary patterns and contourlet transform , 2016 .

[20]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[21]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[22]  Tony Jan,et al.  Expression-invariant face recognition system using subspace model analysis , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[23]  Rajendran Parthiban,et al.  Spatiotemporal feature extraction for facial expression recognition , 2016, IET Image Process..

[24]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[25]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[26]  Elif Derya Übeyli,et al.  Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study , 2008, Digit. Signal Process..

[27]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[28]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[29]  Rabab M. Ramadan,et al.  FACE RECOGNITION USING PARTICLE SWARM OPTIMIZATION-BASED SELECTED FEATURES , 2009 .

[30]  S. C. Neoh,et al.  A Micro-GA Embedded PSO Feature Selection Approach to Intelligent Facial Emotion Recognition , 2017, IEEE Transactions on Cybernetics.

[31]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[32]  Surendra Ranganath,et al.  Face recognition using transform features and neural networks , 1997, Pattern Recognit..

[33]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[34]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[35]  M. Sharif,et al.  Robust Face Recognition Technique under Varying Illumination , 2015 .

[36]  Jianwei Zhao,et al.  A novel decorrelated neural network ensemble algorithm for face recognition , 2015, Knowl. Based Syst..

[37]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[38]  Baoxin Li,et al.  A compressive sensing approach for expression-invariant face recognition , 2009, CVPR.

[39]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[40]  Zheru Chi,et al.  Facial Expression Recognition in Video with Multiple Feature Fusion , 2018, IEEE Transactions on Affective Computing.

[41]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[42]  Kin-Man Lam,et al.  Illumination invariant face recognition , 2005, Pattern Recognit..