Expression invariant face recognition using semidecimated DWT, Patch-LDSMT, feature and score level fusion

This paper addresses the issue of human face recognition in presence of expression variations, which pose a great challenge to face recognition systems. Typically, the discriminant features lie in both spatial as well as transform domain. In this paper, we propose combination of Discrete Wavelet Transform (DWT) and proposed Semi-decimated Discrete Wavelet Transform (SDWT) to develop an expression invariant face recognition algorithm followed by a novel wavelet coefficients enhancement function. The wavelet coefficients are boosted using the proposed coefficients enhancement function and extracted using the Weber Local Descriptors (WLD). This enhances weak skin edges based features, resulting in increased probability of recognition. The proposed algorithm also exploits spatial domain features using our customized version of Complete Local binary patterns (CLBP) named Patch Local Difference Sign Magnitude Transform (Patch-LDSMT) applied on complete images and physiologically meaningful overlapping regions of human facial images for the first time. Feature level fusion of the wavelet based features and Patch-LDSMT yields a robust feature vector whose dimensionality is reduced using Linear Discriminant Analysis (LDA). Comprehensive experimentation is carried out on the JAFFE, CMU-AMP, ORL, Yale, Cohn-Kanade (CK) and database collected by us. Benchmarking analysis illustrates that the proposed face recognition algorithm offers much better rank one recognition performance when compared with the current state-of-the-art expression invariant face recognition approaches.

[1]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[2]  Jia Tang,et al.  Simulation study on the performance of several classifiers in face recognition , 2012, FSKD.

[3]  Liu Zun-yan,et al.  Automatic Extraction and Matching of Control Points for Distortion Correction in Star-Background Image , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[4]  Massimo Tistarelli,et al.  Feature Level Fusion of Face and Fingerprint Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[5]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[6]  Jin Wang,et al.  Automatic Foreground Extraction of Head Shoulder Images , 2006, Computer Graphics International.

[7]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[8]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[9]  Tony Jan,et al.  Expression-invariant face recognition system using subspace model analysis , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[12]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[13]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[14]  Michael Beetz,et al.  A Model Based Approach for Expressions Invariant Face Recognition , 2009, ICB.

[15]  Baoxin Li,et al.  A compressive sensing approach for expression-invariant face recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Yong Cheng,et al.  Multiscale principal contour direction for varying lighting face recognition , 2010 .

[17]  M. Gokmen,et al.  Face recognition by combining Gabor wavelets and nearest neighbor discriminant analysis , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[18]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[19]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[20]  Jiashu Zhang,et al.  Wavelet Energy Entropy as a New Feature Extractor for Face Recognition , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[21]  Giuseppe Pirlo,et al.  Cosine similarity for analysis and verification of static signatures , 2013, IET Biom..

[22]  Koen Van de Velde.  Multi-scale color image enhancement , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[23]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[24]  Hao Zhang,et al.  Expression-Invariant Face Recognition with Expression Classification , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[25]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[27]  Zhao Lihong,et al.  Face Recognition Based on Image Transformation , 2009, 2009 WRI Global Congress on Intelligent Systems.

[28]  H. D. Vankayalapati,et al.  Nonlinear feature extraction approaches with application to face recognition over large databases , 2009, 2009 2nd International Workshop on Nonlinear Dynamics and Synchronization.

[29]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[30]  Brian C. Lovell,et al.  Illumination and expression invariant face recognition with one sample image , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[31]  Minh N. Do,et al.  The finite ridgelet transform for image representation , 2003, IEEE Trans. Image Process..

[32]  B. V. K. Vijaya Kumar,et al.  Face authentication for multiple subjects using eigenflow , 2003, Pattern Recognit..

[33]  Michael Weeks,et al.  Digital Signal Processing Using Matlab And Wavelets , 2006 .

[34]  A. Abbas,et al.  Expression and illumination invariant preprocessing technique for Face Recognition , 2008, 2008 International Conference on Computer Engineering & Systems.

[35]  B. Lovell,et al.  Illumination and expression invariant face recognition with one sample image , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[36]  Vipin Kumar,et al.  Face Recognition using Line Edge Map , 2014 .

[37]  Yongsheng Gao,et al.  Face Recognition Using Line Edge Map , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[39]  Shuzhi Sam Ge,et al.  Face recognition by applying wavelet subband representation and kernel associative memory , 2004, IEEE Transactions on Neural Networks.

[40]  Daijin Kim,et al.  Expression-invariant face recognition by facial expression transformations , 2008, Pattern Recognit. Lett..

[41]  W. L. Woo,et al.  Discriminant analysis of the two-dimensional Gabor features for face recognition , 2008 .

[42]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[43]  Vijayan K. Asari,et al.  Gabor Wavelet Based Modular PCA Approach for Expression and Illumination Invariant Face Recognition , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[44]  Yu-Jin Zhang,et al.  Expression-independent face recognition based on higher-order singular value decomposition , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[45]  Michael Weeks.  Digital Signal Processing Using MATLAB & Wavelets, Second Edition , 2010 .

[46]  Jie Lin,et al.  The Contourlet Transfrom and SVM Classification for Face Recognition , 2008, 2008 International Conference on Apperceiving Computing and Intelligence Analysis.

[47]  Vikas Maheshkar,et al.  Face Recognition using Geometric Measurements, Directional Edges and Directional Multiresolution Information , 2012 .

[48]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[49]  Mohamed-Jalal Fadili,et al.  The Undecimated Wavelet Decomposition and its Reconstruction , 2007, IEEE Transactions on Image Processing.

[50]  Andrew Beng Jin Teoh,et al.  Fusion of Locally Linear Embedding and Principal Component Analysis for Face Recognition (FLLEPCA) , 2005, ICAPR.

[51]  Chulho Won,et al.  Face Recognition Based on Sparse Representation Classifier with Gabor-Edge Components Histogram , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[52]  T. Rawat,et al.  Color image enhancement by scaling the discrete wavelet transform coefficients , 2013, 2013 Annual International Conference on Emerging Research Areas and 2013 International Conference on Microelectronics, Communications and Renewable Energy.

[53]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Haifeng Hu,et al.  Illumination invariant face recognition based on dual-tree complex wavelet transform , 2015, IET Comput. Vis..

[55]  S. Ramachandran,et al.  Face recognition using transform domain feature extraction and PSO-based feature selection , 2014, Appl. Soft Comput..