Expression-Invariant Face Recognition via 3D Face Reconstruction Using Gabor Filter Bank from a 2D Single Image

In this paper, a novel method for expression-insensitive face recognition is proposed from only a 2D single image in a gallery including any facial expressions. A 3D Generic Elastic Model (3D GEM) is used to reconstruct a 3D model of each human face in the present database using only a single 2D frontal image with/without facial expressions. Then, the rigid parts of the face are extracted from both the texture and reconstructed depth based on 2D facial land-marks. Afterwards, the Gabor filter bank was applied to the extracted rigid-part of the face to extract the feature vectors from both texture and reconstructed depth images. Finally, by combining 2D and 3D feature vectors, the final feature vectors are generated and classified by the Support Vector Machine (SVM). Favorable outcomes were acquired to handle expression changes on the available image database based on the proposed method compared to several state-of-the-arts in expression-insensitive face recognition.

[1]  Timo Ahonen,et al.  Recognition of blurred faces using Local Phase Quantization , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  Marios Savvides,et al.  3-D Generic Elastic Models for Fast and Texture Preserving 2-D Novel Pose Synthesis , 2012, IEEE Transactions on Information Forensics and Security.

[3]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Karim Faez,et al.  Makeup-Invariant Face Recognition by 3D Face: Modeling and Dual-Tree Complex Wavelet Transform from Women's 2D Real-World Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[6]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[7]  Karim Faez,et al.  Pose-Invariant Facial Expression Recognition Based on 3D Face Reconstruction and Synthesis from a Single 2D Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[8]  Hao Zhang,et al.  Expression-Invariant Face Recognition with Expression Classification , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[9]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[10]  Marios Savvides,et al.  Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[12]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Karim Faez,et al.  Facial expression invariant 3D face reconstruction from a single image using Deformable Generic Elastic Models , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[14]  Yanfeng Sun,et al.  3D face recognition using local binary patterns , 2013, Signal Process..

[15]  Karim Faez,et al.  Real-Time Pose-Invariant Face Recognition by Triplet Pose Sparse Matrix from Only a Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Rama Chellappa,et al.  A method for converting a smiling face to a neutral face with applications to face recognition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[17]  Shang-Hong Lai,et al.  An Optical Flow-Based Approach to Robust Face Recognition Under Expression Variations , 2010, IEEE Transactions on Image Processing.

[18]  Xiaojun Qi,et al.  A retrieval pattern-based inter-query learning approach for content-based image retrieval , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Bruce A. Draper,et al.  A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[21]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[22]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[24]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Chengjun Liu,et al.  A Gabor feature classifier for face recognition , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Karim Faez,et al.  Deformable Generic Elastic Models from a single 2D image for facial expression and large pose face together synthesis and recognition , 2013, 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC).

[27]  Aleix M. Martínez,et al.  Recognizing expression variant faces from a single sample image per class , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[28]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[29]  Alex Pentland,et al.  A vision system for observing and extracting facial action parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Marios Savvides,et al.  Gender and Ethnicity Specific Generic Elastic Models from a Single 2D Image for Novel 2D Pose Face Synthesis and Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Tieniu Tan,et al.  Automatic 3D face recognition from depth and intensity Gabor features , 2009, Pattern Recognit..

[32]  Liya Ding,et al.  Features versus Context: An Approach for Precise and Detailed Detection and Delineation of Faces and Facial Features , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .