Real-Time Pose-Invariant Face Recognition by Triplet Pose Sparse Matrix from Only a Single Image

In this paper, a novel method for real-time pose-invariant face recognition is proposed from only a single image in a gallery including any facial expressions. A 3D Facial Expression Generic Elastic Model (3D FE-GEM) is proposed to reconstruct 3D model of each human face in the present database using only a single 2D frontal image. Then, for each person in the database, a Triplet Pose Sparse Matrix (TPSM) is created from all face poses by rotating the 3D reconstructed models and extracting features in rotated face. Each TPSM is subsequently rendered based on triplet angles of face poses. Before matching to TPSM, an initial estimate of triplet angles of face poses is obtained in the test face image/video using an automatic head pose estimation approach. Then, an array of the TPSM is selected based on the estimated triplet angles for each subject. Finally, the selected arrays from TPSMs are compared with target image by joint dynamic sparse representation classification. Favorable outcomes were acquired to handle pose and expression changes on the available image and video databases based on the proposed method compared to several state-of-the-arts in pose-invariant face recognition.

[1]  Marios Savvides,et al.  Gender and Ethnicity Specific Generic Elastic Models from a Single 2D Image for Novel 2D Pose Face Synthesis and Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[3]  Marios Savvides,et al.  3-D Generic Elastic Models for Fast and Texture Preserving 2-D Novel Pose Synthesis , 2012, IEEE Transactions on Information Forensics and Security.

[4]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Karim Faez,et al.  Deformable Generic Elastic Models from a single 2D image for facial expression and large pose face together synthesis and recognition , 2013, 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC).

[6]  Luc Van Gool,et al.  Real Time Head Pose Estimation from Consumer Depth Cameras , 2011, DAGM-Symposium.

[7]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Marios Savvides,et al.  Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Thomas S. Huang,et al.  Joint dynamic sparse representation for multi-view face recognition , 2012, Pattern Recognit..

[10]  Ioannis A. Kakadiaris,et al.  3D/4D facial expression analysis: An advanced annotated face model approach , 2012, Image Vis. Comput..

[11]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[12]  Stan Z. Li,et al.  Towards Pose Robust Face Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Bill Triggs,et al.  Visual Recognition Using Local Quantized Patterns , 2012, ECCV.

[14]  Liya Ding,et al.  Features versus Context: An Approach for Precise and Detailed Detection and Delineation of Faces and Facial Features , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Karim Faez,et al.  Pose-Invariant Facial Expression Recognition Based on 3D Face Reconstruction and Synthesis from a Single 2D Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Nicolas Pinto,et al.  Beyond simple features: A large-scale feature search approach to unconstrained face recognition , 2011, Face and Gesture 2011.

[17]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Karim Faez,et al.  Expression-Invariant Face Recognition via 3D Face Reconstruction Using Gabor Filter Bank from a 2D Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[19]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[20]  Karim Faez,et al.  Makeup-Invariant Face Recognition by 3D Face: Modeling and Dual-Tree Complex Wavelet Transform from Women's 2D Real-World Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[21]  Emmanuel Dellandréa,et al.  A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models , 2013, Image Vis. Comput..

[22]  Frédéric Jurie,et al.  Face Recognition using Local Quantized Patterns , 2012, BMVC.

[23]  Karim Faez,et al.  Facial expression invariant 3D face reconstruction from a single image using Deformable Generic Elastic Models , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[24]  Marios Savvides,et al.  Individual Kernel Tensor-Subspaces for Robust Face Recognition: A Computationally Efficient Tensor Framework Without Requiring Mode Factorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Jonghyun Choi,et al.  Robust pose invariant face recognition using coupled latent space discriminant analysis , 2012, Comput. Vis. Image Underst..

[26]  Thomas S. Huang,et al.  Pose-robust face recognition via sparse representation , 2013, Pattern Recognit..