Unconstrained pose-invariant face recognition by a triplet collaborative dictionary matrix

We propose a novel method for real-world pose-invariant face recognition.Proposed method used from a single image in gallery with any facial expressions.We generate a collaborative dictionary matrix for each people.Promising results were obtained to handle pose on the FERET, LFW and video databases. In this paper, a novel method is proposed for unconstrained pose-invariant face recognition from only an image in a gallery. A 3D face is initially reconstructed using only a 2D frontal image. Then, for each person in the gallery, a Triplet Collaborative Dictionary Matrix (TCDM) is created from all face poses by rotating the 3D reconstructed models and extracting features in rotated face. Each TCDM is subsequently rendered based on triplet angles of face poses. Finally, the classification is performed by Collaborative Representation Classification (CRC) with Regularized Least Square (RLS). Promising results were acquired to handle pose changes on the FERET, LFW and video face databases compared to state-of-the-art methods in pose-invariant face recognition.

[1]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Marios Savvides,et al.  Gender and Ethnicity Specific Generic Elastic Models from a Single 2D Image for Novel 2D Pose Face Synthesis and Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[4]  Yun Fu,et al.  Learning low-rank and discriminative dictionary for image classification , 2014, Image Vis. Comput..

[5]  Luc Van Gool,et al.  Real Time Head Pose Estimation from Consumer Depth Cameras , 2011, DAGM-Symposium.

[6]  Josef Kittler,et al.  Fast pose invariant face recognition using super coupled multiresolution Markov Random Fields on a GPU , 2014, Pattern Recognit. Lett..

[7]  Yun Fu,et al.  Graph embedded analysis for head pose estimation , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Marios Savvides,et al.  3-D Generic Elastic Models for Fast and Texture Preserving 2-D Novel Pose Synthesis , 2012, IEEE Transactions on Information Forensics and Security.

[9]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[10]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[11]  P. Jonathon Phillips,et al.  Face recognition based on frontal views generated from non-frontal images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[14]  Karim Faez,et al.  Real-Time Pose-Invariant Face Recognition by Triplet Pose Sparse Matrix from Only a Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[15]  Karim Faez,et al.  Pose-Invariant Facial Expression Recognition Based on 3D Face Reconstruction and Synthesis from a Single 2D Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Daijin Kim,et al.  Generating frontal view face image for pose invariant face recognition , 2006, Pattern Recognit. Lett..

[18]  Karim Faez,et al.  Expression-invariant three-dimensional face reconstruction from a single image by facial expression generic elastic models , 2014, J. Electronic Imaging.

[19]  Lei Zhang,et al.  Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[21]  Jonghyun Choi,et al.  Robust pose invariant face recognition using coupled latent space discriminant analysis , 2012, Comput. Vis. Image Underst..

[22]  Patrick J. Flynn,et al.  A sparse representation approach to face matching across plastic surgery , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[23]  Wen Gao,et al.  Cross-pose face recognition based on partial least squares , 2011, Pattern Recognit. Lett..

[24]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[25]  Frédéric Jurie,et al.  Face Recognition using Local Quantized Patterns , 2012, BMVC.

[26]  Yanning Zhang,et al.  2D representation of facial surfaces for multi-pose 3D face recognition , 2012, Pattern Recognit. Lett..

[27]  Rama Chellappa,et al.  Pose-Invariant Face Recognition Using Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[28]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[29]  Karim Faez,et al.  Deformable Generic Elastic Models from a single 2D image for facial expression and large pose face together synthesis and recognition , 2013, 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC).

[30]  Surendra Ranganath,et al.  Pose-invariant face recognition using a 3D deformable model , 2003, Pattern Recognit..

[31]  Ali Moeini,et al.  Real-World and Rapid Face Recognition Toward Pose and Expression Variations via Feature Library Matrix , 2015, IEEE Transactions on Information Forensics and Security.

[32]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[33]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Daniel González-Jiménez,et al.  Toward Pose-Invariant 2-D Face Recognition Through Point Distribution Models and Facial Symmetry , 2007, IEEE Transactions on Information Forensics and Security.

[35]  Karim Faez,et al.  Expression-Invariant Face Recognition via 3D Face Reconstruction Using Gabor Filter Bank from a 2D Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[36]  Karim Faez,et al.  Unrestricted pose-invariant face recognition by sparse dictionary matrix , 2015, Image Vis. Comput..

[37]  Stan Z. Li,et al.  Towards Pose Robust Face Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.