3D Assisted Face Recognition: Dealing With Expression Variations

One of the most critical sources of variation in face recognition is facial expressions, especially in the frequent case where only a single sample per person is available for enrollment. Methods that improve the accuracy in the presence of such variations are still required for a reliable authentication system. In this paper, we address this problem with an analysis-by-synthesis-based scheme, in which a number of synthetic face images with different expressions are produced. For this purpose, an animatable 3D model is generated for each user based on 17 automatically located landmark points. The contribution of these additional images in terms of the recognition performance is evaluated with three different techniques (principal component analysis, linear discriminant analysis, and local binary patterns) on face recognition grand challenge and Bosphorus 3D face databases. Significant improvements are achieved in face recognition accuracies, for each database and algorithm.

[1]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Lucas D. Introna,et al.  Facial Recognition Technology A Survey of Policy and Implementation Issues , 2009 .

[3]  Alan Wee-Chung Liew,et al.  Lip contour extraction using a deformable model , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[5]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[6]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Michael G. Strintzis,et al.  Pose and illumination compensation for 3D face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[8]  Marios Savvides,et al.  Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sami Romdhani,et al.  Optimal Step Nonrigid ICP Algorithms for Surface Registration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Michael G. Strintzis,et al.  Integration of 2D and 3D images for enhanced face authentication , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[11]  Marc Rioux,et al.  Face recognition with range images and intensity images , 1997 .

[12]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[13]  Michael G. Strintzis,et al.  Bilinear elastically deformable models with application to 3D face and facial expression recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[14]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[15]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 Large-Scale Experimental Results , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Firsova T,et al.  MPEG-4 compliant 3 D Face animation , 2007 .

[17]  Josef Kittler,et al.  3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[18]  Jean-Luc Dugelay,et al.  Automatic extraction of facial interest points based on 2D and 3D data , 2011, Electronic Imaging.

[19]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[20]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[21]  Yuxiao Hu,et al.  Automatic 3D reconstruction for face recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[22]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Liming Chen,et al.  A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[24]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[25]  Meng Li,et al.  A Lip Contour Extraction Method Using Localized Active Contour Model with Automatic Parameter Selection , 2010, 2010 20th International Conference on Pattern Recognition.

[26]  Anil K. Jain,et al.  Multimodal Facial Feature Extraction for Automatic 3D Face Recognition , 2005 .

[27]  Ilkay Ulusoy,et al.  3D data processing for enhancement of face scanner data , 2009, 2009 IEEE 17th Signal Processing and Communications Applications Conference.

[28]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[29]  Rama Chellappa,et al.  SFS based view synthesis for robust face recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[30]  Jean-Luc Dugelay,et al.  An Efficient Iris and Eye Corners Extraction Method , 2010, SSPR/SPR.

[31]  Behrooz Kamgar-Parsi,et al.  Face Recognition with 3D Model-Based Synthesis , 2004, ICBA.

[32]  Adrian Hilton,et al.  A Validated Method for Dense Non-rigid 3D Face Registration , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[33]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Liming Chen,et al.  Automatic Asymmetric 3D-2D Face Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[35]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[36]  Xiangdong Wang,et al.  Accurate and real-time lip contour extraction based on constrained contour growing , 2009, 2009 Joint Conferences on Pervasive Computing (JCPC).

[37]  Fabio Lavagetto,et al.  The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces , 1999, IEEE Trans. Circuits Syst. Video Technol..

[38]  Surendra Ranganath,et al.  Pose-invariant face recognition using a 3D deformable model , 2003, Pattern Recognit..

[39]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Anil K. Jain,et al.  Deformation Analysis for 3D Face Matching , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.