Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach

In this paper, we present the computational tools and a hardware prototype for 3D face recognition. Full automation is provided through the use of advanced multistage alignment algorithms, resilience to facial expressions by employing a deformable model framework, and invariance to 3D capture devices through suitable preprocessing steps. In addition, scalability in both time and space is achieved by converting 3D facial scans into compact metadata. We present our results on the largest known, and now publicly available, face recognition grand challenge 3D facial database consisting of several thousand scans. To the best of our knowledge, this is the highest performance reported on the FRGC v2 database for the 3D modality

[1]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  M. W. Koch,et al.  3D facial recognition: a quantitative analysis , 2004, 38th Annual 2004 International Carnahan Conference on Security Technology, 2004..

[4]  P. Jonathon Phillips,et al.  An Introduction to Evaluating Biometric Systems , 2000, Computer.

[5]  C. Cacou.  Anthropometry of the head and face , 1995 .

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Patrick J. Flynn,et al.  Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[8]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[9]  Zhaohui Wu,et al.  3D Face Recognition using Mapped Depth Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  Patrick Siarry,et al.  Enhanced simulated annealing for globally minimizing functions of many-continuous variables , 1997, TOMS.

[11]  Ioannis A. Kakadiaris,et al.  Expression-invariant multispectral face recognition: you can smile now! , 2006, SPIE Defense + Commercial Sensing.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[14]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ioannis A. Kakadiaris,et al.  Elastically Adaptive Deformable Models , 1996, ECCV.

[16]  PortillaJavier,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000 .

[17]  Ioannis A. Kakadiaris,et al.  Evaluation of 3D Face Recognition in the presence of facial expressions: an Annotated Deformable Model approach , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[18]  Ioannis A. Kakadiaris,et al.  m-HDAF multiresolution deformable models , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[19]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[20]  Hong Qin,et al.  Dynamic smooth subdivision surfaces for data visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[21]  Wei-Yang Lin,et al.  Fusion of Summation Invariants in 3D Human Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[23]  Ioannis A. Kakadiaris,et al.  Multimodal face recognition: combination of geometry with physiological information , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[26]  Patrick J. Flynn,et al.  Effects on facial expression in 3D face recognition , 2005, SPIE Defense + Commercial Sensing.

[27]  Georgios Papaioannou,et al.  Reconstruction of Three-Dimensional Objects through Matching of Their Parts , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Hong Qin,et al.  A novel FEM-based dynamic framework for subdivision surfaces , 1999, SMA '99.

[29]  Ioannis A. Kakadiaris,et al.  g-HDAF Multiresolution Deformable Models for Shape Modeling and Reconstruction , 2002, BMVC.

[30]  J FlynnPatrick,et al.  An Evaluation of Multimodal 2D+3D Face Biometrics , 2005 .

[31]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[32]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[33]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[34]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[35]  David Salesin,et al.  Wavelets for computer graphics: theory and applications , 1996 .

[36]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[37]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[38]  Chris Boehnen,et al.  3D Face Recognition Using 3D Alignment for PCA , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).