Evaluation of 3D Face Recognition in the presence of facial expressions: an Annotated Deformable Model approach

From a user’s perspective, face recognition is one of the most desirable biometrics, due to its non-intrusive nature; however, variables such as face expression tend to severely affect recognition rates. We have applied to this problem our previous work on elastically adaptive deformable models to obtain parametric representations of the geometry of selected localized face areas using an annotated face model. We then use wavelet analysis to extract a compact biometric signature, thus allowing us to perform rapid comparisons on either a global or a per area basis. To evaluate the performance of our algorithm, we have conducted experiments using data from the Face Recognition Grand Challenge data corpus, the largest and most established data corpus for face recognition currently available. Our results indicate that our algorithm exhibits high levels of accuracy and robustness, and is not gender biased. In addition, it is minimally affected by facial expressions.

[1]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[2]  Hong Qin,et al.  Dynamic smooth subdivision surfaces for data visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[3]  Marc Acheroy,et al.  Automatic 3D face authentication , 2000, Image Vis. Comput..

[4]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[5]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[6]  Patrick J. Flynn,et al.  Effects on facial expression in 3D face recognition , 2005, SPIE Defense + Commercial Sensing.

[7]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[8]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[9]  Ioannis A. Kakadiaris,et al.  Expression-invariant multispectral face recognition: you can smile now! , 2006, SPIE Defense + Commercial Sensing.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Chris Boehnen,et al.  3D Face Recognition Using 3D Alignment for PCA , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[16]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  M. W. Koch,et al.  3D facial recognition: a quantitative analysis , 2004, 38th Annual 2004 International Carnahan Conference on Security Technology, 2004..

[18]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[19]  Patrick Siarry,et al.  Enhanced simulated annealing for globally minimizing functions of many-continuous variables , 1997, TOMS.

[20]  Jon Louis Bentley,et al.  Quad trees a data structure for retrieval on composite keys , 1974, Acta Informatica.

[21]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[22]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[23]  David Salesin,et al.  Wavelets for computer graphics - theory and applications , 1996, The Morgan Kaufmann series in computer graphics and geometric modeling.

[24]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[25]  Andrea Salgian,et al.  Face recognition with visible and thermal infrared imagery , 2003, Comput. Vis. Image Underst..

[26]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[27]  Jim Austin,et al.  Three-dimensional face recognition: an eigensurface approach , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[28]  P. Jonathon Phillips,et al.  An Introduction to Evaluating Biometric Systems , 2000, Computer.

[29]  C. Cacou.  Anthropometry of the head and face , 1995 .

[30]  Shihong Lao,et al.  3D template matching for pose invariant face recognition using 3D facial model built with isoluminance line based stereo vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[31]  Zhaohui Wu,et al.  3D Face Recognition using Mapped Depth Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[32]  Hong Qin,et al.  A novel FEM-based dynamic framework for subdivision surfaces , 1999, SMA '99.

[33]  Ioannis A. Kakadiaris,et al.  g-HDAF Multiresolution Deformable Models for Shape Modeling and Reconstruction , 2002, BMVC.

[34]  Patrick J. Flynn,et al.  Visible-light and Infrared Face Recognition , 2003 .

[35]  Ioannis A. Kakadiaris,et al.  Multimodal face recognition: combination of geometry with physiological information , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Georgios Papaioannou,et al.  Reconstruction of Three-Dimensional Objects through Matching of Their Parts , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Joseph Wilder,et al.  Comparison of visible and infra-red imagery for face recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[38]  Ioannis A. Kakadiaris,et al.  g-HDAF Multiresolution Deformable Models , 2002, AMDO.

[39]  Wei-Yang Lin,et al.  Fusion of Summation Invariants in 3D Human Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[40]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[41]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[42]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[43]  Patrick J. Flynn,et al.  Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[44]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[45]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[46]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[47]  Surendra Ranganath,et al.  Pose-invariant face recognition using a 3D deformable model , 2003, Pattern Recognit..

[48]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[49]  J FlynnPatrick,et al.  An Evaluation of Multimodal 2D+3D Face Biometrics , 2005 .

[50]  Gérard G. Medioni,et al.  Face modeling and recognition in 3-D , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[51]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[52]  Ioannis A. Kakadiaris,et al.  m-HDAF multiresolution deformable models , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[53]  Anil K. Jain,et al.  Face modeling for recognition , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[54]  Ioannis A. Kakadiaris,et al.  Elastically Adaptive Deformable Models , 1996, ECCV.

[55]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Fernand S. Cohen,et al.  3-D face structure extraction and recognition from images using 3-D morphing and distance mapping , 2002, IEEE Trans. Image Process..

[57]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.