Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition

We present a new algorithm for 3D face recognition, and compare its performance to that of previous approaches. We focus especially on the case of facial expression change between gallery and probe images. We first establish performance comparisons using a PCA ("eigenface") algorithm and an ICP (iterative closest point) algorithm similar to ones reported in the literature. Experimental results show that the performance of either approach degrades substantially in the case Then we introduce a new algorithm, Adaptive Rigid Multi-region Selection, is introduced to independently matches multiple facial regions and creates a fused result. This algorithm is fully automated and used no manually selected landmark points. Experimental results show that our new algorithm substantially improves performance in the case of varying facial expression. Our experimental results are based on the largest 3D face dataset to date, with 449 persons, over 4,000 3D images, and substantial lapse between gallery and probe images.

[1]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Patrick J. Flynn,et al.  A Survey Of 3D and Multi-Modal 3D+2D Face Recognition , 2004 .

[3]  Anil K. Jain,et al.  Three-dimensional model based face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Charles A. Poynton,et al.  A technical introduction to digital video , 1996 .

[5]  Anil K. Jain,et al.  3D object recognition using invariant feature indexing of interpretation tables , 1992, CVGIP Image Underst..

[6]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  M. W. Koch,et al.  3D facial recognition: a quantitative analysis , 2004, 38th Annual 2004 International Carnahan Conference on Security Technology, 2004..

[8]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..

[9]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[12]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[13]  T. Yi,et al.  3D face recognition using multiple features for local depth information , 2003, Proceedings EC-VIP-MC 2003. 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications (IEEE Cat. No.03EX667).

[14]  T. Dalgleish.  Basic Emotions , 2004 .

[15]  Zhaohui Wu,et al.  Automatic 3D face verification from range data , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[16]  Michael A. Greenspan,et al.  A nearest neighbor method for efficient ICP , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[17]  Gaile G. Gordon,et al.  Face recognition based on depth maps and surface curvature , 1991, Optics & Photonics.

[18]  José F. Vélez,et al.  Face recognition using 3D surface extracted descriptors , 2003 .

[19]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[20]  Bruce A. Draper,et al.  A Statistical Assessment of Subject Factors in the PCA Recognition of Human Faces , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[21]  J FlynnPatrick,et al.  An Evaluation of Multimodal 2D+3D Face Biometrics , 2005 .

[22]  Gérard G. Medioni,et al.  Face modeling and recognition in 3-D , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[23]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[24]  Daniel Rueckert,et al.  Evaluation of automatic 4D face recognition using surface and texture registration , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[25]  Kim L. Boyer,et al.  Saliency Sequential Surface Organization for Free-Form Object Recognition , 2002, Comput. Vis. Image Underst..

[26]  I. Masuda,et al.  3D facial image analysis for human identification , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[27]  P. Jonathon Phillips,et al.  Facial Recognition Vendor Test 2000: Evaluation Report , 2001 .

[28]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .