Alternative face models for 3D face registration

3D has become an important modality for face biometrics. The accuracy of a 3D face recognition system depends on a correct registration that aligns the facial surfaces and makes a comparison possible. The best results obtained so far use a one-to-all registration approach, which means each new facial surface is registered to all faces in the gallery, at a great computational cost. We explore the approach of registering the new facial surface to an average face model (AFM), which automatically establishes correspondence to the pre-registered gallery faces. Going one step further, we propose that using a couple of well-selected AFMs can trade-off computation time with accuracy. Drawing on cognitive justifications, we propose to employ category-specific alternative average face models for registration, which is shown to increase the accuracy of the subsequent recognition. We inspect thin-plate spline (TPS) and iterative closest point (ICP) based registration schemes under realistic assumptions on manual or automatic landmark detection prior to registration. We evaluate several approaches for the coarse initialization of ICP. We propose a new algorithm for constructing an AFM, and show that it works better than a recent approach. Finally, we perform simulations with multiple AFMs that correspond to different clusters in the face shape space and compare these with gender and morphology based groupings. We report our results on the FRGC 3D face database.

[1]  Daniel Rueckert,et al.  Evaluation of automatic 4D face recognition using surface and texture registration , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  Zhaohui Wu,et al.  3d Face Recognition from Range Data , 2005, Int. J. Image Graph..

[3]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[4]  Lale Akarun,et al.  2D/3D facial feature extraction , 2006, Electronic Imaging.

[5]  Yong Yan,et al.  A system for the automatic extraction of 3-D facial feature points for face model calibration , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Bülent Sankur,et al.  Robust facial landmarking for registration , 2007, Ann. des Télécommunications.

[8]  D. Kendall MORPHOMETRIC TOOLS FOR LANDMARK DATA: GEOMETRY AND BIOLOGY , 1994 .

[9]  Xiangyang Ju,et al.  Constructing dense correspondences for the analysis of 3D facial morphology , 2006, Pattern Recognit. Lett..

[10]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  Anil K. Jain,et al.  Detection of Anchor Points for 3D Face Veri.cation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[13]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[14]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[15]  Albert Ali Salah,et al.  3D Facial Feature Localization for Registration , 2006, MRCS.

[16]  Albert Ali Salah,et al.  Incremental mixtures of factor analysers , 2004, ICPR 2004.

[17]  Berk Gökberk,et al.  3D shape-based face recognition using automatically registered facial surfaces , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Garrison W. Cottrell,et al.  Are Greebles Special? Or, Why the Fusiform Fish Area Would be Recruited for Sword Expertise (If We had One) , 2005 .

[19]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.