HMM-based geometric signatures for compact 3D face representation and matching

3D face recognition(s) systems improve current 2D image-based approaches, but in general they are required to deal with larger amounts of data. Therefore, a compact representation of 3D faces is often crucial for a better manipulation of data, in the context of 3D face applications such as smart card identity verification systems. We propose a new compact 3D representation by focusing on the most significant parts of the face. We introduce a generative learning approach by adapting Hidden Markov Models (HMM) to work on 3D meshes. The geometry of local area around face fiducial points is modeled by training HMMs which provide a robust pose invariant point signature. Such description allows the matching by comparing the signature of corresponding points in a maximum-likelihood principle. We show that our descriptor is robust for recognizing expressions and performs faster than the current ICP-based 3D face recognition systems by maintaining a satisfactory recognition rate. Preliminary results on a subset of the FRGC 2.0 dataset are reported by considering subjects under different expressions.

[1]  Alexander M. Bronstein,et al.  Expression-invariant three-dimensional face recognition , 2005 .

[2]  Chin-Seng Chua,et al.  Face recognition from 2D and 3D images using 3D Gabor filters , 2005, Image Vis. Comput..

[3]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[4]  Michael G. Strintzis,et al.  Integration of 2D and 3D images for enhanced face authentication , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Remco C. Veltkamp,et al.  A Survey of 3D Face Recognition Methods , 2005, AVBPA.

[6]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[7]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J. Vélez,et al.  Face recognition using 3D local geometrical features: PCA vs. SVM , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[9]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[11]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[12]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[13]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[15]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  A. Lue,et al.  The phenomenology of Dvali–Gabadadze–Porrati cosmologies , 2005, astro-ph/0510068.

[17]  Sylvain Petitjean,et al.  A survey of methods for recovering quadrics in triangle meshes , 2002, CSUR.

[18]  C. Cacou.  Anthropometry of the head and face , 1995 .

[19]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).