Fully automatic face recognition from 3D videos

Almost all of the existing research on 3D face recognition is based on static 3D images. 3D videos are believed to provide more information in terms of both the shape as well as the dynamics of an individual's face. This paper presents a system which exploits the spatiotemporal information in 3D videos for the task of face recognition. An algorithm for automatic normalization of raw 3D videos is also given. After the detection of the nose tip, all meshes of the 3D video are cropped and uniformly sampled to form range videos. Spatiotemporal Local Binary Pattern (LBP) descriptors are used for feature extraction from the range videos. For classification, a linear multiclass Support Vector Machine (SVM) is used. The system is trained on videos of a person with different facial expressions and tested on a video with new facial expression. Experimental results on the largest currently available 3D video database, BU 4DFE, show a high recognition rate of 92.68%.

[1]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[2]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[3]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Stefanos Zafeiriou,et al.  A dynamic approach to the recognition of 3D facial expressions and their temporal models , 2011, Face and Gesture 2011.

[5]  Lijun Yin,et al.  Tracking Vertex Flow and Model Adaptation for Three-Dimensional Spatiotemporal Face Analysis , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[7]  Cordelia Schmid,et al.  Evaluation of Local Spatio-temporal Features for Action Recognition , 2009, BMVC.

[8]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sharath Pankanti,et al.  BIOMETRIC IDENTIFICATION , 2000 .

[10]  Mohammed Bennamoun,et al.  A training-free nose tip detection method from face range images , 2011, Pattern Recognit..

[11]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[12]  A. O'Toole,et al.  Recognizing moving faces: a psychological and neural synthesis , 2002, Trends in Cognitive Sciences.

[13]  Lijun Yin,et al.  3D Spatio-Temporal face recognition using dynamic range model sequences , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  A. O'Toole,et al.  Psychological and neural perspectives on the role of motion in face recognition. , 2003, Behavioral and cognitive neuroscience reviews.