Expressive Maps for 3D Facial Expression Recognition

We present a semi-automatic 3D Facial Expression Recognition system based on geometric facial information. In this approach, the 3D facial meshes are first fitted to an Annotated Face Model (AFM). Then, the Expressive Maps are computed, which indicate the parts of the face that are most expressive according to a particular geometric feature (e.g., vertex coordinates, normals, and local curvature). The Expressive Maps provide a way to analyze the geometric features in terms of their discriminative information and their distribution along the face and allow the reduction of the dimensionality of the input space to 2:5% of the original size. Using the selected features a simple linear classifier was trained and yielded a very competitive average recognition rate of 90:4% when evaluated using ten-fold cross validation on the publicly available BU-3DFE database.

[1]  Jun Wang,et al.  3D Facial Expression Recognition Based on Primitive Surface Feature Distribution , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Thomas S. Huang,et al.  3D facial expression recognition based on automatically selected features , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Ioannis A. Kakadiaris,et al.  3D facial expression recognition: A perspective on promises and challenges , 2011, Face and Gesture 2011.

[4]  T. Theoharis,et al.  Partial matching of interpose 3D facial data for face recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[5]  Thomas S. Huang,et al.  Expression recognition from 3D dynamic faces using robust spatio-temporal shape features , 2011, Face and Gesture 2011.

[6]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael G. Strintzis,et al.  Bilinear Models for 3-D Face and Facial Expression Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[8]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ioannis A. Kakadiaris,et al.  Elastically Adaptive Deformable Models , 1996, ECCV.

[10]  Peter Eisert,et al.  Algorithms For Automatic And Robust Registration Of 3D Head Scans , 2010, J. Virtual Real. Broadcast..

[11]  Hasan Demirel,et al.  Facial Expression Recognition Using 3D Facial Feature Distances , 2007, ICIAR.

[12]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[13]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[14]  Ioannis A. Kakadiaris,et al.  Which parts of the face give out your identity? , 2011, CVPR 2011.

[15]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[16]  Xing Zhang,et al.  Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis , 2011, Face and Gesture 2011.

[17]  Michael G. Strintzis,et al.  3D facial expression recognition using swarm intelligence , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.