Estimation of the Temporal Dynamics of Posed and Spontaneous Facial Expression Formation Using LLE

When analysing facial expressions, it is not only the final expression itself, but also its formation that plays an important role when attempting to decipher its meaning. Currently in research there are two techniques for describing the dynamics of facial expression; quantitative and temporal based analysis. Quantitative-based techniques attempt to determine the amplitude of the expression in terms of intensity levels, where the levels correspond to some measure of the extent to which the expression is present on the face. Temporal-based techniques split the expression into three temporal phases (onset-apex-offset). In this paper we focus on the temporal aspects of facial expression formation, describing our research into applying a non-linear manifold extraction technique for modelling these temporal phases. We present initial results of our technique for modelling the temporal aspects of both posed and spontaneous facial expressions.

[1]  Maja Pantic,et al.  Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[2]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[3]  Gwen Littlewort,et al.  Drowsy Driver Detection Through Facial Movement Analysis , 2007, ICCV-HCI.

[4]  Matti Pietikäinen,et al.  Efficient Locally Linear Embeddings of Imperfect Manifolds , 2003, MLDM.

[5]  Changbo Hu,et al.  Manifold of facial expression , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[6]  Marian Stewart Bartlett,et al.  Automatic facial expression recognition for intelligent tutoring systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  P. Ekman,et al.  Facial Action Coding System: Manual , 1978 .

[9]  Matti Pietikäinen,et al.  Supervised Locally Linear Embedding , 2003, ICANN.

[10]  Javier Lorenzo-Navarro,et al.  Face and Facial Feature Detection Evaluation - Performance Evaluation of Public Domain Haar Detectors for Face and Facial Feature Detection , 2008, VISAPP.

[11]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[12]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Ralph Gross,et al.  Individual differences in facial expression: stability over time, relation to self-reported emotion, and ability to inform person identification , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[14]  Gwen Littlewort,et al.  Automatic Recognition of Facial Actions in Spontaneous Expressions , 2006, J. Multim..

[15]  D. D. Ridder,et al.  Locally linear embedding for classification , 2002 .

[16]  John McDonald,et al.  Automatic estimation of the dynamics of facial expression using a three-level model of intensity , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[17]  L. Saul,et al.  An Introduction to Locally Linear Embedding , 2001 .

[18]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.