Analyses of the Differences between Posed and Spontaneous Facial Expressions

This paper presents comprehensive analyses of the differences between posed and spontaneous expressions from visible images. First, geometric and appearance features are extracted from the difference images between apex and onset facial images. Secondly, the differences between the posed and spontaneous facial expressions are analyzed through hypothetical testing methods from three aspects: on overall samples, on samples with different genders, and on samples with different expressions. Thirdly, Bayesian networks (BNs) are used to classify posed versus spontaneous expressions from the same three aspects. Statistical analyses on the NVIE database demonstrate the importance of the geometric and appearance features for discriminating posed and spontaneous expressions. Gender effect exists on the differences between posed and spontaneous expressions. It is easier to distinguish posed happiness from spontaneous happiness than other expressions. Recognition experimental results confirm the observations of statistical analyses in most cases.

[1]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[2]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[3]  Craig A. Smith,et al.  The facial muscle patterning of posed and imagery-induced expressions of emotion by expressive and nonexpressive posers , 1986 .

[4]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[7]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J. Cohn,et al.  Movement Differences between Deliberate and Spontaneous Facial Expressions: Zygomaticus Major Action in Smiling , 2006, Journal of nonverbal behavior.

[9]  Maja Pantic,et al.  Spontaneous vs. posed facial behavior: automatic analysis of brow actions , 2006, ICMI '06.

[10]  Yunus Saatci,et al.  Cascaded classification of gender and facial expression using active appearance models , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[11]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[12]  Hatice Gunes,et al.  How to distinguish posed from spontaneous smiles using geometric features , 2007, ICMI '07.

[13]  Qiang Ji,et al.  Multi-view face and eye detection using discriminant features , 2007, Comput. Vis. Image Underst..

[14]  Gwen Littlewort,et al.  Automatic coding of facial expressions displayed during posed and genuine pain , 2009, Image Vis. Comput..

[15]  Chrysa D. Lithari,et al.  Are Females More Responsive to Emotional Stimuli? A Neurophysiological Study Across Arousal and Valence Dimensions , 2009, Brain Topography.

[16]  John McDonald,et al.  Estimation of the Temporal Dynamics of Posed and Spontaneous Facial Expression Formation Using LLE , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[17]  M. Ottley.  Posed and genuine smiles: an evoked response potentials study. , 2009 .

[18]  Fei Chen,et al.  A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference , 2010, IEEE Transactions on Multimedia.

[19]  Albert Ali Salah,et al.  Eyes do not lie: spontaneous versus posed smiles , 2010, ACM Multimedia.

[20]  Vinod Chandran,et al.  Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions , 2011, ICONIP.

[21]  Albert Ali Salah,et al.  Classification of spontaneous and posed smiles , 2011, 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU).

[22]  M. Seckington,et al.  Using Dynamic Bayesian Networks for Posed versus Spontaneous Facial Expression Recognition , 2011 .

[23]  Matti Pietikäinen,et al.  Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[24]  R. Lowry,et al.  Concepts and Applications of Inferential Statistics , 2014 .