Expression training for complex emotions using facial expressions and head movements

Imitation is an important aspect of emotion recognition. We present an expression training interface which evaluates the imitation of facial expressions and head movements. The system provides feedback on complex emotion expression, via an integrated emotion classifier which can recognize 18 complex emotions. Feedback is also provided for exact-expression imitation via dynamic time warping. Discrepancies in intensity and frequency of action units are communicated via simple graphs. This work has applications as a training tool for customer-facing professionals and people with Autism Spectrum Conditions.

[1]  Peter Robinson,et al.  Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[2]  P. Niedenthal,et al.  When did her smile drop? Facial mimicry and the influences of emotional state on the detection of change in emotional expression , 2001 .

[3]  H. Wallbott.  Recognition of emotion from facial expression via imitation? Some indirect evidence for an old theory. , 1991, The British journal of social psychology.

[4]  Marian Stewart Bartlett,et al.  Automatic Facial Expression Recognition , 2014 .

[5]  Jeffrey F. Cohn,et al.  Intra- and Interpersonal Functions of Head Motion in Emotion Communication , 2014, RFMIR '14.

[6]  T. Field,et al.  Discrimination and imitation of facial expression by neonates. , 1982, Science.

[7]  Bilge Mutlu,et al.  MACH: my automated conversation coach , 2013, UbiComp.

[8]  Thomas Dierks,et al.  The development and evaluation of a computer-based program to test and to teach the recognition of facial affect , 2002, International journal of circumpolar health.

[9]  C. Tardif,et al.  Author manuscript, published in "Journal of Autism and Developmental Disorders (2007) 1469-1484" 1 , 2008 .

[10]  Cecilia Heyes,et al.  Facial Self-Imitation , 2013, Psychological science.

[11]  Maja Pantic,et al.  The first facial expression recognition and analysis challenge , 2011, Face and Gesture 2011.

[12]  Lipps Theodor.  Das Wissen von fremden Ichen , 1907 .

[13]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[14]  Daniel Lundqvist,et al.  The EU-Emotion Stimulus Set: A validation study , 2016, Behavior research methods.

[15]  K. Loveland,et al.  Imitation and expression of facial affect in autism , 1994, Development and Psychopathology.

[16]  V. Ramachandran,et al.  Face to face: Blocking facial mimicry can selectively impair recognition of emotional expressions , 2007, Social neuroscience.

[17]  Shogo Nishida,et al.  iFace: A facial expression training system , 2007, IFAC HMS.

[18]  Peter Sturmey,et al.  Generalized imitation of facial models by children with autism. , 2007, Journal of applied behavior analysis.