Towards Automatic and Unobtrusive Recognition of Primary-Process Emotions in Body Postures

Recent years demonstrate an increased research in automatic recognition of emotions in whole-body gestures. However, most of them rely on emotional models that are still being contested or require an obtrusive way of collecting the data. We study primitive postures based on 7 primary-process and clinically measured emotions. We portray postures from theatre in front of the motion capture sensor and we conduct online surveys to discriminate primary-process emotions. We analyze low-level features from postural joints data and reveal RAGE patterns which we will use in future real-time affective interactions.

[1]  P. Ekman.  Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life , 2003 .

[2]  V. Gallese,et al.  Abstract art and cortical motor activation: an EEG study , 2012, Front. Hum. Neurosci..

[3]  Antonio Camurri,et al.  Technique for automatic emotion recognition by body gesture analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Anthony Steed,et al.  Automatic Recognition of Non-Acted Affective Postures , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Ginevra Castellano,et al.  Recognising Human Emotions from Body Movement and Gesture Dynamics , 2007, ACII.

[6]  Amy J. C. Cuddy,et al.  Power Posing , 2010, Psychological science.

[7]  Adam Wyrembelski.  Detection of the selected , basic emotions based on face expression using Kinect , 2013 .

[8]  H. Wallbott.  Bodily expression of emotion , 1998 .

[9]  A. Mehrabian.  Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[10]  H. Siddons.  Practical illustrations of rhetorical gesture and action , 2010 .

[11]  Tom Cochrane,et al.  Eight dimensions for the emotions , 2009 .

[12]  Andrea Kleinsmith,et al.  Cross-cultural differences in recognizing affect from body posture , 2006, Interact. Comput..

[13]  Albert A. Rizzo,et al.  FAAST: The Flexible Action and Articulated Skeleton Toolkit , 2011, 2011 IEEE Virtual Reality Conference.

[14]  Peter F. Driessen,et al.  Gesture-Based Affective Computing on Motion Capture Data , 2005, ACII.

[15]  Rana El Kaliouby,et al.  When Human Coders (and Machines) Disagree on the Meaning of Facial Affect in Spontaneous Videos , 2009, IVA.

[16]  Andrea Kleinsmith,et al.  Affective Body Expression Perception and Recognition: A Survey , 2013, IEEE Transactions on Affective Computing.

[17]  B. de Gelder,et al.  Body expressions influence recognition of emotions in the face and voice. , 2007, Emotion.

[18]  Daniel McDuff,et al.  A medical mirror for non-contact health monitoring , 2011, SIGGRAPH '11.

[19]  Michael Garber-Barron,et al.  Using body movement and posture for emotion detection in non-acted scenarios , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[20]  K. Scherer,et al.  The Body Action and Posture Coding System (BAP): Development and Reliability , 2012 .

[21]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[22]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[23]  K. Scherer,et al.  Emotion expression in body action and posture. , 2012, Emotion.

[24]  Andrea Kleinsmith,et al.  Recognizing Affective Dimensions from Body Posture , 2007, ACII.

[25]  Hatice Gunes,et al.  A Bimodal Face and Body Gesture Database for Automatic Analysis of Human Nonverbal Affective Behavior , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[26]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  J. Panksepp.  Cross-Species Affective Neuroscience Decoding of the Primal Affective Experiences of Humans and Related Animals , 2011, PloS one.

[28]  M. Mancini,et al.  Real-time analysis and synthesis of emotional gesture expressivity , 2007 .

[29]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[30]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[31]  J. Panksepp.  Affective neuroscience of the emotional BrainMind: evolutionary perspectives and implications for understanding depression , 2010, Dialogues in clinical neuroscience.

[32]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[33]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[34]  Daniel McDuff,et al.  Acume: A new visualization tool for understanding facial expression and gesture data , 2011, Face and Gesture 2011.

[35]  S. Paradiso,et al.  Book Review: Affective Neuroscience: The Foundations of Human and Animal Emotions , 2000 .

[36]  R. Plutchik.  Emotion, a psychoevolutionary synthesis , 1980 .

[37]  H. Siddons,et al.  Practical illustrations of rhetorical gesture and action, adapted to the English drama, from a work on the same subject by M. Engel , 1807 .