Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement

In this study, we tested the feasibility of capturing video of facial ­expressions while concurrently capturing motion capture and video of bodily expressions. To collect facial expression data, we used a custom designed head-mount for a video camera that provided images for facial expression microanalysis but did not limit freedom of movement. We assessed the effect of the head-mount on emotion elicitation, emotion recognition, qualitative aspects of body movement, and quantitative aspects of body movement. The results indicate that while the head-mount may slightly constrain arm movement, wearing the head-mounted camera during motion capture is a valid method for collecting facial and bodily data.

[1]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[2]  D. Kahneman,et al.  Well-being : the foundations of hedonic psychology , 1999 .

[3]  Loïc Kessous,et al.  Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech , 2008, Affect and Emotion in Human-Computer Interaction.

[4]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[5]  Klaus R. Scherer,et al.  Vocal indicators of mood change in depression , 1996 .

[6]  Wanqing Li,et al.  A Real-Time Facial Expression Recognition System for Online Games , 2008, Int. J. Comput. Games Technol..

[7]  D. Watson,et al.  Assessing positive and negative affect via self-report. , 2007 .

[8]  Michelle Karg,et al.  Recognition of Affect Based on Gait Patterns , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  D. Janssen,et al.  Recognition of Emotions in Gait Patterns by Means of Artificial Neural Nets , 2008 .

[10]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[11]  G. Labouvie-vief,et al.  Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. , 2003, Emotion.

[12]  H. Wallbott.  Bodily expression of emotion , 1998 .

[13]  P. Ekman,et al.  Emotion, physiology, and expression in old age. , 1991, Psychology and aging.

[14]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[15]  Minetada Osano,et al.  Therapeutic Tool for Develop Child Nonverbal Communication Skills through Interactive Game , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[16]  Norman I. Badler,et al.  A motion control scheme for animating expressive arm movements , 1999 .

[17]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[18]  Gwen Littlewort,et al.  Drowsy Driver Detection Through Facial Movement Analysis , 2007, ICCV-HCI.

[19]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[20]  J. Montepare,et al.  The identification of emotions from gait information , 1987 .

[21]  B. Fredrickson,et al.  Measurement issues in emotion research. , 1999 .

[22]  J. Bachorowski.  Vocal Expression and Perception of Emotion , 1999 .

[23]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[24]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[25]  K. Scherer,et al.  Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? , 2007, Emotion.

[26]  Lorenzo Torresani,et al.  Learning Motion Style Synthesis from Perceptual Observations , 2006, NIPS.

[27]  K. Scherer,et al.  Multimodal expression of emotion: affect programs or componential appraisal patterns? , 2007, Emotion.