Mood Recognition Based on Upper Body Posture and Movement Features

While studying body postures in relation to mood is not a new concept, the majority of these studies rely on actors interpretations. This project investigated the temporal aspects of naturalistic body postures while users listened to mood inducing music. Video data was collected while participants listened to eight minutes of music during two sessions (happy and sad) in a within-subjects design. Subjectively reported mood scores validated that mood did differ significantly for valence and energy. Video analysis consisted of postural ratings for the head, shoulders, trunk, arms, and head and hand tapping. Results showed significant differences for the majority of these dimensions by mood. This study showed that certain body postures are indicative of certain mood states in a naturalistic setting.

[1]  F. Hesse,et al.  Experimental inductions of emotional states and their effectiveness: A review , 1994 .

[2]  Egon L. van den Broek,et al.  Guidelines for affective signal processing (ASP): From lab to life , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[3]  R. Thayer.  The Origin of Everyday Moods: Managing Energy, Tension, and Stress , 1996 .

[4]  Peter Robinson,et al.  Detecting Affect from Non-stylised Body Motions , 2007, ACII.

[5]  Guido H E Gendolla,et al.  Informational mood impact on effort-related cardiovascular response: the diagnostic value of mood counts. , 2002, Emotion.

[6]  H. Wallbott.  Bodily expression of emotion , 1998 .

[7]  Dylan M. Jones,et al.  Refining the measurement of mood: The UWIST Mood Adjective Checklist , 1990 .

[8]  M. Argyle.  Bodily communication, 2nd ed. , 1988 .

[9]  Maurizio Mancini,et al.  A Virtual Head Driven by Music Expressivity , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  G. Gendolla,et al.  Informational mood impact on effort-related cardiovascular response: the diagnostic value of mood counts. , 2002, Emotion.

[11]  Arthur C. Graesser,et al.  AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE , 2009, Appl. Artif. Intell..

[12]  J. Foley.  The co-ordination and regulation of movements , 1968 .

[13]  A. Friberg,et al.  Visual Perception of Expressiveness in Musicians' Body Movements , 2007 .

[14]  Ginevra Castellano,et al.  User-Centered Control of Audio and Visual Expressive Feedback by Full-Body Movements , 2007, ACII.

[15]  R. Piferi,et al.  An alternative approach for achieving cardiovascular baseline: viewing an aquatic video. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  Albert Mehrabian,et al.  Encoding of attitude by a seated communicator via posture and position cues. , 1969 .