Classification of emotional content of sighs in dyadic human interactions

Emotions are an important part of human communication and are expressed both verbally and non-verbally. Common nonverbal vocalizations such as laughter, cries and sighs carry important emotional content in conversations. Sighs often are associated with negative emotion. In this work, we show that emotional sighs exist along both ends of the valence axis (positive-emotion vs. negative-emotion sighs) in spontaneous affective dialogs and that they have certain distinct multimodal characteristics. Classification results show that it is possible to differentiate between the two types of emotionally valenced sighs, using a combination of acoustic and gestural features with an overall unweighted accuracy of 58.26%.

[1]  Merlin Suarez,et al.  Discovering Emotions in Filipino Laughter Using Audio Features , 2010, 2010 3rd International Conference on Human-Centric Computing.

[2]  S. Scott,et al.  Perceptual Cues in Nonverbal Vocal Expressions of Emotion , 2010 .

[3]  Sophie K. Scott,et al.  Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations , 2010, Proceedings of the National Academy of Sciences.

[4]  J. Gottman,et al.  Daily marital interactions and positive affect during marital conflict among newlywed couples. , 2004, Family process.

[5]  Jonas Beskow,et al.  Wavesurfer - an open source speech tool , 2000, INTERSPEECH.

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  Shrikanth Narayanan,et al.  Automatic acoustic synthesis of human-like laughter. , 2007, The Journal of the Acoustical Society of America.

[8]  Carlos Busso,et al.  IEMOCAP: interactive emotional dyadic motion capture database , 2008, Lang. Resour. Evaluation.

[9]  Kornel Laskowski.  Finding emotionally involved speech using implicitly proximity-annotated laughter , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  V. Reddy,et al.  Sharing humour and laughter in autism and Down's syndrome. , 2002, British journal of psychology.

[11]  Karl Halvor Teigen,et al.  Is a sigh "just a sigh"? Sighs as emotional signals and responses to a difficult task. , 2008, Scandinavian journal of psychology.

[12]  Shrikanth S. Narayanan,et al.  Primitives-based evaluation and estimation of emotions in speech , 2007, Speech Commun..

[13]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[14]  K. Kikuchi,et al.  Estimation of babies' emotion by frequency analyses of their cries , 2005 .