Audiovisual analysis of relations between laughter types and laughter motions

Laughter commonly occurs in daily interactions, and is not only simply related to funny situations, but also for expressing some type of attitude, having important social functions in communication. The background of the present work is generation of natural motions in a humanoid robot, so that miscommunication might be caused if there is mismatch between audio and visual modalities, especially in laughter intervals. In the present work, we analyzed a multimodal dialogue database, and investigated the relations between different types of laughter (including production type, vowel quality, laughing style, intensity and laughter functions) and different types of motion during laughter (including facial expressions, head and body motion).

[1]  Nick Campbell,et al.  Acoustic Features of Four Types of Laughter in Natural Conversational Speech , 2011, ICPhS.

[2]  Takashi Minato,et al.  Online speech-driven head motion generating system and evaluation on a tele-operated robot , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[3]  Hiroshi Ishiguro,et al.  Head motion during dialogue speech and nod timing control in humanoid robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[5]  N. Campbell Whom we laugh with affects how we laugh , 2007 .

[6]  Takashi Minato,et al.  Motion generation in android robots during laughing speech , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Hiroshi Ishiguro,et al.  Evaluation of a formant-based speech-driven lip motion generation , 2012, INTERSPEECH.

[8]  Hiroshi Ishiguro,et al.  Generation of Nodding, Head tilting and Gazing for Human-Robot speech Interaction , 2013, Int. J. Humanoid Robotics.

[9]  Radoslaw Niewiadomski,et al.  Rhythmic Body Movements of Laughter , 2014, ICMI.

[10]  Radoslaw Niewiadomski,et al.  Perception of intensity incongruence in synthesized multimodal expressions of laughter , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[11]  Norihiro Hagita,et al.  Analysis of laughter events in real science classes by using multiple environment sensor data , 2014, INTERSPEECH.

[12]  D. Wildgruber,et al.  Formant characteristics of human laughter. , 2011, Journal of voice : official journal of the Voice Foundation.

[13]  L. Devillers,et al.  Positive and Negative emotional states behind the laughs in spontaneous spoken dialogs , 2007 .