Analysis of the occurrence of laughter in meetings

Automatic speech understanding in natural multiparty conversation settings stands to gain from parsing not only verbal but also non-verbal vocal communicative behaviors. In this work, we study the most frequently annotated non-verbal behavior, laughter, whose detection has clear implications for speech understanding tasks, and for the automatic recognition of affect in particular. To complement existing acoustic descriptions of the phenomenon, we explore the temporal patterning of laughter over the course of conversation, with a view towards its automatic segmentation and detection. We demonstrate that participants vary extensively in their use of laughter, and that laughter differs from speech in its duration and in the regularity of its occurrence. We also show that laughter and speech are quite dissimilar in terms of the degree of simultaneous vocalization by multiple participants, and in terms of the probability of transitioning into and out of vocalization overlap states. Index Terms: laughter, vocal interaction, multiparty meetings, Markov models.

[1]  Andreas Stolcke,et al.  The ICSI Meeting Corpus , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  G. Jefferson A technique for inviting laughter and its subsequent acceptance/declination , 1979 .

[3]  J. Russell,et al.  Facial and vocal expressions of emotion. , 2003, Annual review of psychology.

[4]  J. Bachorowski,et al.  The acoustic features of human laughter. , 2001, The Journal of the Acoustical Society of America.

[5]  Andreas Stolcke,et al.  Observations on overlap: findings and implications for automatic processing of multi-party conversation , 2001, INTERSPEECH.

[6]  Elizabeth Shriberg,et al.  The ICSI Meeting Recorder Dialog Act (MRDA) Corpus , 2004, SIGDIAL Workshop.

[7]  Tanja Schultz,et al.  Modeling Vocal Interaction for Segmentation in Meeting Recognition , 2007, MLMI.

[8]  David A. van Leeuwen,et al.  Automatic discrimination between laughter and speech , 2007, Speech Commun..

[9]  Elizabeth Shriberg,et al.  Spontaneous speech: how people really talk and why engineers should care , 2005, INTERSPEECH.

[10]  Daniel P. W. Ellis,et al.  Laughter Detection in Meetings , 2004 .

[11]  Kornel Laskowski,et al.  Annotation and Analysis of Emotionally Relevant Behavior in the ISL Meeting Corpus , 2006, LREC.

[12]  R. Provine Contagious laughter: Laughter is a sufficient stimulus for laughs and smiles , 1992 .

[13]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[14]  J. Trouvain Phonetic Aspects of "Speech-Laughs" , 2001 .