Multimodal corpus of multi-party meetings for automatic social behavior analysis and personality traits detection

This paper describes an automatically annotated multimodal corpus of multi-party meetings. The corpus provides for each subject involved in the experimental sessions information on her/his social behavior and personality traits, as well as audiovisual cues (speech rate, pitch and energy, head orientation, head, hand and body fidgeting). The corpus is based on the audio and video recordings of thirteen sessions, which took place in a lab setting equipped with cameras and microphones. Our main concern in collecting this corpus was to investigate the possibility of creating a system capable of automatically analyzing social behaviors and predicting personality traits using audio-visual cues.

[1]  Fabio Pianesi,et al.  A multimodal annotated corpus of consensus decision making meetings , 2007, Lang. Resour. Evaluation.

[2]  Jay Hall,et al.  The Effects of a Normative Intervention on Group Decision-Making Performance , 1970 .

[3]  James W. Davis.  Hierarchical motion history images for recognizing human motion , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[4]  Jonas Beskow,et al.  Wavesurfer - an open source speech tool , 2000, INTERSPEECH.

[5]  Samy Bengio,et al.  Towards Computer Understanding of Human Interactions , 2003, EUSAI.

[6]  Wallace W. Tourtellotte,et al.  Interaction , 1988 .

[7]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[8]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[9]  L. B. Rosenfeld,et al.  The Measurement of Cohesion and its Relationship to Dimensions of Self-Disclosure in Classroom Settings , 1989 .

[10]  R. Bales,et al.  Personality and Interpersonal Behavior. , 1971 .

[11]  Anne H. Soukhanov,et al.  The american heritage dictionary of the english language , 1992 .

[12]  Daniel Gatica-Perez,et al.  Detection and application of influence rankings in small group meetings , 2006, ICMI '06.

[13]  Alexander H. Waibel.  CHIL - Computers in the Human Interaction Loop , 2005, MVA.

[14]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[15]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[16]  Mary P. Harper,et al.  VACE Multimodal Meeting Corpus , 2005, MLMI.

[17]  Dennis R. Wixon,et al.  CHI '02 Extended Abstracts on Human Factors in Computing Systems , 2002, CHI 2002.

[18]  J. Stokes,et al.  Toward an understanding of cohesion in personal change groups. , 1983, International journal of group psychotherapy.

[19]  Alexander H. Waibel,et al.  Modeling focus of attention for meeting indexing , 1999, MULTIMEDIA '99.

[20]  Fabio Pianesi,et al.  Automatic detection of group functional roles in face to face interactions , 2006, ICMI '06.

[21]  P. H. Lodhi,et al.  The Five-Factor Model of Personality , 2002 .

[22]  K. Bollen,et al.  Perceived Cohesion: A Conceptual and Empirical Examination , 1990 .