The Teams Corpus and Entrainment in Multi-Party Spoken Dialogues

When interacting individuals entrain, they begin to speak more like each other. To support research on entrainment in cooperative multi-party dialogues, we have created a corpus where teams of three or four speakers play two rounds of a cooperative board game. We describe the experimental design and technical infrastructure used to collect our corpus, which consists of audio, video, transcriptions, and questionnaire data for 63 teams (47 hours of audio). We illustrate the use of our corpus as a novel resource for studying team entrainment by 1) developing and evaluating teamlevel acoustic-prosodic entrainment measures that extend existing dyad measures, and 2) investigating relationships between team entrainment and participation dominance.

[1]  Paul R. Yost,et al.  Potency in groups: articulating a construct. , 1993, The British journal of social psychology.

[2]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Susannah B. F. Paletz,et al.  Lexical entrainment and success in student engineering groups , 2012, 2012 IEEE Spoken Language Technology Workshop (SLT).

[4]  Erin V. Lehman,et al.  Team Diagnostic Survey , 2005 .

[5]  Cristian Danescu-Niculescu-Mizil,et al.  Conversational Markers of Constructive Discussions , 2016, NAACL.

[6]  R. Porzel.  How Entrainment Increases Dialogical Effectiveness , 2006 .

[7]  Julia Hirschberg,et al.  Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions , 2011, INTERSPEECH.

[8]  Giuseppe Carenini,et al.  Detecting Disagreement in Conversations using Pseudo-Monologic Rhetorical Structure , 2014, EMNLP.

[9]  Julia Hirschberg,et al.  Acoustic-Prosodic Entrainment and Social Behavior , 2012, NAACL.

[10]  Heather Pon-Barry,et al.  Acoustic-Prosodic Entrainment and Rapport in Collaborative Learning Dialogues , 2014, MLA@ICMI.

[11]  Maxine Eskénazi,et al.  Automated two-way entrainment to improve spoken dialog system performance , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Athanasios Katsamanis,et al.  An Analysis of PCA-Based Vocal Entrainment Measures in Married Couples' Affective Spoken Interactions , 2011, INTERSPEECH.

[13]  Susannah B. F. Paletz,et al.  Assessing group-level participation in fluid teams: Testing a new metric , 2011, Behavior research methods.

[14]  D. Beal,et al.  Cohesion and performance in groups: a meta-analytic clarification of construct relations. , 2003, The Journal of applied psychology.

[15]  James E. Driskell,et al.  Collective Orientation and Team Performance: Development of an Individual Differences Measure , 2010, Hum. Factors.

[16]  Justine Cassell,et al.  Fine-Grained Analyses of Interpersonal Processes and Their Effect on Learning , 2015, AIED.

[17]  E. Naveh,et al.  Do personal characteristics and cultural values that promote innovation, quality, and efficiency compete or complement each other? , 2004 .

[18]  Kristy Elizabeth Boyer,et al.  From Strangers to Partners: Examining Convergence within a Longitudinal Study of Task-Oriented Dialogue , 2012, SIGDIAL Conference.

[19]  Julia Hirschberg,et al.  High Frequency Word Entrainment in Spoken Dialogue , 2008, ACL.

[20]  Eduardo Salas,et al.  Developing and enhancing teamwork in organizations : evidence-based best practices and guidelines , 2013 .

[21]  Amanda Stent,et al.  Lexical and Syntactic Adaptation and Their Impact in Deployed Spoken Dialog Systems , 2009, NAACL.

[22]  G. Stasser,et al.  Effects of information load and percentage of shared information on the dissemination of unshared information during group discussion. , 1987 .

[23]  Johanna D. Moore,et al.  Predicting Success in Dialogue , 2007, ACL.

[24]  Stephanie A. Borrie,et al.  Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges , 2015, Front. Psychol..

[25]  Jeffrey T. Hancock,et al.  Language Style Matching as a Predictor of Social Dynamics in Small Groups , 2010, Commun. Res..

[26]  Jon M. Kleinberg,et al.  Echoes of power: language effects and power differences in social interaction , 2011, WWW.

[27]  Julia Hirschberg,et al.  Entrainment, dominance and alliance in supreme court hearings , 2014, Knowl. Based Syst..

[28]  Seungwhan Moon,et al.  Identifying Student Leaders from MOOC Discussion Forums through Language Influence , 2014, EMNLP 2014.

[29]  Jean Carletta,et al.  The AMI Meeting Corpus: A Pre-announcement , 2005, MLMI.

[30]  B. Mullen,et al.  The relation between group cohesiveness and performance: An integration. , 1994 .

[31]  Julia Hirschberg,et al.  Entrainment in Speech Preceding Backchannels , 2011, ACL.

[32]  Jean-Marc Odobez,et al.  Who Will Get the Grant?: A Multimodal Corpus for the Analysis of Conversational Behaviours in Group Interviews , 2014, UM3I '14.

[33]  I. Emmerik,et al.  Leadership and Team Cohesiveness Across Cultures , 2009 .

[34]  Leslie A. DeChurch,et al.  Information sharing and team performance: a meta-analysis. , 2009, The Journal of applied psychology.

[35]  Eduardo Salas,et al.  Does Team Training Improve Team Performance? A Meta-Analysis , 2008, Hum. Factors.

[36]  Nicholas Asher,et al.  Discourse parsing for multi-party chat dialogues , 2015, EMNLP.

[37]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .