Entrainment profiles: Comparison by gender, role, and feature set

Abstract We examine prosodic entrainment in cooperative game dialogs for new feature sets describing register, pitch accent shape, and rhythmic aspects of utterances. For these as well as for established features we present entrainment profiles to detect within- and across-dialog entrainment by the speakers’ gender and role in the game. It turned out, that feature sets undergo entrainment in different quantitative and qualitative ways, which can partly be attributed to their different functions. Furthermore, interactions between speaker gender and role (describer vs. follower) suggest gender-dependent strategies in cooperative solution-oriented interactions: female describers entrain most, male describers least. Our data suggests a slight advantage of the latter strategy on task success.

[1]  Štefan Beňuš,et al.  The prosody of backchannels in Slovak , 2016 .

[2]  Julia Hirschberg,et al.  Implementing Acoustic-Prosodic Entrainment in a Conversational Avatar , 2016, INTERSPEECH.

[3]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[4]  P. Healey,et al.  Divergence in Dialogue , 2014, PloS one.

[5]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[6]  Johanna D. Moore,et al.  Alignment and task success in spoken dialogue , 2014, Journal of Memory and Language.

[7]  Jan Michalsky,et al.  Pitch Convergence as an Effect of Perceived Attractiveness and Likability , 2017, INTERSPEECH.

[8]  Yang Xu,et al.  An Evaluation and Comparison of Linguistic Alignment Measures , 2015, CMCL@NAACL-HLT.

[9]  C. Frith,et al.  Coming to Terms , 2012, Psychological science.

[10]  Stefan Benus,et al.  Social Aspects of Entrainment in Spoken Interaction , 2014, Cognitive Computation.

[11]  Susanne Burger,et al.  Syllable detection in read and spontaneous speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[12]  Uwe D. Reichel,et al.  U NSUPERVISED EXTRACTION OF PROSODIC STRUCTURE , 2017 .

[13]  Oliver Niebuhr,et al.  What makes a charismatic speaker? A computer-based acoustic-prosodic analysis of Steve Jobs tone of voice , 2016, Comput. Hum. Behav..

[14]  Julia Hirschberg,et al.  Entrainment in Slovak collaborative dialogues , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[15]  Alexandra A. Cleland,et al.  The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structure , 2003 .

[16]  Peter French,et al.  Turn-competitive incomings , 1983 .

[17]  Uwe D. Reichel,et al.  CoPaSul Manual - Contour-based parametric and superpositional intonation stylization , 2016, ArXiv.

[18]  Martin J. Pickering,et al.  Participant role and syntactic alignment in dialogue , 2007 .

[19]  Julia Hirschberg,et al.  Acoustic-prosodic entrainment in Slovak, Spanish, English and Chinese: A cross-linguistic comparison , 2015, SIGDIAL Conference.

[20]  Nick Campbell,et al.  Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction , 2014, Speech Commun..

[21]  Julia Hirschberg,et al.  Pragmatic aspects of temporal accommodation in turn-taking , 2011, Journal of Pragmatics.

[22]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[23]  Uwe D. Reichel,et al.  Linking bottom-up intonation stylization to discourse structure , 2014, Comput. Speech Lang..

[24]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[25]  Florian Schiel,et al.  The influence of alcoholic intoxication on the short-time energy function of speech. , 2014, The Journal of the Acoustical Society of America.

[26]  H. Giles,et al.  Relational and Identity Processes in Communication: A Contextual and Meta-Analytical Review of Communication Accommodation Theory , 2014 .

[27]  Juan Manuel Pérez,et al.  Disentrainment may be a Positive Thing: A Novel Measure of Unsigned Acoustic-Prosodic Synchrony, and its Relation to Speaker Engagement , 2016, INTERSPEECH.

[28]  Alexandra A. Cleland,et al.  Syntactic alignment and participant role in dialogue , 2007, Cognition.

[29]  Molly Babel,et al.  The Role of Fundamental Frequency in Phonetic Accommodation , 2012, Language and speech.

[30]  Athanasios Katsamanis,et al.  Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples , 2010, INTERSPEECH.

[31]  M. Wood.  Language: Contexts and Consequences. , 1993 .

[32]  Mattias Heldner,et al.  Pause and gap length in face-to-face interaction , 2009, INTERSPEECH.

[33]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[34]  Julia Hirschberg,et al.  Pause and gap length in face , 2009 .

[35]  Julia Hirschberg,et al.  Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions , 2011, INTERSPEECH.

[36]  Julia Hirschberg,et al.  High Frequency Word Entrainment in Spoken Dialogue , 2008, ACL.

[37]  Adam N. Joinson,et al.  Finding Zelig in Text: A Measure for Normalising Linguistic Accommodation , 2014, COLING.

[38]  D. H. Zimmerman,et al.  9. Sex roles, interruptions and silences in conversation , 1996 .

[39]  Julia Hirschberg,et al.  Entrainment in Speech Preceding Backchannels. , 2011, ACL.

[40]  Susanne Fuchs,et al.  On the relation between pointing gestures and speech production in German counting out rhymes , 2016 .

[41]  Sébastien Le Maguer,et al.  Investigating Phonetic Convergence in a Shadowing Experiment with Synthetic Stimuli , 2017 .

[42]  Milos Cernak,et al.  Effective Triphone Mapping for Acoustic Modeling in Speech Recognition , 2011, INTERSPEECH.

[43]  Jon M. Kleinberg,et al.  Echoes of power: language effects and power differences in social interaction , 2011, WWW.

[44]  L. Nygaard,et al.  Gender Differences in Vocal Accommodation: , 2002 .

[45]  Julia Hirschberg,et al.  Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[46]  Toni C. M. Rietveld,et al.  Cues for Perceived Pitch Register , 2001, Phonetica.

[47]  M. Swerts,et al.  Prosody as a Marker of Information Flow in Spoken Discourse , 1994 .

[48]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[49]  Julia Hirschberg,et al.  Turn-taking and affirmative cue words in task-oriented dialogue , 2009 .

[50]  Julia Hirschberg,et al.  Speaking More Like You: Entrainment in Conversational Speech , 2011, INTERSPEECH.

[51]  Erin Walker,et al.  Naturalness and rapport in a pitch adaptive learning companion , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[52]  A. Samuel,et al.  Accommodating variation: Dialects, idiolects, and speech processing , 2008, Cognition.

[53]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[54]  Natalie Lewandowski,et al.  Social Factors in Convergence of F 1 and F 2 in Spontaneous Speech , 2013 .

[55]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[56]  Uwe D. Reichel,et al.  Comparing parameterizations of pitch register and its discontinuities at prosodic boundaries for Hungarian , 2014, INTERSPEECH.

[57]  Antje Schweitzer,et al.  To See or not to See: Interlocutor Visibility and Likeability Influence Convergence in Intonation , 2017, INTERSPEECH.

[58]  S. Gries.  Syntactic Priming: A Corpus-based Approach , 2005, Journal of psycholinguistic research.

[59]  Julia Hirschberg,et al.  Prosodic Entrainment in Mandarin Chinese and English: A Cross-Linguistic Comparison , 2014 .

[60]  Stefan Benus,et al.  Conversational Entrainment in the Use of Discourse Markers , 2013, WIRN.

[61]  R. Krauss,et al.  Dominance and accommodation in the conversational behaviours of same- and mixed-gender dyads. , 1988 .

[62]  Julia Hirschberg,et al.  Acoustic-Prosodic Entrainment and Social Behavior , 2012, NAACL.

[63]  Stephen Webster,et al.  Evaluating the Relation of Vocal Accommodation in Conversation Partners' Fundamental Frequencies to Perceptions of Communication Quality , 1997 .

[64]  Peter F. Dominey.  Pickering and Garrod : Toward a mechanistic psychology of dialogue , 2009 .

[65]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[66]  Marko Dragojevic,et al.  Communication Accommodation Theory , 2015 .

[67]  F. Heider.  The psychology of interpersonal relations , 1958 .

[68]  P. Trudgill,et al.  Gender and discourse , 1998 .

[69]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[70]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[71]  S. W. Gregory,et al.  A nonverbal signal in voices of interview partners effectively predicts communication accommodation and social status perceptions. , 1996, Journal of personality and social psychology.