Prosodic entrainment in dialog acts

We examined prosodic entrainment in spoken dialogs separately for several dialog acts in cooperative and competitive games. Entrainment was measured for intonation features derived from a superpositional intonation stylization as well as for rhythm features. The found differences can be related to the cooperative or competitive nature of the game, as well as to dialog act properties as its intrinsic authority, supportiveness and distributional characteristics. In cooperative games dialog acts with a high authority given by knowledge and with a high frequency showed the most entrainment. The results are discussed amongst others with respect to the degree of active entrainment control in cooperative behavior.

[1]  Andreas Stolcke,et al.  Can Prosody Aid the Automatic Classification of Dialog Acts in Conversational Speech? , 1998, Language and speech.

[2]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[3]  Uwe D. Reichel,et al.  Linking bottom-up intonation stylization to discourse structure , 2014, Comput. Speech Lang..

[4]  Uwe D. Reichel,et al.  CoPaSul Manual - Contour-based parametric and superpositional intonation stylization , 2016, ArXiv.

[5]  H. Giles,et al.  Speech Accommodation Theory: The First Decade and Beyond , 1987 .

[6]  Gwyneth Doherty-Sneddon,et al.  The Reliability of a Dialogue Structure Coding Scheme , 1997, CL.

[7]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[8]  Julia Hirschberg,et al.  High Frequency Word Entrainment in Spoken Dialogue , 2008, ACL.

[9]  Marko Dragojevic,et al.  Communication Accommodation Theory , 2015 .

[10]  Julia Hirschberg,et al.  Acoustic-Prosodic Entrainment and Social Behavior , 2012, NAACL.

[11]  Stephen Webster,et al.  Evaluating the Relation of Vocal Accommodation in Conversation Partners' Fundamental Frequencies to Perceptions of Communication Quality , 1997 .

[12]  Peter F. Dominey.  Pickering and Garrod : Toward a mechanistic psychology of dialogue , 2009 .

[13]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[14]  E. M. Adams,et al.  The Nature and Limits of Authority , 1989 .

[15]  Nick Campbell,et al.  Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction , 2014, Speech Commun..

[16]  Susanne Burger,et al.  Syllable detection in read and spontaneous speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[17]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[18]  Uwe D. Reichel,et al.  U NSUPERVISED EXTRACTION OF PROSODIC STRUCTURE , 2017 .

[19]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[20]  Florian Schiel,et al.  The influence of alcoholic intoxication on the short-time energy function of speech. , 2014, The Journal of the Acoustical Society of America.

[21]  Jennifer S. Pardo,et al.  Measuring phonetic convergence in speech production , 2013, Front. Psychol..

[22]  Susanne Fuchs,et al.  On the relation between pointing gestures and speech production in German counting out rhymes , 2016 .

[23]  Joseph M. Bochenski.  Was ist Autorität? : Einführung in die Logik der Autorität , 1974 .

[24]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[25]  S. W. Gregory,et al.  A nonverbal signal in voices of interview partners effectively predicts communication accommodation and social status perceptions. , 1996, Journal of personality and social psychology.

[26]  E. Schegloff.  Sequence Organization In Interaction , 2007 .

[27]  Molly Babel,et al.  The Role of Fundamental Frequency in Phonetic Accommodation , 2012, Language and speech.

[28]  Deirdre Wilson,et al.  Relevance theory: A tutorial , 2002 .

[29]  Jon M. Kleinberg,et al.  Echoes of power: language effects and power differences in social interaction , 2011, WWW.

[30]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[31]  Julia Hirschberg,et al.  Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[32]  Julia Hirschberg,et al.  Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions , 2011, INTERSPEECH.

[33]  Johanna D. Moore,et al.  Alignment and task success in spoken dialogue , 2014, Journal of Memory and Language.

[34]  Uwe D. Reichel,et al.  PermA and Balloon: Tools for string alignment and text processing , 2012, INTERSPEECH.

[35]  Toni C. M. Rietveld,et al.  Cues for Perceived Pitch Register , 2001, Phonetica.

[36]  Uwe D. Reichel,et al.  Characterization and prediction of dialogue acts using prosodic features , 2016 .

[37]  Julia Hirschberg,et al.  Entrainment in spontaneous speech: The case of filled pauses in Supreme Court hearings , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[38]  Jean Carletta,et al.  HCRC dialogue structure coding manual , 1995 .

[39]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Julia Hirschberg,et al.  Speaking More Like You: Entrainment in Conversational Speech , 2011, INTERSPEECH.

[41]  Natalie Lewandowski,et al.  Talent in nonnative phonetic convergence , 2012 .

[42]  Stefan Benus,et al.  Social Aspects of Entrainment in Spoken Interaction , 2014, Cognitive Computation.

[43]  Jennifer S. Pardo,et al.  On phonetic convergence during conversational interaction. , 2006, The Journal of the Acoustical Society of America.

[44]  Alexandra A. Cleland,et al.  The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structure , 2003 .

[45]  Florian Schiel,et al.  Multilingual processing of speech via web services , 2017, Comput. Speech Lang..

[46]  Siobhan Chapman.  Logic and Conversation , 2005 .

[47]  A. Samuel,et al.  Accommodating variation: Dialects, idiolects, and speech processing , 2008, Cognition.

[48]  R. Street,et al.  The conception and perception of noncontent speech performance: implications for speech-accommodation theory , 1984 .

[49]  Juan Manuel Pérez,et al.  Disentrainment may be a Positive Thing: A Novel Measure of Unsigned Acoustic-Prosodic Synchrony, and its Relation to Speaker Engagement , 2016, INTERSPEECH.

[50]  Satoshi Nakamura,et al.  Analyzing the Effect of Entrainment on Dialogue Acts , 2016, SIGDIAL Conference.

[51]  Uwe D. Reichel,et al.  Entrainment analysis of categorical intonation representations , 2016 .

[52]  R. Street.  Speech Convergence and Speech Evaluation in Fact-Finding Interviews , 1984 .

[53]  Uwe D. Reichel,et al.  Comparing parameterizations of pitch register and its discontinuities at prosodic boundaries for Hungarian , 2014, INTERSPEECH.

[54]  S. Gries.  Syntactic Priming: A Corpus-based Approach , 2005, Journal of psycholinguistic research.

[55]  Stefan Benus,et al.  Conversational Entrainment in the Use of Discourse Markers , 2013, WIRN.

[56]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[57]  Uwe D. Reichel,et al.  Analysis and classification of cooperative and competitive dialogs , 2015, INTERSPEECH.

[58]  Natalie Lewandowski,et al.  Social Factors in Convergence of F 1 and F 2 in Spontaneous Speech , 2013 .

[59]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[60]  H. Giles,et al.  Language: Contexts and Consequences , 1991 .

[61]  Spyros Kousidis,et al.  Convergence in Human Dialogues Time Series Analysis of Acoustic Feature , 2009 .

[62]  Athanasios Katsamanis,et al.  Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples , 2010, INTERSPEECH.

[63]  Martin J. Pickering,et al.  Participant role and syntactic alignment in dialogue , 2007 .

[64]  J. Ohala.  Sound symbolism: The frequency code underlies the sound-symbolic use of voice pitch , 1995 .

[65]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .