Investigating fine temporal dynamics of prosodic and lexical accommodation

Conversational interaction is a dynamic activity in which participants engage in the construction of meaning and in establishing and maintaining social relationships. Lexical and prosodic accommodation have been observed in many studies as contributing importantly to these dimensions of social interaction. However, while previous works have considered accommodation mechanisms at global levels (for whole conversations, halves and thirds of conversations), this work investigates their evolution through repeated analysis at time intervals of increasing granularity to analyze the dynamics of alignment in a spoken language corpus. Results show that the levels of both prosodic and lexical accommodation fluctuate several times over the course of a conversation. Index Terms: prosodic accommodation, lexical alignment, dynamics, task-based interactions

[1]  Sergios Theodoridis,et al.  A novel efficient approach for audio segmentation , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  Nivja H. Jong,et al.  Praat script to detect syllable nuclei and measure speech rate automatically , 2009, Behavior research methods.

[3]  Susan E. Brennan,et al.  LEXICAL ENTRAINMENT IN SPONTANEOUS DIALOG , 1996 .

[4]  Carl Vogel,et al.  Attribution of Mutual Understanding , 2013 .

[5]  Jennifer S. Pardo,et al.  On phonetic convergence during conversational interaction. , 2006, The Journal of the Acoustical Society of America.

[6]  Diane J. Litman,et al.  Automatically measuring lexical and acoustic/prosodic convergence in tutorial dialog corpora , 2007, SLaTE.

[7]  Johanna D. Moore,et al.  Predicting Success in Dialogue , 2007, ACL.

[8]  Julia Hirschberg,et al.  Entrainment in Speech Preceding Backchannels. , 2011, ACL.

[9]  Stéphane Rauzy,et al.  Measuring Speakers' Similarity in Speech by Means of Prosodic Cues: Methods and Potential , 2011, INTERSPEECH.

[10]  C. Macrae,et al.  The rhythm of rapport: Interpersonal synchrony and social perception , 2009 .

[11]  L. Tickle-Degnen,et al.  The Nature of Rapport and Its Nonverbal Correlates , 1990 .

[12]  Fabian Ramseyer,et al.  Nonverbal Synchrony or Random Coincidence? How to Tell the Difference , 2009, COST 2102 Training School.

[13]  Mattias Heldner,et al.  Pause and gap length in face-to-face interaction , 2009, INTERSPEECH.

[14]  Kenneth Ward Church.  Empirical Estimates of Adaptation: The chance of Two Noriegas is closer to p/2 than p2 , 2000, COLING.

[15]  T. Chartrand,et al.  Using Nonconscious Behavioral Mimicry to Create Affiliation and Rapport , 2003, Psychological science.

[16]  M. Pickering,et al.  Structural priming: a critical review. , 2008, Psychological bulletin.

[17]  J. Russell,et al.  The psychology of facial expression: Studies in Emotion and Social Interaction , 1997 .

[18]  Julia Hirschberg,et al.  Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions , 2011, INTERSPEECH.

[19]  F. Grosjean,et al.  Analyse contrastive des variables temporelles de l’anglais et du français: vitesse de parole et variables composantes, phénomènes d’hésitation , 1975 .

[20]  Petr Motlícek,et al.  Unsupervised Speech/Non-Speech Detection for Automatic Speech Recognition in Meeting Rooms , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[21]  Brian Vaughan,et al.  Prosodic Synchrony in Co-Operative Task-Based Dialogues: A Measure of Agreement and Disagreement , 2011, INTERSPEECH.

[22]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[23]  S. W. Gregory,et al.  A nonverbal signal in voices of interview partners effectively predicts communication accommodation and social status perceptions. , 1996, Journal of personality and social psychology.

[24]  Fey Parrill,et al.  Seeing and Hearing Double: The Influence of Mimicry in Speech and Gesture on Observers , 2006 .

[25]  Nick Campbell,et al.  Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction , 2014, Speech Commun..

[26]  H. Giles,et al.  Accommodation theory: Communication, context, and consequence. , 1991 .

[27]  Spyros Kousidis,et al.  Convergence in Human Dialogues Time Series Analysis of Acoustic Feature , 2009 .

[28]  Julia Hirschberg,et al.  High Frequency Word Entrainment in Spoken Dialogue , 2008, ACL.

[29]  Marko Dragojevic,et al.  Communication Accommodation Theory , 2015 .

[30]  Carl Vogel,et al.  Measuring Synchrony in Dialog Transcripts , 2011, COST 2102 Training School.

[31]  H. Giles,et al.  Contexts of Accommodation: Developments in Applied Sociolinguistics , 2010 .

[32]  Frieda Goldman Eisler.  Psycholinguistics : experiments in spontaneous speech , 1968 .

[33]  Maria Wolters,et al.  Prosody and the Resolution of Pronominal Anaphora , 2000, International Conference on Computational Linguistics.

[34]  Carl Vogel,et al.  Laughter and topic changes: Temporal distribution and information flow , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[35]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[36]  M. Pickering,et al.  Linguistic alignment between people and computers , 2010 .

[37]  K. Scherer,et al.  Vocal expression of affect , 2005 .

[38]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[39]  Nick Campbell,et al.  Measuring Dynamics of Mimicry by Means of Prosodic Cues in Conversational Speech , 2011, ICPhS.

[40]  Céline de Looze.  Analyse et Interprétation de l'Empan Temporel des Variations Prosodiques en Français et en Anglais , 2010 .