Articulatory, acoustic, and prosodic accommodation in a cooperative maze navigation task

This study uses a maze navigation task in conjunction with a quasi-scripted, prosodically controlled speech task to examine acoustic and articulatory accommodation in pairs of interacting speakers. The experiment uses a dual electromagnetic articulography set-up to collect synchronized acoustic and articulatory kinematic data from two facing speakers simultaneously. We measure the members of a dyad individually before they interact, while they are interacting in a cooperative task, and again individually after they interact. The design is ideally suited to measure speech convergence, divergence, and persistence effects during and after speaker interaction. This study specifically examines how convergence and divergence effects during a dyadic interaction may be related to prosodically salient positions, such as preceding a phrase boundary. The findings of accommodation in fine-grained prosodic measures illuminate our understanding of how the realization of linguistic phrasal structure is coordinated across interacting speakers. Our findings on individual speaker variability and the time course of accommodation provide novel evidence for accommodation at the level of cognitively specified motor control of individual articulatory gestures. Taken together, these results have implications for understanding the cognitive control of interactional behavior in spoken language communication.

[1]  Jennifer S. Pardo,et al.  Phonetic convergence in college roommates , 2012, J. Phonetics.

[2]  Eric Vatikiotis-Bateson,et al.  Articulatory coordination of two vocal tracts , 2014, J. Phonetics.

[3]  Julia Hirschberg,et al.  Backward mimicry and forward influence in prosodic contour choice in standard American English , 2015, INTERSPEECH.

[4]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[5]  Uriel Cohen Priva,et al.  Converging to the baseline: Corpus evidence for convergence in speech rate to interlocutor's baseline. , 2017, The Journal of the Acoustical Society of America.

[6]  Jelena M. Krivokapic,et al.  Rhythm and convergence between speakers of American and Indian English , 2013 .

[7]  Guillaume Gibert,et al.  Speech articulator movements recorded from facing talkers using two electromagnetic articulometer systems simultaneously , 2010 .

[8]  M. Castelhano,et al.  Movement Coordination during Conversation , 2014, PloS one.

[9]  Véronique Delvaux,et al.  Role of imitation in the emergence of phonological systems , 2015, J. Phonetics.

[10]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Mariapaola D'Imperio,et al.  At the juncture of prosody, phonology, and phonetics – the interaction of phrasal and syllable structure in shaping the timing of consonant gestures , 2010 .

[12]  D. Choi At the juncture of prosody , phonology , and phonetics — The interaction of phrasal and syllable structure in shaping the timing of consonant gestures , 2007 .

[13]  A. Yu Perceptual Compensation Is Correlated with Individuals' “Autistic” Traits: Implications for Models of Sound Change , 2010, PloS one.

[14]  Robert E Remez,et al.  Analogy and disanalogy in production and perception of speech , 2015, Language, cognition and neuroscience.

[15]  Jennifer S. Pardo Expressing oneself in conversational interaction , 2009 .

[16]  Stefanie Shattuck-Hufnagel,et al.  Multiple targets of phrase-final lengthening in American English words , 2007, J. Phonetics.

[17]  Christopher T. Kello,et al.  Production and Convergence of Multiscale Clustering in Speech , 2015 .

[18]  Jennifer S. Pardo,et al.  Measuring phonetic convergence in speech production , 2013, Front. Psychol..

[19]  C. Rawlings,et al.  Systems Responses to Progressive Water Stress in Durum Wheat , 2014, PloS one.

[20]  Jennifer S. Pardo,et al.  A comparison of phonetic convergence in conversational interaction and speech shadowing , 2018, J. Phonetics.

[21]  Fred Cummins Gaze and blinking in dyadic conversation: A study in coordinated behaviour among individuals , 2012 .

[22]  Christopher T. Kello,et al.  Complexity matching in dyadic conversation. , 2014, Journal of experimental psychology. General.

[23]  Louis Goldstein,et al.  The coordination of boundary tones and its interaction with prominence , 2014, J. Phonetics.

[24]  C. Browman,et al.  Articulatory Phonology: An Overview , 1992, Phonetica.

[25]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[26]  Jennifer S. Pardo,et al.  Phonetic convergence across multiple measures and model talkers , 2016, Attention, Perception, & Psychophysics.

[27]  Shrikanth S. Narayanan,et al.  Phrasal signatures in articulation , 2000 .

[28]  Jennifer S. Pardo,et al.  On phonetic convergence during conversational interaction. , 2006, The Journal of the Acoustical Society of America.

[29]  Phil Hoole,et al.  Recording speech articulation in dialogue: Evaluating a synchronized double electromagnetic articulography setup , 2013, J. Phonetics.

[30]  Armin Fuchs,et al.  How Interpersonal Coordination Affects Individual Behavior (and Vice Versa): Experimental Analysis and Adaptive HKB Model of Social Memory , 2018, Ecological psychology : a publication of the International Society for Ecological Psychology.

[31]  Molly Babel,et al.  Cognitive Load Reduces Perceived Linguistic Convergence Between Dyads , 2017, Language and speech.

[32]  Kerry J. Ressler,et al.  Exploring Epigenetic Regulation of Fear Memory and Biomarkers Associated with Post-Traumatic Stress Disorder , 2013, Front. Psychiatry.

[33]  Andrew Faulkner,et al.  Vividness of Visual Imagery and Incidental Recall of Verbal Cues, When Phenomenological Availability Reflects Long-Term Memory Accessibility , 2013, Front. Psychology.

[34]  Alexandra A. Cleland,et al.  Syntactic co-ordination in dialogue , 2000, Cognition.

[35]  Julia Hirschberg,et al.  Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions , 2011, INTERSPEECH.

[36]  P. Keating,et al.  Articulatory strengthening at edges of prosodic domains. , 1997, The Journal of the Acoustical Society of America.

[37]  Meredith Tamminga,et al.  The dynamics of variation in individuals. , 2016, Linguistic variation.

[38]  Kuniko Y. Nielsen Specificity and abstractness of VOT imitation , 2011, J. Phonetics.

[39]  Dani Byrd,et al.  Intragestural dynamics of multiple prosodic boundaries , 1998 .

[40]  Charles Darwin,et al.  The Perception of Speech , 1961, Nature.

[41]  Rick Dale,et al.  Behavior Matching in Multimodal Communication Is Synchronized , 2012, Cogn. Sci..

[42]  Jennifer S. Pardo,et al.  Influence of Role-Switching on Phonetic Convergence in Conversation , 2013 .

[43]  Christine Mooshammer,et al.  Evidence for an articulatory component of phonetic convergence from dual electromagnetic articulometer observation of interacting talkers , 2013 .

[44]  Dani Byrd,et al.  Prosodic boundary strength: An articulatory and perceptual study , 2012, J. Phonetics.

[45]  Louis Goldstein,et al.  Relating prosody and dynamic events: Comments on the papers by Cho and Smiljanić , 2006 .

[46]  Udo Will,et al.  The concept of entrainment and its significance for ethnomusicology , 2004 .

[47]  Julia Hirschberg,et al.  Acoustic-Prosodic Entrainment and Social Behavior , 2012, NAACL.

[48]  Molly Babel,et al.  Evidence for phonetic and social selectivity in spontaneous phonetic imitation , 2012, J. Phonetics.

[49]  M. Turvey,et al.  Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. , 1990, Journal of experimental psychology. Human perception and performance.