Timing in turn-taking and its implications for processing models of language

The core niche for language use is in verbal interaction, involving the rapid exchange of turns at talking. This paper reviews the extensive literature about this system, adding new statistical analyses of behavioral data where they have been missing, demonstrating that turn-taking has the systematic properties originally noted by Sacks et al. (1974; hereafter SSJ). This system poses some significant puzzles for current theories of language processing: the gaps between turns are short (of the order of 200 ms), but the latencies involved in language production are much longer (over 600 ms). This seems to imply that participants in conversation must predict (or ‘project’ as SSJ have it) the end of the current speaker’s turn in order to prepare their response in advance. This in turn implies some overlap between production and comprehension despite their use of common processing resources. Collecting together what is known behaviorally and experimentally about the system, the space for systematic explanations of language processing for conversation can be significantly narrowed, and we sketch some first model of the mental processes involved for the participant preparing to speak next.

[1]  W. E. Hick.  Quarterly Journal of Experimental Psychology , 1948, Nature.

[2]  Gene H. Lerner.  Turn-sharing : the choral co-production of talk-in-interaction , 2002 .

[3]  Louis ten Bosch,et al.  On temporal aspects of turn taking in conversational dialogues , 2005, Speech Commun..

[4]  T Shipp,et al.  Minimal reaction times for phonatory initiation. , 1978, Journal of speech and hearing research.

[5]  T. Crystal,et al.  Segmental durations in connected‐speech signals: Current results , 1988 .

[6]  Gareth Walker.  Phonetics and Prosody in Conversation , 2012 .

[7]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[8]  Michael C. Frank,et al.  The development of predictive processes in children's discourse understanding , 2013, CogSci.

[9]  K. Izdebski,et al.  Physiologic stages of vocal reaction time. , 1982, Journal of speech and hearing research.

[10]  S. Feldstein,et al.  Adult-like temporal characteristics of mother-infant vocal interactions. , 1986, Child development.

[11]  John J. Godfrey,et al.  SWITCHBOARD: telephone speech corpus for research and development , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Paul T. Brady,et al.  A statistical analysis of on-off patterns in 16 conversations , 1968 .

[13]  Marisa Tice,et al.  Turn-boundary projection: Looking ahead , 2011, CogSci.

[14]  S. Levinson,et al.  Conversation Electrified: ERP Correlates of Speech Act Recognition in Underspecified Utterances , 2015, PloS one.

[15]  W. Levelt,et al.  Word frequency effects in speech production: Retrieval of syntactic information and of phonological form , 1994 .

[16]  Kara D. Federmeier,et al.  Timed picture naming in seven languages , 2003, Psychonomic bulletin & review.

[17]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[18]  Delta Ferrite Measurement.  The Effects of Processing on , 1983 .

[19]  S. Levinson,et al.  Turn-timing in signed conversations: coordinating stroke-to-stroke turn boundaries , 2015, Front. Psychol..

[20]  J. Mehler,et al.  Understanding Compressed Sentences: The Role of Rhythm and Meaning a , 1993, Annals of the New York Academy of Sciences.

[21]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[22]  M. Bateson,et al.  MOTHER‐INFANT EXCHANGES: THE EPIGENESIS OF CONVERSATIONAL INTERACTION * , 1975, Annals of the New York Academy of Sciences.

[23]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[24]  Peter Z. Revesz,et al.  Temporal Constraints , 2009, Encyclopedia of Database Systems.

[25]  Federico Rossano,et al.  Gaze in Conversation , 2012 .

[26]  Matthias J. Sjerps,et al.  Variation in dual-task performance reveals late initiation of speech planning in turn-taking , 2015, Cognition.

[27]  Mark Steedman,et al.  The NXT-format Switchboard Corpus: a rich resource for investigating the syntax, semantics, pragmatics and prosody of dialogue , 2010, Lang. Resour. Evaluation.

[28]  Louis ten Bosch,et al.  Turn-taking in social talk dialogues : temporal, formal and functional aspects , 2004 .

[29]  Makoto Hayashi,et al.  Turn Allocation and Turn Sharing , 2012 .

[30]  Carina Riest,et al.  Anticipation in turn-taking: mechanisms and information sources , 2015, Front. Psychol..

[31]  F. Donders.  On the speed of mental processes. , 1969, Acta psychologica.

[32]  Felicia Roberts,et al.  Judgments Concerning the Valence of Inter-Turn Silence Across Speakers of American English, Italian, and Japanese , 2011 .

[33]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[34]  V. Yngve.  On getting a word in edgewise , 1970 .

[35]  Agnieszka E. Konopka,et al.  Word order affects the time course of sentence formulation in Tzeltal , 2013 .

[36]  Stanley Feldstein,et al.  Adult-like temporal characteristics of mother-infant vocal interactions. , 1986 .

[37]  W. Levelt,et al.  Monitoring the Time Course of Phonological Encoding , 1995 .

[38]  D. Zimmerman,et al.  The structure of silence between turns in two‐party conversation , 1986 .

[39]  Albert Costa,et al.  Planning at the Phonological Level during Sentence Production , 2006, Journal of psycholinguistic research.

[40]  Relatedness and Timing in Talk-in-Interaction , 2009 .

[41]  C. Garvey,et al.  Timing and turn taking in children's conversations 1 , 1981 .

[42]  D. Whitteridge,et al.  Expiratory Pressures and Air Flow During Speech , 1960, British medical journal.

[43]  M. Heldner.  Detection thresholds for gaps, overlaps, and no-gap-no-overlaps. , 2011, The Journal of the Acoustical Society of America.

[44]  D. Fry.  Simple Reaction-Times to Speech and Non-Speech Stimuli , 1975, Cortex.

[45]  Margaret Wilson,et al.  An oscillator model of the timing of turn-taking , 2005, Psychonomic bulletin & review.

[46]  Alene Kiku Terasaki.  Pre-announcement sequences in conversation , 2004 .

[47]  Steven E. Clayman,et al.  Turn‐Constructional Units and the Transition‐Relevance Place , 2012 .

[48]  Anne Fernald,et al.  Looking while listening: Using eye movements to monitor spoken language comprehension by infants and young children. , 2008 .

[49]  T. Stivers,et al.  An overview of the question-response system in American English conversation , 2010 .

[50]  Francisco Torreira,et al.  The effects of processing and sequence organization on the timing of turn taking: a corpus study , 2015, Front. Psychol..

[51]  S. Duncan,et al.  On the structure of speaker–auditor interaction during speaking turns , 1974, Language in Society.

[52]  Lilla Magyari,et al.  Prediction of Turn-Ends Based on Anticipation of Upcoming Words , 2012, Front. Psychology.

[53]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[54]  Stephen C. Levinson,et al.  Early Anticipation Lies behind the Speed of Response in Conversation , 2014, Journal of Cognitive Neuroscience.

[55]  Peter Hagoort,et al.  A Paradox of Syntactic Priming: Why Response Tendencies Show Priming for Passives, and Response Latencies Show Priming for Actives , 2011, PloS one.

[56]  S. Levinson,et al.  Question-response sequences in conversation across ten languages: An introduction , 2010 .

[57]  Noam Chomsky.  Quine’s Empirical Assumptions , 1968 .

[58]  Zenzi M. Griffin,et al.  PSYCHOLOGICAL SCIENCE Research Article WHAT THE EYES SAY ABOUT SPEAKING , 2022 .

[59]  Julia Hirschberg,et al.  Turn-Yielding Cues in Task-Oriented Dialogue , 2009, SIGDIAL Conference.

[60]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[61]  James M Scobbie,et al.  Measuring reaction times: Vocalisation vs. articulation , 2014 .

[62]  Moritz M. Daum,et al.  Perception of conversations: the importance of semantics and intonation in children's development. , 2013, Journal of experimental child psychology.

[63]  L. Gleitman,et al.  On the give and take between event apprehension and utterance formulation. , 2007, Journal of memory and language.

[64]  Kiwako Ito,et al.  Anticipatory effects of intonation: Eye movements during instructed visual search. , 2008, Journal of memory and language.

[65]  Noam Chomsky,et al.  Quine's empirical assumptions , 2004, Synthese.

[66]  Stephen C. Levinson,et al.  Recursion in Pragmatics , 2011 .

[67]  J. Buck,et al.  Synchronous fireflies. , 1976, Scientific American.

[68]  Timothy W. Boiteau,et al.  Interference between conversation and a concurrent visuomotor task. , 2014, Journal of experimental psychology. General.

[69]  D. McFarland.  Respiratory markers of conversational interaction. , 2001, Journal of speech, language, and hearing research : JSLHR.

[70]  C. Goodwin.  Restarts, Pauses, and the Achievement of a State of Mutual Gaze at Turn‐Beginning , 1980 .

[71]  S. Levinson,et al.  Breathing for answering: the time course of response planning in conversation , 2015, Front. Psychol..

[72]  E. Schegloff.  Overlapping talk and the organization of turn-taking for conversation , 2000, Language in Society.

[73]  Julia Hirschberg,et al.  Backchannel-inviting cues in task-oriented dialogue , 2009, INTERSPEECH.

[74]  O. J. Murphy,et al.  Characteristic time intervals in telephonic conversation , 1938 .

[75]  Günther Knoblich,et al.  From mirroring to joint action , 2008 .

[76]  G. Jefferson.  Notes on ‘latency’ in overlap onset , 1986 .

[77]  S. Feldstein,et al.  Vocal congruence in mother-infant play , 1988, Journal of psycholinguistic research.

[78]  Francisco Torreira,et al.  Listeners use intonational phrase boundaries to project turn ends in spoken interaction , 2015, J. Phonetics.

[79]  M. Corley,et al.  Articulatory Effects of Prediction During Comprehension: An Ultrasound Tongue Imaging Approach , 2014 .

[80]  Jan-Peter de Holger N. J. Ruiter,et al.  Projecting the End of a Speaker's Turn: A Cognitive Cornerstone of Conversation , 2006 .

[81]  P. Gribble,et al.  Temporal constraints on the McGurk effect , 1996, Perception & psychophysics.

[82]  Marisa Casillas.  Taking the floor on time: Delay and deferral in children’s turn taking , 2014 .

[83]  S. MacFarlane,et al.  Prosody as an Interactional Resource: Turn-projection and Overlap , 1998, Language and speech.

[84]  Marta Kutas,et al.  CHAPTER 15 A Look around at What Lies Ahead: Prediction and Predictability in Language Processing , 2010 .

[85]  Mattias Heldner,et al.  Pauses, gaps and overlaps in conversations , 2010, J. Phonetics.

[86]  Abigail Sellen,et al.  Remote Conversations: The Effects of Mediating Talk With Technology , 1995, Hum. Comput. Interact..

[87]  A. Lomax.  Cross cultural factors in phonological change , 1973, Language in Society.

[88]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[89]  S. Garrod,et al.  Conversational Interaction in the Scanner: Mentalizing during Language Processing as Revealed by MEG , 2014, Cerebral cortex.

[90]  J. Bavelas,et al.  The Listener as Addressee in Face-to-Face Dialogue , 2011 .

[91]  Kobin H. Kendrick,et al.  The Timing and Construction of Preference: A Quantitative Study , 2015 .

[92]  J. Local,et al.  How phonetic features project more talk , 2012, Journal of the International Phonetic Association.

[93]  Peter Indefrey,et al.  The Spatial and Temporal Signatures of Word Production Components: A Critical Update , 2011, Front. Psychology.

[94]  Gene H. Lerner.  On the syntax of sentences-in-progress , 1991, Language in Society.

[95]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[96]  M. Hayashi.  An overview of the question–response system in Japanese , 2010 .

[97]  Sandra A. Thompson,et al.  The language of turn and sequence , 2002 .

[98]  J. Pennebaker,et al.  Are Women Really More Talkative Than Men? , 2007, Science.