Working Together: Contributions of Corpus Analyses and Experimental Psycholinguistics to Understanding Conversation

As conversation is the most important way of using language, linguists and psychologists should combine forces to investigate how interlocutors deal with the cognitive demands arising during conversation. Linguistic analyses of corpora of conversation are needed to understand the structure of conversations, and experimental work is indispensable for understanding the underlying cognitive processes. We argue that joint consideration of corpus and experimental data is most informative when the utterances elicited in a lab experiment match those extracted from a corpus in relevant ways. This requirement to compare like with like seems obvious but is not trivial to achieve. To illustrate this approach, we report two experiments where responses to polar (yes/no) questions were elicited in the lab and the response latencies were compared to gaps between polar questions and answers in a corpus of conversational speech. We found, as expected, that responses were given faster when they were easy to plan and planning could be initiated earlier than when they were harder to plan and planning was initiated later. Overall, in all but one condition, the latencies were longer than one would expect based on the analyses of corpus data. We discuss the implication of this partial match between the data sets and more generally how corpus and experimental data can best be combined in studies of conversation.

[1]  Stephen C. Levinson,et al.  Planning versus comprehension in turn-taking: Fast responders show reduced anticipatory processing of the question , 2017, Neuropsychologia.

[2]  Rasha Abdel Rahman,et al.  Having a task partner affects lexical retrieval: Spoken word production in shared task settings , 2017, Cognition.

[3]  S. Levinson,et al.  Next Speakers Plan Their Turn Early and Speak after Turn-Final “Go-Signals” , 2017, Front. Psychol..

[4]  Anna K. Kuhlen,et al.  Brains in dialogue: decoding neural preparation of speaking to a conversational partner , 2017, Social cognitive and affective neuroscience.

[5]  S. Levinson,et al.  The Timing of Utterance Planning in Task-Oriented Dialogue: Evidence from a Novel List-Completion Paradigm , 2016, Front. Psychol..

[6]  S. Levinson Turn-taking in Human Communication – Origins and Implications for Language Processing , 2016, Trends in Cognitive Sciences.

[7]  Kobin H. Kendrick,et al.  Never Say No … How the Brain Interprets the Pregnant Pause in Conversation , 2015, PloS one.

[8]  D. Bates,et al.  Balancing Type I Error and Power in Linear Mixed Models , 2015, 1511.01864.

[9]  R. Hari,et al.  Centrality of Social Interaction in Human Brain Function , 2015, Neuron.

[10]  Stephen C. Levinson,et al.  Neural signatures of response planning occur midway through an incoming question in conversation , 2015, Scientific Reports.

[11]  E. Clark,et al.  Turn-taking: a case study of early gesture and word use in answering WHERE and WHICH questions , 2015, Front. Psychol..

[12]  M. Pickering,et al.  How do speakers coordinate? Evidence for prediction in a joint word-replacement task , 2015, Cortex.

[13]  Francisco Torreira,et al.  Timing in turn-taking and its implications for processing models of language , 2015, Front. Psychol..

[14]  Martin J. Pickering,et al.  The use of content and timing to predict turn transitions , 2015, Front. Psychol..

[15]  Francisco Torreira,et al.  The effects of processing and sequence organization on the timing of turn taking: a corpus study , 2015, Front. Psychol..

[16]  Kobin H. Kendrick,et al.  The Timing and Construction of Preference: A Quantitative Study , 2015 .

[17]  Matthias J. Sjerps,et al.  Variation in dual-task performance reveals late initiation of speech planning in turn-taking , 2015, Cognition.

[18]  Carina Riest,et al.  Anticipation in turn-taking: mechanisms and information sources , 2015, Front. Psychol..

[19]  Antje S. Meyer,et al.  Priming sentence planning , 2014, Cognitive Psychology.

[20]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[21]  Timothy W. Boiteau,et al.  Interference between conversation and a concurrent visuomotor task. , 2014, Journal of experimental psychology. General.

[22]  G. Dell Cascading and feedback in interactive models of production: A reflection of forward modeling? , 2013, Behavioral and Brain Sciences.

[23]  Anders Holmberg,et al.  The syntax of answers to polar questions in English and Swedish , 2013 .

[24]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[25]  Lilla Magyari,et al.  Prediction of Turn-Ends Based on Anticipation of Upcoming Words , 2012, Front. Psychology.

[26]  Philip T. Quinlan,et al.  Spoken word processing creates a lexical bottleneck , 2012 .

[27]  Martin J. Pickering,et al.  Edinburgh Research Explorer A cognitive architecture for the coordination of utterances , 2022 .

[28]  A. Roelofs,et al.  Attention Demands of Spoken Word Planning: A Review , 2011, Front. Psychology.

[29]  Herbert Schriefers,et al.  Semantic interference in immediate and delayed naming and reading: Attention and task decisions , 2011 .

[30]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[31]  Mattias Heldner,et al.  Pauses, gaps and overlaps in conversations , 2010, J. Phonetics.

[32]  Kathryn Bock,et al.  Driving impairs talking , 2010, Psychonomic bulletin & review.

[33]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[34]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[35]  Simon Garrod,et al.  Joint Action, Interactive Alignment, and Dialog , 2009, Top. Cogn. Sci..

[36]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[37]  Antje S Meyer,et al.  Capacity demands of phoneme selection in word production: new evidence from dual-task experiments. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[38]  Eva Belke Effects of working memory load on lexical-semantic encoding in language production , 2008, Psychonomic bulletin & review.

[39]  Jan-Peter de Holger N. J. Ruiter,et al.  Projecting the End of a Speaker's Turn: A Cognitive Cornerstone of Conversation , 2006 .

[40]  S. Kemper,et al.  Different Effects of Dual Task Demands on the Speech of Young and Older Adults , 2005, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[41]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[42]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[43]  J. Fox Effect Displays in R for Generalised Linear Models , 2003 .

[44]  Jason Wittenberg,et al.  Clarify: Software for Interpreting and Presenting Statistical Results , 2003 .

[45]  H. Pashler,et al.  Central bottleneck influences on the processing stages of word production. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[46]  David L. Strayer,et al.  Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone , 2001, Psychological science.

[47]  Zenzi M. Griffin,et al.  Constraint, Word Frequency, and the Relationship between Lexical Processing Levels in Spoken Word Production , 1998 .

[48]  John J. Godfrey,et al.  SWITCHBOARD: telephone speech corpus for research and development , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[49]  F. Ferreira Effects of length and syntactic complexity on initiation times for prepared utterances , 1991 .

[50]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[51]  C. K. Grant,et al.  On Using Language , 1956 .

[52]  Joris Van de Cavey,et al.  Interference in joint picture naming. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[53]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[54]  L. Dybkjær,et al.  UvA-DARE ( Digital Academic Repository ) Early preparation of experimentally elicited minimal responses , 2005 .

[55]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[56]  R. Gagne,et al.  The effects of an interfering task on the learning of a complex motor skill. , 1951, Journal of experimental psychology.