Context effects in language production : models of syntactic priming in dialogue corpora

This thesis addresses the cognitive basis of syntactic adaptation, which biases speakers to repeat their own syntactic constructions and those of their conversational partners. I address two types of syntactic adaptation: short-term priming and longterm adaptation. I develop two metrics for syntactic adaptation within a speaker and between speakers in dialogue: one for short-term priming effects that decay quickly, and one for long-term adaptation over the course of a dialogue. Both methods estimate adaptation in large datasets consisting of transcribed human-human dialogue annotated with syntactic information. Two such corpora in English are used: Switchboard, a collection of spontaneous phone conversation, and HCRC Map Task, a set of task-oriented dialogues in which participants describe routes on a map to one another. I find both priming and long-term adaptation in both corpora, confirming well-known experimental results (e.g., Bock, 1986b). I extend prior work by showing that syntactic priming effects not only apply to selected syntactic constructions that are alternative realizations of the same semantics, but still hold when a broad variety of syntactic phrase structure rules are considered. Each rule represents a cognitive decision during syntactic processing. I show that the priming effect for a rule is inversely proportional to its frequency. With this methodology, I test predictions of the Interactive Alignment Model (IAM, Pickering and Garrod, 2004). The IAM claims that linguistic and situationmodel agreement between interlocutors in dialogue is the result of a cascade of resource-free, mechanistic priming effects on various linguistic levels. I examine task-oriented dialogue in Map Task, which provides a measure of task success through the deviance of the communicated routes on the maps. I find that longterm syntactic adaptation predicts communicative success, and it does so earlier than lexical adaptation. The result is applied in a machine-learning based model that estimates task success based on the dialogue, capturing 14 percent of the variance in Map Task. Short-term syntactic priming differs qualitatively from longterm adaptation, as it does not predict task success, providing evidence against learning as a single cognitive basis of adaptation effects. I obtain further evidence for the correlation between semantic activity and syntactic priming through a comparison of the Map Task and Switchboard corpora, showing that short-term priming is stronger in task-oriented dialogue than in spon-

[1]  John R. Anderson Retrieval of propositional information from long-term memory , 1974 .

[2]  D. Tannen Talking Voices: Repetition, Dialogue, and Imagery in Conversational Discourse , 1989 .

[3]  Benedikt Szmrecsanyi Morphosyntactic persistence in spoken English: a corpus study at the intersection of variationist sociolinguistics, psycholinguistics, and discourse analysis , 2006 .

[4]  Mitchell P. Marcus,et al.  Parsing a Natural Language Using Mutual Information Statistics , 1990, AAAI.

[5]  Mark Steedman,et al.  Generative Models for Statistical Parsing with Combinatory Categorial Grammar , 2002, ACL.

[6]  Randi C. Martin,et al.  Semantic and phonological codes interact in single word production. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Renato De Mori,et al.  A Cache-Based Natural Language Model for Speech Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  H. H. Clark,et al.  Repeating Words in Spontaneous Speech , 1998, Cognitive Psychology.

[9]  Frank Keller,et al.  Priming Effects in Combinatory Categorial Grammar , 2006, EMNLP.

[10]  R. Hartsuiker,et al.  Word order priming in written and spoken sentence production , 2000, Cognition.

[11]  J. Meaning , Sound , and Syntax : Lexical Priming in Sentence Production , 2001 .

[12]  G. Bower,et al.  Human Associative Memory , 1973 .

[13]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[14]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[15]  P. O'Seaghdha,et al.  Phrasal Ordering Constraints in Sentence Production: Phrase Length and Verb Disposition in Heavy-NP Shift , 1998 .

[16]  Frank Keller,et al.  Against Sequence Priming: Evidence from Constituents and Distituents in Corpus Data , 2007 .

[17]  Mark Steedman Connectionist Sentence Processing in Perspective , 1999 .

[18]  Kenneth Ward Church Empirical Estimates of Adaptation: The chance of Two Noriegas is closer to p/2 than p2 , 2000, COLING.

[19]  Robert J. Hartsuiker,et al.  Priming Word Order in Sentence Production , 1999 .

[20]  Clifford Nass,et al.  Syntactic alignment between computers and people: The role of belief about mental states , 2003 .

[21]  F. Ferreira,et al.  How incremental is language production? Evidence from the production of utterances requiring the computation of arithmetic sums , 2002 .

[22]  M. Pickering,et al.  Constituent structure is formulated in one stage. , 2002 .

[23]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[24]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[25]  T. Jaeger,et al.  Implicit Learning and Syntactic Persistence: Surprisal and Cumulativity , 2007 .

[26]  Eugene Charniak,et al.  A TAG-based noisy-channel model of speech repairs , 2004, ACL.

[27]  Beryl Hoffman,et al.  Integrating “Free” Word Order Syntax and Information Structure , 1995, EACL.

[28]  W. Labov,et al.  Constraints on the agentless passive , 1983, Journal of Linguistics.

[29]  Michael Collins,et al.  Head-Driven Statistical Models for Natural Language Parsing , 2003, CL.

[30]  Douglas Roland,et al.  Verb Sense and Verb Subcategorization Probabilities , 2001 .

[31]  S. Suter Meaningful differences in the everyday experience of young American children , 2005, European Journal of Pediatrics.

[32]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[33]  John R. Anderson Language, Memory, and Thought , 1976 .

[34]  D. Estival,et al.  Syntactic priming of the passive in English , 1985 .

[35]  Alexandra A. Cleland,et al.  The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structure , 2003 .

[36]  Dov M. Gabbay,et al.  Dynamic syntax - the flow of language understanding , 2000 .

[37]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[38]  Alexandra A. Cleland,et al.  Syntactic priming in written production: Evidence for rapid decay , 1999, Psychonomic bulletin & review.

[39]  Christoph Scheepers,et al.  Syntactic priming of relative clause attachments: persistence of structural configuration in sentence production , 2003, Cognition.

[40]  Ann Bies,et al.  The Penn Treebank: Annotating Predicate Argument Structure , 1994, HLT.

[41]  Marilyn A. Walker,et al.  Learning to Predict Problematic Situations in a Spoken Dialogue System: Experiments with How May I Help You? , 2000, ANLP.

[42]  D. Crystal,et al.  Intonation and Grammar in British English , 1967 .

[43]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[44]  李幼升,et al.  Ph , 1989 .

[45]  M. Pickering,et al.  The representation of lexical and syntactic information in bilinguals: Evidence from syntactic priming , 2007 .

[46]  G. Dell,et al.  Persistent structural priming from language comprehension to language production , 2007, Cognition.

[47]  Andrew J. Stewart,et al.  Syntactic priming in spoken production: Linguistic and temporal interference , 2000, Memory & cognition.

[48]  Mark Steedman,et al.  Generating Context-appropriate Word Orders in Turkish , 1994 .

[49]  Adam Kilgarriff,et al.  Language is never, ever, ever, random , 2005 .

[50]  Koenraad De Smedt,et al.  Segment Grammar: a Formalism for Incremental Sentence Generation , 1991 .

[51]  S. Gries Syntactic Priming: A Corpus-based Approach , 2005, Journal of psycholinguistic research.

[52]  Michael P. Kaschak,et al.  Long-term structural priming affects subsequent patterns of language production , 2007, Memory & cognition.

[53]  Zenzi M. Griffin,et al.  The persistence of structural priming: transient activation or implicit learning? , 2000, Journal of experimental psychology. General.

[54]  Johanna D. Moore,et al.  Predicting Success in Dialogue , 2007, ACL.

[55]  Linda Wheeldon,et al.  Syntactic priming in spoken sentence production – an online study , 2001, Cognition.

[56]  Johanna D. Moore,et al.  Computational Modelling of Structural Priming in Dialogue , 2006, NAACL.

[57]  M. Potter,et al.  Syntactic Priming in Immediate Recall of Sentences , 1998 .

[58]  Michael P. Kaschak,et al.  Recent experience affects the strength of structural priming , 2006, Cognition.

[59]  Michael Niv A Psycholinguistically Motivated Parser for CCG , 1994, ACL.

[60]  James R. Curran,et al.  Parsing the WSJ Using CCG and Log-Linear Models , 2004, ACL.

[61]  Mark Steedman,et al.  CCGbank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank , 2007, CL.

[62]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[63]  Jason Eisner Efficient Normal-Form Parsing for Combinatory Categorial Grammar , 1996, ACL.

[64]  J. K. Bock Syntactic persistence in language production , 1986, Cognitive Psychology.

[65]  Malvina Nissim,et al.  Using the NITE XML Toolkit on the Switchboard Corpus to Study Syntactic Choice: a Case Study , 2004, LREC.

[66]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[67]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[68]  Ardi Roelofs,et al.  Testing a non-decompositional theory of lemma retrieval in speaking: Retrieval of verbs , 1993, Cognition.

[69]  D. Swinney Lexical access during sentence comprehension: (Re)consideration of context effects , 1979 .

[70]  Kim K. Baldridge,et al.  Adapting Chart Realization to CCG , 2003, ENLG@EACL.

[71]  Angeliki Salamoura,et al.  Processing verb argument structure across languages: Evidence for shared representations in the bilingual lexicon , 2007, Applied Psycholinguistics.

[72]  Christoph Scheepers,et al.  Syntactic Priming in German Sentence Production , 2000 .

[73]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[74]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[75]  Alan H. Bond A psycholinguistically and neurolinguistically plausible system-level model of natural-language syntax processing , 2005, Neurocomputing.

[76]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[77]  Brian D. Ripley,et al.  Modern Applied Statistics with S Fourth edition , 2002 .

[78]  Benedikt Szmrecsanyi Language users as creatures of habit: A corpus-based analysis of persistence in spoken English , 2005 .

[79]  M. Pickering,et al.  Syntactic priming in language production , 1999, Trends in Cognitive Sciences.

[80]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[81]  Marc Brysbaert,et al.  The Whorfian hypothesis and numerical cognition: is `twenty-four' processed in the same way as `four-and-twenty'? , 1998, Cognition.

[82]  Stephanie Kelter,et al.  Surface form and memory in question answering , 1982, Cognitive Psychology.

[83]  R. Hartsuiker,et al.  Syntactic priming persists while the lexical boost decays : Evidence from written and spoken dialogue , 2008 .

[84]  Amy Isard,et al.  Modelling alignment for affective dialogue , 2005 .

[85]  Vincenzo Lombardo,et al.  Incrementality and Lexicalism: A Treebank Study , 2002 .

[86]  R. Hartsuiker,et al.  Syntactic Persistence in Dutch , 1998, Language and speech.

[87]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[88]  V. Ferreira Is It Better to Give Than to Donate? Syntactic Flexibility in Language Production , 1996 .

[89]  V. M. Holmes Hesitations and sentence planning , 1988 .

[90]  A. Roelofs,et al.  A spreading-activation theory of lemma retrieval in speaking , 1992, Cognition.

[91]  Johanna D. Moore,et al.  Priming of Syntactic Rules in Task-Oriented Dialogue and Spontaneous Conversation , 2006 .

[92]  G. Dell,et al.  Becoming syntactic. , 2006, Psychological review.

[93]  A. Meyer Lexical Access in Phrase and Sentence Production: Results from Picture–Word Interference Experiments , 1996 .

[94]  Michael P. Kaschak,et al.  Is long-term structural priming affected by patterns of experience with individual verbs? , 2008, Journal of memory and language.

[95]  David Reitter Corpus-based evidence against sequence priming , 2007 .

[96]  A. Lahiri,et al.  Prosodic Units in Speech Production , 1997 .

[97]  M. Pickering,et al.  The Representation of Verbs: Evidence from Syntactic Priming in Language Production , 1998 .

[98]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[99]  Matthew Purver,et al.  Incremental Generation by Incremental Parsing: Tactical Generation in Dynamic Syntax , 2003, ENLG@EACL.

[100]  Jonas Kuhn Experiments in parallel-text based grammar induction , 2004, ACL.

[101]  Anne H. Anderson,et al.  The Hcrc Map Task Corpus , 1991 .

[102]  C. Phillips Linear Order and Constituency , 2003, Linguistic Inquiry.

[103]  Alissa Melinger,et al.  Lexically-driven syntactic priming , 2005, Cognition.

[104]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[105]  Alexandra A. Cleland,et al.  Syntactic co-ordination in dialogue , 2000, Cognition.

[106]  Victor S. Ferreira,et al.  The persistence of optional complementizer production: Why saying “that” is not saying “that” at all , 2003 .

[107]  V. Ferreira,et al.  The functions of structural priming , 2006, Language and cognitive processes.

[108]  Frank Keller,et al.  Parallelism in Coordination as an Instance of Syntactic Priming: Evidence from Corpus-based Modeling , 2005, HLT.

[109]  Mark Steedman,et al.  The syntactic process , 2004, Language, speech, and communication.