Working memory differences in long-distance dependency resolution

There is a wealth of evidence showing that increasing the distance between an argument and its head leads to more processing effort, namely, locality effects; these are usually associated with constraints in working memory (DLT: Gibson, 2000; activation-based model: Lewis and Vasishth, 2005). In SOV languages, however, the opposite effect has been found: antilocality (see discussion in Levy et al., 2013). Antilocality effects can be explained by the expectation-based approach as proposed by Levy (2008) or by the activation-based model of sentence processing as proposed by Lewis and Vasishth (2005). We report an eye-tracking and a self-paced reading study with sentences in Spanish together with measures of individual differences to examine the distinction between expectation- and memory-based accounts, and within memory-based accounts the further distinction between DLT and the activation-based model. The experiments show that (i) antilocality effects as predicted by the expectation account appear only for high-capacity readers; (ii) increasing dependency length by interposing material that modifies the head of the dependency (the verb) produces stronger facilitation than increasing dependency length with material that does not modify the head; this is in agreement with the activation-based model but not with the expectation account; and (iii) a possible outcome of memory load on low-capacity readers is the increase in regressive saccades (locality effects as predicted by memory-based accounts) or, surprisingly, a speedup in the self-paced reading task; the latter consistent with good-enough parsing (Ferreira et al., 2002). In sum, the study suggests that individual differences in working memory capacity play a role in dependency resolution, and that some of the aspects of dependency resolution can be best explained with the activation-based model together with a prediction component.

[1]  David Caplan,et al.  Age, working memory, and on-line syntactic processing in sentence comprehension. , 2001 .

[2]  M. Just,et al.  Working memory constraints on the processing of syntactic ambiguity , 1992, Cognitive Psychology.

[3]  Amitai Etzioni ~, Routledge , 2004 .

[4]  Reinhold Kliegl,et al.  Experimental Effects and Individual Differences in Linear Mixed Models: Estimating the Relationship between Spatial, Object, and Attraction Effects in Visual Attention , 2010, Front. Psychology.

[5]  Angela D. Friederici,et al.  Syntactic parsing and working memory: The effects of syntactic complexity, reading span, and concurrent load , 2001 .

[6]  Jos J. A. Van Berkum,et al.  Does working memory capacity affect the ability to predict upcoming words in discourse? , 2009, Brain Research.

[7]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[8]  Christopher T. Kello,et al.  Verb-specific constraints in sentence processing: separating effects of lexical preference from garden-paths. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[10]  John M. Henderson,et al.  Reading processes during syntactic analysis and reanalysis , 1993 .

[11]  C. Phillips,et al.  ERP effects of the processing of syntactic long-distance dependencies. , 2005, Brain research. Cognitive brain research.

[12]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[13]  Anne Anastasi,et al.  The nature of individual differences. , 1939 .

[14]  Morten H. Christiansen,et al.  Experience and sentence processing: Statistical learning and relative clause comprehension , 2009, Cognitive Psychology.

[15]  R. Engle Working Memory Capacity as Executive Attention , 2002 .

[16]  R. Poldrack,et al.  Neural Systems for Rapid Automatized Naming in Skilled Readers: Unraveling the RAN-Reading Relationship , 2004, The Cognitive Neuroscience of Reading.

[17]  G. Waters,et al.  Age, working memory, and on-line syntactic processing in sentence comprehension. , 2001, Psychology and aging.

[18]  Morten H. Christiansen,et al.  Reassessing working memory: comment on Just and Carpenter (1992) and Waters and Caplan (1996). , 2002, Psychological review.

[19]  Clare Beaumont,et al.  Reading Relative Clauses , 1982 .

[20]  L Konieczny,et al.  Locality and Parsing Complexity , 2000, Journal of psycholinguistic research.

[21]  Adam Chuderski,et al.  Modeling Individual Differences in Working Memory Search Task , 2006 .

[22]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[23]  A. Marantz,et al.  Image, language, brain : papers from the First Mind Articulation Project Symposium , 2000 .

[24]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[25]  F. Ferreira,et al.  The role of working memory in syntactic ambiguity resolution: a psychometric approach. , 2007, Journal of experimental psychology. General.

[26]  Evelina Fedorenko,et al.  The syntactic complexity of Russian relative clauses , 2012, Journal of memory and language.

[27]  Benton J. Underwood,et al.  Individual differences as a crucible in theory construction. , 1975 .

[28]  Kristen M. Tooley,et al.  Individual Differences in Eye-Movements During Reading: Working Memory and Speed-of-Processing Effects. , 2012, Journal of eye movement research.

[29]  Elizabeth A. L. Stine-Morrow,et al.  Aging and individual differences in binding during sentence understanding: Evidence from temporary and global syntactic attachment ambiguities , 2014, Cognition.

[30]  Clinton L. Johns,et al.  Low working memory capacity is only spuriously related to poor reading comprehension , 2014, Cognition.

[31]  M. Masson,et al.  A linear mixed model analysis of masked repetition priming , 2010 .

[32]  Shravan Vasishth,et al.  Working Memory in Sentence Comprehension: Processing Hindi Center Embeddings , 2003 .

[33]  Edward Gibson,et al.  Reading relative clauses in English , 2005 .

[34]  David E. Irwin,et al.  Visual Search has Memory , 2001, Psychological science.

[35]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[36]  Edward Gibson,et al.  The nature of working memory capacity in sentence comprehension : Evidence against domain-specific working memory resources , 2006 .

[37]  Fernanda Ferreira,et al.  The 'Good Enough' Approach to Language Comprehension , 2007, Lang. Linguistics Compass.

[38]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[39]  R. Engle,et al.  The nature of individual differences in working memory capacity: active maintenance in primary memory and controlled search from secondary memory. , 2007, Psychological review.

[40]  John Eccleston,et al.  Statistics and Computing , 2006 .

[41]  Paul McKellips,et al.  Good enough , 2013, Lab Animal.

[42]  J. Oakhill,et al.  Working memory, comprehension ability and the resolution of text anomaly. , 1989, British journal of psychology.

[43]  Reinhold Kliegl,et al.  Semantic preview benefit during reading. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[44]  Brian A. Nosek,et al.  Recommendations for Increasing Replicability in Psychology † , 2013 .

[45]  Chantel S. Prat,et al.  The Brain Basis of Individual Differences in Language Comprehension Abilities , 2011, Lang. Linguistics Compass.

[46]  Klaus Oberauer,et al.  Working memory capacity and the construction of spatial mental models in comprehension and deductive reasoning , 2006, Quarterly journal of experimental psychology.

[47]  Marta Kutas,et al.  CHAPTER 15 A Look around at What Lies Ahead: Prediction and Predictability in Language Processing , 2010 .

[48]  Barbara Steiner,et al.  The 'Good Enough' , 2001, Afterall: A Journal of Art, Context and Enquiry.

[49]  Titus von der Malsburg,et al.  Scanpaths reveal syntactic underspecification and reanalysis strategies , 2012, Language and Cognitive Processes.

[50]  M. Denckla,et al.  Rapid ‘automatized’ naming (R.A.N.): Dyslexia differentiated from other learning disabilities , 1976, Neuropsychologia.

[51]  Richard L. Lewis,et al.  In search of on-line locality effects in sentence comprehension. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[52]  Edward Gibson,et al.  Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity , 2005, Cogn. Sci..

[53]  Frank Keller,et al.  Data from eye-tracking corpora as evidence for theories of syntactic processing complexity , 2008, Cognition.

[54]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[55]  Raymond M Klein,et al.  Decomposing the relation between Rapid Automatized Naming (RAN) and reading ability. , 2009, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[56]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[57]  K Christianson,et al.  Misinterpretations of Garden-Path Sentences: Implications for Models of Sentence Processing and Reanalysis , 2001, Journal of psycholinguistic research.

[58]  Jacolien van Rij,et al.  How WM Load Influences Linguistic Processing in Adults: A Computational Model of Pronoun Interpretation in Discourse , 2013, Top. Cogn. Sci..

[59]  M. Just,et al.  Individual differences in syntactic processing: The role of working memory , 1991 .

[60]  A. Anastasi Individual differences. , 2020, Annual review of psychology.

[61]  Marsha C. Lovett,et al.  Modeling individual differences in working memory performance: a source activation account , 2001, Cogn. Sci..

[62]  Richard L. Lewis,et al.  Distinguishing effects of structure and decay on attachment and repair: A cue-based parsing account of recovery from misanalyzed ambiguities , 2003 .

[63]  G. Waters,et al.  Verbal working memory and sentence comprehension , 1999, Behavioral and Brain Sciences.

[64]  Adrian Staub,et al.  Eye movements and processing difficulty in object relative clauses , 2010, Cognition.

[65]  Barry K. Rosen,et al.  Syntactic Complexity , 1974, Inf. Control..

[66]  G. Waters,et al.  Memory mechanisms supporting syntactic comprehension , 2013, Psychonomic Bulletin & Review.

[67]  Richard L. Lewis,et al.  Argument-Head Distance and Processing Complexity: Explaining both Locality and Antilocality Effects , 2006 .

[68]  C. Fiebach,et al.  Separating syntactic memory costs and syntactic integration costs during parsing: the processing of German WH-questions , 2002 .

[69]  M. Kutas,et al.  Bridging the Gap: Evidence from ERPs on the Processing of Unbounded Dependencies , 1993, Journal of Cognitive Neuroscience.

[70]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[71]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[72]  Raymond M. Klein,et al.  The ABCs of computerized naming: Equivalency, reliability, and predictive validity of a computerized rapid automatized naming (RAN) task , 2006, Journal of Neuroscience Methods.

[73]  P. Carpenter,et al.  Individual Differences in Integrating Information between and within Sentences. , 1983 .

[74]  Peter Carruthers The Nature of Working Memory , 2015 .

[75]  Shravan Vasishth,et al.  Locality in German , 2011, Dialogue Discourse.

[76]  Narayanan Srinivasan,et al.  Strong Expectations Cancel Locality Effects: Evidence from Hindi , 2014, PloS one.

[77]  Stephani Foraker,et al.  Memory structures that subserve sentence comprehension , 2003 .

[78]  Michael J Kane,et al.  Why does working memory capacity predict variation in reading comprehension? On the influence of mind wandering and executive attention. , 2012, Journal of experimental psychology. General.

[79]  Edward Gibson,et al.  Direct Evidence of Memory Retrieval as a Source of Difficulty in Non-Local Dependencies in Language , 2013, Cogn. Sci..

[80]  H. Schielzeth,et al.  Conclusions beyond support: overconfident estimates in mixed models , 2008, Behavioral ecology : official journal of the International Society for Behavioral Ecology.

[81]  Lynn Hasher,et al.  Working Memory, Comprehension, and Aging: A Review and a New View , 1988 .

[82]  M. Daneman,et al.  Working memory and language comprehension: A meta-analysis , 1996, Psychonomic bulletin & review.

[83]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[84]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[85]  A. Hollingworth,et al.  Thematic Roles Assigned along the Garden Path Linger , 2001, Cognitive Psychology.

[86]  A. Heathcote,et al.  Averaging learning curves across and within participants , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[87]  V. Carey,et al.  Mixed-Effects Models in S and S-Plus , 2001 .

[88]  Nelson Cowan,et al.  Working Memory Capacity , 2005 .

[89]  V. Kuperman,et al.  Effects of individual differences in verbal skills on eye-movement patterns during sentence reading. , 2011, Journal of memory and language.

[90]  Leticia Pablos,et al.  Pre-verbal Structure Building in Romance Languages and Basque , 2006 .

[91]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[92]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[93]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[94]  R. Engle,et al.  Is working memory capacity task dependent , 1989 .

[95]  B. McElree,et al.  Retrieval interference in sentence comprehension. , 2006, Journal of memory and language.

[96]  E. Gibson,et al.  Memory Limitations and Structural Forgetting: The Perception of Complex Ungrammatical Sentences as Grammatical , 1999 .

[97]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[98]  Morten H. Christiansen,et al.  Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996) , 2002 .

[99]  J. Woolley,et al.  Paradigms and processes in reading comprehension. , 1982, Journal of experimental psychology. General.

[100]  G. Waters,et al.  The capacity theory of sentence comprehension: critique of Just and Carpenter (1992) , 1996, Psychological review.

[101]  B McElree,et al.  Sentence Comprehension Is Mediated by Content-Addressable Memory Structures , 2000, Journal of psycholinguistic research.

[102]  Carrick C. Williams,et al.  Younger and Older Adults' "Good-Enough" Interpretations of Garden-Path Sentences , 2006, Discourse processes.

[103]  E. Gibson The dependency locality theory: A distance-based theory of linguistic complexity. , 2000 .

[104]  M. MacDonald,et al.  Individual Differences and Probabilistic Constraints in Syntactic Ambiguity Resolution , 1995 .

[105]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[106]  Frank Keller,et al.  Expectation and Locality Effects in German Verb-final Structures. , 2013, Journal of memory and language.

[107]  Robin K. Morris,et al.  Working memory, animacy, and verb class in the processing of relative clauses , 2005 .