Frequenzeffekte in der Satzverarbeitung. Wie Erfahrung den Erwerb und die Verarbeitung von Sprache beeinflusst

Distributional properties of language and the implicit acquisition of knowledge about these properties influences human language processing. Connectionist approaches of sentence processing provide a paradigm that places the role of frequency at the core of psycholinguistic reasoning. We introduce this paradigm and some of its consequences by focusing on simple recurrent networks (Elman 1990) and the processing differences of relative clauses (MacDonald/Christiansen 2002). An effect of frequency that is predicted by connectionist models–but not by classical, computational symbol processing models–is the interference of so-called ›local syntactic coherences‹: embedded sequences that have–if they occur in isolation–a particular interpretation. However, embedded in a complex sentence, this interpretation is incorrect because the preceding context of the global sentence renders it ungrammatical. It has been shown in both reading- and visual world studies that the local, syntactically invalid analysis of such sequences is in fact processed, interferes with the globally correct analysis, and can even influence interpretational processes. This is remarkable since such effects seem to be in conflict with fundamental assumptions about economical language processing. In addition, we show that the amount of ›distraction‹ that the local sequence causes depends on the tendency of the local sequence towards the local analysis, where this tendency was measured by examining corpus data. We take these effects as strong evidence in favour of processing accounts that do not take effects of distributional properties in processing as mere phenomena of ›performance‹ but rather as results of the fundamental mechanisms and processes language acquisition and processing are built on.

[1]  L. Konieczny,et al.  Local syntactic coherence interpretation. Evidence from a visual world study. , 2009 .

[2]  Martin J. Pickering,et al.  The Modular Statistical Hypothesis: Exploring Lexical Category Ambiguity , 1999 .

[3]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[4]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[5]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[6]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[7]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[8]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[9]  Roger Levy,et al.  A model of local coherence effects in human sentence processing as consequences of updates from bottom-up prior to posterior beliefs , 2009, NAACL.

[10]  Rolf A. Zwaan,et al.  Embodied Sentence Comprehension , 2005 .

[11]  J. Elman An alternative view of the mental lexicon , 2004, Trends in Cognitive Sciences.

[12]  Anuenue Kukona,et al.  Impulse Processing: A Dynamical Systems Model of Incremental Eye Movements in the Visual World Paradigm , 2011, Cogn. Sci..

[13]  Christina M. Krause,et al.  The Psychological Reality of Local Coherences in Sentence Processing , 2005 .

[14]  Daniel C. Richardson,et al.  Effects of merely local syntactic coherence on sentence processing , 2004 .

[15]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[16]  Roger Levy,et al.  A noisy-channel model of rational human sentence comprehension under uncertain input , 2008, EMNLP 2008.

[17]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[18]  John T. Hale,et al.  What a Rational Parser Would Do , 2011, Cogn. Sci..

[19]  E. Gibson The dependency locality theory: A distance-based theory of linguistic complexity. , 2000 .

[20]  Michael J. Spivey,et al.  The Continuity Of Mind , 2008 .

[21]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[22]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[23]  Roger M. Cooper,et al.  The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. , 1974 .

[24]  Morten H. Christiansen,et al.  Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996) , 2002 .

[25]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999 .

[26]  Janet D. Fodor,et al.  The sausage machine: A new two-stage parsing model , 1978, Cognition.

[27]  M. Just,et al.  Individual differences in syntactic processing: The role of working memory , 1991 .

[28]  Edward Gibson,et al.  The Interaction of Top-Down and Bottom-Up Statistics in the Resolution of Syntactic Category Ambiguity. , 2006 .

[29]  T. Gelder,et al.  The dynamical hypothesis in cognitive science , 1998, Behavioral and Brain Sciences.

[30]  J. A. Dyke Interference effects from grammatically unavailable constituents during sentence processing. , 2007 .

[31]  Roger Levy,et al.  Correcting the Incorrect: Local Coherence Effects Modeled with Prior Belief Update , 2009 .

[32]  J. Hawkins Efficiency and complexity in grammars , 2004 .

[33]  P. Auer Online-Syntax , 2009 .

[34]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[35]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[36]  P. Gordon,et al.  Memory interference during language processing. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[37]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[38]  J. Elman On the Meaning of Words and Dinosaur Bones: Lexical Knowledge Without a Lexicon , 2009, Cogn. Sci..

[39]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[40]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[41]  Morten H. Christiansen,et al.  Experience and sentence processing: Statistical learning and relative clause comprehension , 2009, Cognitive Psychology.

[42]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[43]  Peter Baumann,et al.  Connectionist Modeling of Situated Language Processing: Language and Meaning Acquisition from an Embodiment Perspective , 2009 .