Sentence comprehension

This chapter on sentence comprehension reviews prominent sentence comprehension models addressing how people can turn a linear string of words into an understanding of sentence meaning: who did what to whom. A key method is comparing the factors that make one kind of sentence more difficult to comprehend than another, and the chapter discusses the roles of syntactic ambiguity and syntactic complexity in comprehension, including theoretical accounts emphasizing innate comprehension mechanisms or changes in comprehension patterns with experience. The chapter also discusses probabilistic and information theoretic models, the relationship between comprehension and production processes, and incrementality in sentence comprehension—the degree to which comprehension processes are devoted to interpreting the present input, updating the past, and predicting future input. The chapter also addresses future directions and the degree to which sentence comprehension research can be integrated with work addressing other aspects of language comprehension.

[1]  Michael K. Tanenhaus,et al.  Dynamical models of sentence processing , 1999, Cogn. Sci..

[2]  Adele E. Goldberg,et al.  Generalizing beyond the input: The functions of the constructions matter , 2015 .

[3]  Brian McElree,et al.  Comprehension of Linguistic Dependencies: Speed-Accuracy Tradeoff Evidence for Direct-Access Retrieval From Memory , 2011, Lang. Linguistics Compass.

[4]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[5]  B. McElree,et al.  Retrieval interference in sentence comprehension. , 2006, Journal of memory and language.

[6]  A. Sanford,et al.  Depth of processing in language comprehension: not noticing the evidence , 2002, Trends in Cognitive Sciences.

[7]  Julie C. Sedivy,et al.  Resolving attachment ambiguities with multiple constraints , 1995, Cognition.

[8]  Geoffrey E. Hinton Learning and Applying Contextual Constraints in Sentence Comprehension , 1991 .

[9]  Douglas Roland,et al.  Frequency of Basic English Grammatical Structures: A Corpus Analysis. , 2007, Journal of memory and language.

[10]  M. Tanenhaus,et al.  Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension , 1998 .

[11]  Bill Macken,et al.  Questioning short-term memory and its measurement: Why digit span measures long-term associative learning , 2015, Cognition.

[12]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[13]  Satinder Singh,et al.  Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization , 2014, Top. Cogn. Sci..

[14]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[15]  Clinton L. Johns,et al.  Low working memory capacity is only spuriously related to poor reading comprehension , 2014, Cognition.

[16]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[17]  Gina R Kuperberg,et al.  What do we mean by prediction in language comprehension? , 2016, Language, cognition and neuroscience.

[18]  Richard L. Lewis,et al.  Retrieval Interference in Syntactic Processing: The Case of Reflexive Binding in English , 2016, Front. Psychol..

[19]  Maryellen C. MacDonald,et al.  Experience and generalization in a connectionist model of Mandarin Chinese relative clause processing , 2013, Front. Psychol..

[20]  George A. Miller,et al.  Introduction to the Formal Analysis of Natural Languages , 1968 .

[21]  John R. Anderson,et al.  A rational analysis of human memory. , 1989 .

[22]  Morten H. Christiansen,et al.  The Cambridge Handbook of Psycholinguistics: Individual Differences in Sentence Processing , 2012 .

[23]  Lyn Frazier,et al.  The interaction of syntax and semantics during sentence processing: eye movements in the analysis of semantically biased sentences , 1983 .

[24]  Silvia P. Gennari,et al.  Semantic indeterminacy in object relative clauses. , 2008, Journal of memory and language.

[25]  Mark S. Seidenberg,et al.  Sentence processing and the clause boundary , 1978 .

[26]  Emily S. Darowski,et al.  Lingering misinterpretations in garden-path sentences: evidence from a paraphrasing task. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Daniel J. Acheson,et al.  The Rhymes that the Reader Perused Confused the Meaning: Phonological Effects during On-line Sentence Comprehension. , 2011, Journal of memory and language.

[28]  William O’Grady,et al.  Relative clauses Processing and acquisition * , 2011 .

[29]  Daniel Wiechmann Understanding Relative Clauses: A Usage-Based View on the Processing of Complex Constructions , 2014 .

[30]  Maryellen C. MacDonald,et al.  How language production shapes language form and comprehension , 2012, Front. Psychol..

[31]  Ting Qian,et al.  Rapid Expectation Adaptation during Syntactic Comprehension , 2013, PloS one.

[32]  M. MacDonald,et al.  Pragmatic constraint on the interpretation of complex noun phrases in Spanish and English. , 1999 .

[33]  Alan Kennedy,et al.  Eye movements in reading: Some theoretical context , 2013, Quarterly journal of experimental psychology.

[34]  Edith Kaan,et al.  Event-Related Potentials and Language Processing: A Brief Overview , 2007, Lang. Linguistics Compass.

[35]  Nick Chater,et al.  Finite models of infinite language: A connectionist approach to recursion , 2001 .

[36]  Stephani Foraker,et al.  Memory structures that subserve sentence comprehension , 2003 .

[37]  Maryellen C. MacDonald,et al.  Speak, Act, Remember , 2016 .

[38]  Adrian Staub,et al.  Eye movements and processing difficulty in object relative clauses , 2010, Cognition.

[39]  Janet Dean Fodor,et al.  The Mental Representation of Quantifiers , 1982 .

[40]  Scott H. Fraundorf,et al.  Readers generalize adaptation to newly-encountered dialectal structures to other unfamiliar structures. , 2016, Journal of memory and language.

[41]  Joseph L. Austerweil,et al.  Analyzing the history of Cognition using Topic Models , 2015, Cognition.

[42]  Maryellen C. MacDonald,et al.  Constraint Satisfaction Accounts of Lexical and Sentence Comprehension , 2006 .

[43]  C. Preston Pluralism and Naturalism: Why the Proliferation of Theories is Good for the Mind , 2005 .

[44]  Douglas Roland,et al.  Verb Sense and Verb Subcategorization Probabilities , 2001 .

[45]  C M Connine,et al.  Interactive use of lexical information in speech perception. , 1987, Journal of experimental psychology. Human perception and performance.

[46]  Morten H. Christiansen,et al.  Word chunk frequencies affect the processing of pronominal object-relative clauses , 2007, Quarterly journal of experimental psychology.

[47]  Dylan M. Jones,et al.  The phonological store of working memory: is it phonological and is it a store? , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[48]  Thomas G. Bever,et al.  Subject Preference in the Processingof Relative Clauses in Chinese , 2006 .

[49]  Mark S. Seidenberg,et al.  The emergence of grammaticality in connectionist networks. , 1999 .

[50]  M. Tanenhaus,et al.  Approaches to studying world-situated language use : bridging the language-as-product and language-as-action traditions , 2005 .

[51]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[52]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[53]  M. Pickering,et al.  Do people use language production to make predictions during comprehension? , 2007, Trends in Cognitive Sciences.

[54]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[55]  Alex B. Fine,et al.  Evidence for Implicit Learning in Syntactic Comprehension , 2013, Cogn. Sci..

[56]  Stephanie W. Haas Construal , 1996, Inf. Process. Manag..

[57]  W. Levelt,et al.  Same, different, or closely related: What is the relationship between language production and comprehension? , 2016 .

[58]  Michael P. Kaschak,et al.  This construction needs learned. , 2004, Journal of experimental psychology. General.

[59]  Eugene J. Dawydiak,et al.  Linguistic focus and good-enough representations: An application of the change-detection paradigm , 2004, Psychonomic Bulletin & Review.

[60]  William D. Marslen-Wilson,et al.  The On-Line Effects of Semantic Context on Syntactic Processing , 1977 .

[61]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[62]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[63]  Roger Levy,et al.  Sequential vs. Hierarchical Syntactic Models of Human Incremental Sentence Processing , 2012, CMCL@NAACL-HLT.

[64]  Julie A. Van Dyke,et al.  Memory Interference as a Determinant of Language Comprehension , 2012, Lang. Linguistics Compass.

[65]  Jelena Mirkovic,et al.  Incrementality and Prediction in Human Sentence Processing , 2009, Cogn. Sci..

[66]  Dan Jurafsky,et al.  Probabilistic Modeling in Psycholinguistics: Linguistic Comprehension and Production , 2006 .

[67]  Zenzi M. Griffin,et al.  Structural Priming as Implicit Learning: A Comparison of Models of Sentence Production , 2000, Journal of psycholinguistic research.

[68]  Michael K. Tanenhaus,et al.  Sentence comprehension before and after 1970: Topics, debates and techniques , 2013 .

[69]  Gerard Kempen,et al.  The Unification Space implemented as a localist neural net: predictions and error-tolerance in a constraint-based parser , 2009, Cognitive Neurodynamics.

[70]  Charles Hulme,et al.  Sentence repetition is a measure of children's language skills rather than working memory limitations , 2014, Developmental science.

[71]  M K Tanenhaus,et al.  Eye Movements and Lexical Access in Spoken-Language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing , 2000, Journal of psycholinguistic research.

[72]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[73]  Edward Gibson,et al.  The nature of working memory capacity in sentence comprehension : Evidence against domain-specific working memory resources , 2006 .

[74]  Maryellen C. MacDonald,et al.  Linking production and comprehension processes: The case of relative clauses , 2009, Cognition.

[75]  M. Tanenhaus Afterword The impact of “The cognitive basis for linguistic structures” , 2013 .

[76]  M. Gareth Gaskell,et al.  Does Sleep Improve Your Grammar? Preferential Consolidation of Arbitrary Components of New Linguistic Knowledge , 2016, PloS one.

[77]  Christina S. Kim,et al.  Syntactic Priming without Lexical Overlap in Reading Comprehension , 2014, Language and speech.

[78]  Maryellen C MacDonald,et al.  When language comprehension reflects production constraints: Resolving ambiguities with the help of past experience , 2009, Memory & cognition.

[79]  Nayoung Kwon,et al.  Cognitive and linguistic factors affecting subject/object asymmetry: An eye-tracking study of prenominal relative clauses in Korean , 2010 .

[80]  Susanne Gahl,et al.  Verb subcategorization frequencies: American English corpus data, methodological studies, and cross-corpus comparisons , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[81]  Stephen B. Barton,et al.  A case study of anomaly detection: Shallow semantic processing and cohesion establishment , 1993, Memory & cognition.

[82]  Clinton L Johns,et al.  Identifying the role of phonology in sentence-level reading. , 2015, Journal of memory and language.

[83]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[84]  Florencia Reali Frequency Affects Object Relative Clause Processing: Some Evidence in Favor of Usage-Based Accounts. , 2014 .

[85]  John Hale,et al.  Uncertainty About the Rest of the Sentence , 2006, Cogn. Sci..

[86]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[87]  G. Hickok,et al.  Recency preference in the human sentence processing mechanism , 1996, Cognition.

[88]  W D Marslen-Wilson,et al.  Sentence Perception as an Interactive Parallel Process , 1975, Science.

[89]  Leon Bergen,et al.  Rational integration of noisy evidence and prior semantic expectations in sentence interpretation , 2013, Proceedings of the National Academy of Sciences.

[90]  G. A. Miller,et al.  Finitary models of language users , 1963 .

[91]  J. Woolley,et al.  Paradigms and processes in reading comprehension. , 1982, Journal of experimental psychology. General.

[92]  Nelson Cowan,et al.  Working Memory Capacity , 2005 .

[93]  F. Ferreira,et al.  Lingering misinterpretations of garden path sentences arise from competing syntactic representations , 2013 .

[94]  Morten H. Christiansen,et al.  Experience and sentence processing: Statistical learning and relative clause comprehension , 2009, Cognitive Psychology.

[95]  Morten H. Christiansen,et al.  Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996) , 2002 .

[96]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[97]  A. Hollingworth,et al.  Thematic Roles Assigned along the Garden Path Linger , 2001, Cognitive Psychology.

[98]  P. Gordon,et al.  Effects of noun phrase type on sentence complexity , 2004 .

[99]  Nathaniel J. Smith,et al.  The effect of word predictability on reading time is logarithmic , 2013, Cognition.

[100]  Thomas A. Farmer,et al.  Early Occipital Sensitivity to Syntactic Category Is Based on Form Typicality , 2010, Psychological science.

[101]  M. Tanenhaus,et al.  Acquiring and processing verb argument structure: Distributional learning in a miniature language , 2008, Cognitive Psychology.

[102]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[103]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[104]  Robin K. Morris,et al.  Processing Subject and Object Relative Clauses: Evidence from Eye Movements , 2002 .

[105]  A. H. Kawamoto Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account. , 1993 .

[106]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[107]  David E. Rumelhart,et al.  Toward an interactive model of reading. , 1994 .

[108]  Maryellen C. MacDonald,et al.  Language knowledge and event knowledge in language use , 2015, Cognitive Psychology.

[109]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[110]  K. Rayner,et al.  Eye movement evidence that readers maintain and act on uncertainty about past linguistic input , 2009, Proceedings of the National Academy of Sciences.

[111]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[112]  Andrea E. Martin,et al.  Language Processing as Cue Integration: Grounding the Psychology of Language in Perception and Neurophysiology , 2016, Front. Psychol..

[113]  James L. McClelland Integrating probabilistic models of perception and interactive neural networks: a historical and tutorial review , 2013, Front. Psychol..

[114]  Daniel J. Acheson,et al.  Verbal working memory and language production: Common approaches to the serial ordering of verbal information. , 2009, Psychological bulletin.

[115]  Scott Cheng-Hsin Yang,et al.  A Unifying Computational Framework for Teaching and Active Learning , 2018, Top. Cogn. Sci..

[116]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[117]  Prahlad Gupta,et al.  Does Phonological Short-Term Memory Causally Determine Vocabulary Learning? Toward a Computational Resolution of the Debate. , 2009 .

[118]  Falk Huettig,et al.  Is prediction necessary to understand language , 2016 .

[119]  Kristen M. Tooley,et al.  Syntactic Priming Effects in Comprehension: A Critical Review , 2010, Lang. Linguistics Compass.

[120]  WILLIAM MARSLEN-WILSON,et al.  Processing structure of sentence perception , 1975, Nature.

[121]  Albert Kim,et al.  The Cambridge Handbook of Psycholinguistics: The Neurobiology of Sentence Comprehension , 2012 .

[122]  M. Just,et al.  Individual differences in syntactic processing: The role of working memory , 1991 .

[123]  J. Kimball Seven principles of surface structure parsing in natural language , 1973 .

[124]  M. MacDonald Distributional Information in Language Comprehension, Production, and Acquisition: Three Puzzles and a Moral , 2013 .

[125]  R. M. Warren,et al.  Phonemic restorations based on subsequent context , 1974 .