Who are You Talking About? Tracking Discourse-level Referential Processing with Event-related Brain Potentials

In this event-related brain potentials (ERPs) study, we explored the possibility to selectively track referential ambiguity during spoken discourse comprehension. Earlier ERP research has shown that referentially ambiguous nouns (e.g., the girl in a two-girl context) elicit a frontal, sustained negative shift relative to unambiguous control words. In the current study, we examined whether this ERP effect reflects deep situation model ambiguity or superficial textbase ambiguity. We contrasted these different interpretations by investigating whether a discourse-level semantic manipulation that prevents referential ambiguity also averts the elicitation of a referentially induced ERP effect. We compared ERPs elicited by nouns that were referentially nonambiguous but were associated with two discourse entities (e.g., the girl with two girls introduced in the context, but one of which has died or left the scene), with referentially ambiguous and nonambiguous control words. Although temporally referentially ambiguous nouns elicited a frontal negative shift compared to control words, the double bound but referentially nonambiguous nouns did not. These results suggest that it is possible to selectively track referential ambiguity with ERPs at the level that is most relevant to discourse comprehension, the situation model.

[1]  Peter Hagoort,et al.  So who's "he" anyway? Differential ERP and ERSP effects of referential success, ambiguity and failure during spoken language comprehension , 2004 .

[2]  Peter Hagoort,et al.  The neurocognition of syntactic processing , 1999 .

[3]  Kerry Ledoux,et al.  The Neural Mechanisms of Coreference , 2008, Lang. Linguistics Compass.

[4]  Mante S. Nieuwland,et al.  On sense and reference: Examining the functional neuroanatomy of referential processing , 2007, NeuroImage.

[5]  Colin M. Brown,et al.  When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. , 2003, Brain research. Cognitive brain research.

[6]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[7]  Rolf A. Zwaan,et al.  Discourse comprehension. , 1997, Annual review of psychology.

[8]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[9]  M. Kutas,et al.  Views on how the electrical activity that the brain generates reflects the functions of different language structures. , 1997, Psychophysiology.

[10]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[11]  P. Gordon,et al.  Electrophysiological Evidence for Reversed Lexical Repetition Effects in Language Processing , 2004, Journal of Cognitive Neuroscience.

[12]  Mante S. Nieuwland,et al.  The Neurocognition of Referential Ambiguity in Language Comprehension , 2008, Lang. Linguistics Compass.

[13]  L. Osterhout,et al.  Event-Related Brain Potentials Elicited by Failure to Agree , 1995 .

[14]  Phillip J. Holcomb,et al.  An electrophysiological investigation of the effects of coreference on word repetition and synonymy , 2005, Brain and Language.

[15]  Frank Rösler,et al.  Event-Related Responses to Pronoun and Proper Name Anaphors in Parallel and Nonparallel Discourse Structures , 1999, Brain and Language.

[16]  William S Horton,et al.  Out of sight, out of mind: Occlusion and the accessibility of information in narrative comprehension , 2003, Psychonomic bulletin & review.

[17]  Marta Kutas,et al.  Postlexical integration processes during language comprehension: Evidence from brain-imaging research , 2000 .

[18]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[19]  J. Trueswell,et al.  Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension , 2005, Cognitive, affective & behavioral neuroscience.

[20]  R. Poldrack,et al.  Recovering Meaning Left Prefrontal Cortex Guides Controlled Semantic Retrieval , 2001, Neuron.

[21]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Jos J. A. Van Berkum,et al.  Chapter 13 Sentence Comprehension in a Wider Discourse: Can We Use ERPs To Keep Track of Things? , 2004 .

[23]  Alan Garnham,et al.  Mental models and the interpretation of anaphora , 2001 .

[24]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[25]  Mante S. Nieuwland,et al.  When Peanuts Fall in Love: N400 Evidence for the Power of Discourse , 2005, Journal of Cognitive Neuroscience.

[26]  Jerome L. Myers,et al.  Accessing the discourse representation during reading , 1998 .

[27]  Tony Harris,et al.  An ERP Investigation of Binding and Coreference , 2000, Brain and Language.

[28]  A. Glenberg,et al.  Mental models contribute to foregrounding during text comprehension , 1987 .

[29]  Van Berkum,et al.  Understanding Sentences in Context What Brain Waves Can Tell Us , 2008 .

[30]  Colin M. Brown,et al.  Early referential context effects in sentence processing: Evidence from event-related brain potentials , 1999 .

[31]  Mante S. Nieuwland,et al.  The interplay between semantic and referential aspects of anaphoric noun phrase resolution: Evidence from ERPs , 2008, Brain and Language.

[32]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Mante S. Nieuwland,et al.  Establishing reference in language comprehension: An electrophysiological perspective , 2007, Brain Research.

[34]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[35]  C. Clifton,et al.  The On-line Study of Sentence Comprehension: Eyetracking, ERPs and Beyond , 2004 .

[36]  Peter Hagoort,et al.  Brain responses to lexical ambiguity resolution and parsing. , 1994 .

[37]  Mante S. Nieuwland,et al.  Individual differences and contextual bias in pronoun resolution: Evidence from ERPs , 2006, Brain Research.

[38]  Sarah M. Callahan,et al.  Processing anaphoric constructions: Insights from electrophysiological studies , 2008, Journal of Neurolinguistics.

[39]  M. Rugg,et al.  Event-related potential studies of associative recognition and recall: electrophysiological evidence for context dependent retrieval processes. , 1999, Brain research. Cognitive brain research.

[40]  J. Szentágothai,et al.  Brain Research , 2009, Experimental Neurology.

[41]  Matthew H. Davis,et al.  The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. , 2005, Cerebral cortex.