What naturalistic stimuli tell us about pronoun resolution in real-time processing

Studies on pronoun resolution have mostly utilized short texts consisting of a context and a target sentence. In the current study we presented participants with nine chapters of an audio book while recording their EEG to investigate the real-time resolution of personal and demonstrative pronouns in a more naturalistic setting. The annotation of the features of the pronouns and their antecedents registered a surprising pattern: demonstrative pronouns showed an interpretive preference for subject/agent antecedents, although they are described to have an anti-subject or anti-agent preference. Given the presence of perspectival centers in the audio book, this however confirmed proposals that demonstrative pronouns are sensitive to perspectival centers. The ERP results revealed a biphasic N400–Late Positivity pattern at posterior electrodes for the demonstrative pronoun relative to the personal pronoun, thereby confirming previous findings with highly controlled stimuli. We take the observed N400 for the demonstrative pronoun as an indication for more demanding processing costs that occur due to the relative unexpectedness of this referential expression. The Late Positivity is taken to reflect the consequences of attentional reorientation: since the demonstrative pronoun indicates a possible shift in the discourse structure, it induces updating of the discourse structure. In addition to the biphasic pattern, the data showed an enhanced positivity at frontal electrode sites for the demonstrative pronoun relative to the personal pronoun. We suggest that this frontal positivity reflects self-relevant engagement and identification with the perspective holder. Our study suggests that by using naturalistic stimuli, we get one step closer to understanding the implementation of language processing in the brain during real life language processing.

[1]  M. Crocker,et al.  Retrieval (N400) and integration (P600) in expectation-based comprehension , 2021, PloS one.

[2]  Ingmar Brilmayer,et al.  Referential Chains Reveal Predictive Processes and Form-to-Function Mapping: An Electroencephalographic Study Using Naturalistic Story Stimuli , 2021, Frontiers in Psychology.

[3]  M. Crocker,et al.  When components collide: Spatiotemporal overlap of the N400 and P600 in language comprehension , 2021, Brain Research.

[4]  Jesse A. Harris,et al.  Extended Perspective Shift and Discourse Economy in Language Processing , 2021, Frontiers in Psychology.

[5]  S. Hinterwimmer Zum Zusammenspiel von Erzähler- und Protagonistenperspektive in den Brenner-Romanen von Wolf Haas , 2020 .

[6]  B. Höhle,et al.  Common Ground Information Affects Reference Resolution: Evidence From Behavioral Data, ERPs, and Eye-Tracking , 2020, Frontiers in Psychology.

[7]  V. Lai,et al.  The mental representation and social aspect of expressives , 2020, Cognition & emotion.

[8]  S. Hinterwimmer,et al.  Constraints on German diese demonstratives: language formality and subject-avoidance , 2020, Glossa: a journal of general linguistics.

[9]  Liberty S. Hamilton,et al.  The revolution will not be controlled: natural stimuli in speech neuroscience , 2018, Language, cognition and neuroscience.

[10]  Inge Kirsner „Tschick“ , 2020, pop.religion: lebensstil – kultur – theologie.

[11]  P. Schumacher,et al.  Referential shift potential of demonstrative pronouns – Evidence from text continuation , 2020 .

[12]  K. Heusinger,et al.  Discourse prominence: Definition and application , 2019, Journal of Pragmatics.

[13]  M. Bader,et al.  The interpretation of German personal pronouns and d-pronouns , 2019, Zeitschrift für Sprachwissenschaft.

[14]  M. Crocker,et al.  Event-related potentials index lexical retrieval (N400) and integration (P600) during language comprehension , 2019, Brain and Cognition.

[15]  S. Hinterwimmer Prominent protagonists , 2019 .

[16]  M. Schlesewsky,et al.  The exceptional nature of the first person in natural story processing and the transfer of egocentricity , 2018, Language, Cognition and Neuroscience.

[17]  S. Hinterwimmer,et al.  Demonstrative Pronouns and Propositional Attitudes , 2018 .

[18]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[19]  Phillip M. Alday,et al.  Electrophysiology Reveals the Neural Dynamics of Naturalistic Auditory Language Processing: Event-Related Potentials Reflect Continuous Model Updates , 2016, eNeuro.

[20]  Patrick Sturt,et al.  Processing of It and This in Written Narrative Discourse , 2016 .

[21]  Ina Bornkessel-Schlesewsky,et al.  Towards a Neurobiology of Information Structure , 2016 .

[22]  Erich Schröger,et al.  High-pass filters and baseline correction in M/EEG analysis-continued discussion , 2016, Journal of Neuroscience Methods.

[23]  E. Schröger,et al.  High-pass filters and baseline correction in M/EEG analysis. Commentary on: “How inappropriate high-pass filters can produce artefacts and incorrect conclusions in ERP studies of language and cognition” , 2016, Journal of Neuroscience Methods.

[24]  Michael Burke,et al.  Taking Perspective: Personal Pronouns Affect Experiential Aspects of Literary Reading , 2016, PloS one.

[25]  Florian Schiel,et al.  BAS Speech Science Web Services - an Update of Current Developments , 2016, LREC.

[26]  M. de Vega,et al.  Readers of narratives take the protagonist’s geographical perspective. Evidence from an event-related potential study , 2016, Brain and Language.

[27]  S. Hinterwimmer,et al.  Demonstrative pronouns and perspective , 2016 .

[28]  P. Schumacher,et al.  Thematic role as prominence cue during pronoun resolution in German , 2016 .

[29]  P. Schumacher,et al.  Backward- and Forward-Looking Potential of Anaphors , 2015, Front. Psychol..

[30]  Erich Schröger,et al.  Digital filter design for electrophysiological data – a practical approach , 2015, Journal of Neuroscience Methods.

[31]  Israel de la Fuente Putting pronoun resolution in context : the role of syntax, semantics, and pragmatics in pronoun interpretation , 2015 .

[32]  Iryna Gurevych,et al.  Automatic Annotation Suggestions and Custom Annotation Layers in WebAnno , 2014, ACL.

[33]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[34]  P. Schumacher,et al.  Animacy matters: ERP evidence for the multi-dimensionality of topic-worthiness in Chinese , 2014, Brain Research.

[35]  Petra B. Schumacher,et al.  New is not always costly: evidence from online processing of topic and contrast in Japanese , 2013, Front. Psychol..

[36]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[37]  Sonja A. Kotz,et al.  Prediction errors in self- and externally-generated deviants , 2013, Biological Psychology.

[38]  Saveria Colonna,et al.  Information structure effects on anaphora resolution in German and French: A crosslinguistic study of pronoun resolution , 2012 .

[39]  B. Hemforth,et al.  Different effects of focus in intra- and inter-sentential pronoun resolution in German , 2012 .

[40]  Petra B. Schumacher,et al.  Topicality matters: Position-specific demands on Chinese discourse processing , 2012, Neuroscience Letters.

[41]  Reinhold Kliegl,et al.  Eye movements and brain electric potentials during reading , 2012, Psychological research.

[42]  E. Kaiser Salience and contrast effects in reference resolution: The interpretation of Dutch pronouns and demonstratives , 2011 .

[43]  Aibao Zhou,et al.  An EEG study on the effect of self-relevant possessive pronoun: Self-referential content and first-person perspective , 2011, Neuroscience Letters.

[44]  Neal R. Norrick,et al.  12. Reference and anaphora , 2011 .

[45]  E. Kaiser Relation between Coherence Relations and Anaphoric Demonstratives in German * , 2011 .

[46]  Beate Sodian,et al.  True- and false-belief reasoning in children and adults: An event-related potential study of theory of mind , 2011, Developmental Cognitive Neuroscience.

[47]  Aibao Zhou,et al.  An ERP study on the effect of self-relevant possessive pronoun , 2010, Neuroscience Letters.

[48]  Joël Pynte,et al.  Language specific preferences in anaphor resolution: Exposure or Gricean maxims? , 2010 .

[49]  Christopher Potts,et al.  Perspective-shifting with appositives and expressives , 2009 .

[50]  Petra B. Schumacher,et al.  Definiteness Marking Shows Late Effects during Discourse Processing: Evidence from ERPs , 2009, DAARC.

[51]  M. Schlesewsky,et al.  The neural mechanisms of word order processing revisited: Electrophysiological evidence from Japanese , 2008, Brain and Language.

[52]  J. Trueswell,et al.  Interpreting pronouns and demonstratives in Finnish: Evidence for a form-specific approach to reference resolution , 2008 .

[53]  P. Bosch,et al.  The Non-Subject Bias of German Demonstrative Pronouns , 2007 .

[54]  Carla Umbach,et al.  Reference Determination for Demonstrative Pronouns , 2007 .

[55]  Petra Burkhardt,et al.  Inferential bridging relations reveal distinct neural mechanisms: Evidence from event-related brain potentials , 2006, Brain and Language.

[56]  Mante S. Nieuwland,et al.  When Peanuts Fall in Love: N400 Evidence for the Power of Discourse , 2005, Journal of Cognitive Neuroscience.

[57]  Petra B. Schumacher,et al.  The Syntax–Discourse Interface: Representing and interpreting dependency , 2005 .

[58]  P. Gordon,et al.  Electrophysiological Evidence for Reversed Lexical Repetition Effects in Language Processing , 2004, Journal of Cognitive Neuroscience.

[59]  Frank Rösler,et al.  Different Anaphoric Expressions Are Investigated by Event-Related Brain Potentials , 2004, Journal of psycholinguistic research.

[60]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[61]  H. Gray,et al.  P300 as an index of attention to self-relevant stimuli , 2004 .

[62]  E. Kaiser Word Order, Grammatical Function, and Referential Form: On the Patterns of Anaphoric Reference in Finnish , 2004 .

[63]  M. Tanenhaus,et al.  The effects of common ground and perspective on domains of referential interpretation , 2003 .

[64]  Elsi Kaiser,et al.  The quest for a referent: A crosslinguistic look at reference resolution , 2003 .

[65]  Peter Bosch,et al.  Demonstrative Pronouns and Personal Pronouns: German der vs er , 2003 .

[66]  R. Sainsbury Reference And Anaphora , 2002 .

[67]  W. Abraham Pronomina im Diskurs: deutsche Personal- und Demonstrativpronomina unter 'Zentrierungsperspektive'. Grammatische Überlegungen zu einer Teiltheorie der Textkohärenz , 2002 .

[68]  Lyn Frazier,et al.  Null vs. overt pronouns and the Topic-Focus articulation in Spanish: 2704 , 2002 .

[69]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[70]  Marjorie Taylor,et al.  Neural Correlates of Theory-of-Mind Reasoning: An Event-Related Potential Study , 2000, Psychological science.

[71]  D. Barr,et al.  Taking Perspective in Conversation: The Role of Mutual Knowledge in Comprehension , 2000, Psychological science.

[72]  Beatrice Primus,et al.  Cases and thematic roles : ergative, accusative and active , 1999 .

[73]  Florian Schiel,et al.  Automatic Phonetic Transcription of Non-Prompted Speech , 1999 .

[74]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[75]  Alexis Dimitriadis,et al.  When pro-Drop Languages Don't: On Overt Pronominal Subjects in Greek , 1995 .

[76]  David R. Dowty Thematic proto-roles and argument selection , 1991 .

[77]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[78]  M. Kutas,et al.  Event-related brain potentials to grammatical errors and semantic anomalies , 1983, Memory & cognition.