Electrophysiological Research on Conversation and Discourse Processing

Research into the electrophysiology of language comprehension has essentially been “speakerless.” This has left three vital aspects of communication—it is social, pragmatic, and dynamic—severely underresearched. This chapter makes a case for the investigation of language users involved in active conversation and describes the problems and possibilities that accompany this choice of subject. It gives an overview of what is currently known about how the social, pragmatic, and dynamic puzzles of communication are solved by the brain, and it describes the well-filled toolbox of language-related event-related brain potential (ERP) components (e.g., Nref, N400, P600) that are at our disposal.

[1]  Michael J. Spivey,et al.  The Cambridge Handbook of Psycholinguistics , 2012 .

[2]  C. Phillips,et al.  No semantic illusions in the “Semantic P600” phenomenon: ERP evidence from Mandarin Chinese , 2013, Brain Research.

[3]  May.  How to Say , 2005 .

[4]  C. Phillips,et al.  Examining the evidence for an independent semantic analyzer: An ERP study in Spanish , 2012, Brain and Language.

[5]  Colin M. Brown,et al.  When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. , 2003, Brain research. Cognitive brain research.

[6]  Petra B. Schumacher.  The hepatitis called , 2011 .

[7]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[8]  R. Freedle.  Discourse production and comprehension , 1978 .

[9]  John C J Hoeks,et al.  Seeing words in context: the interaction of lexical and sentence level information during reading. , 2004, Brain research. Cognitive brain research.

[10]  A. Friederici.  The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[11]  B. Kotchoubey,et al.  Event-related potentials, cognition, and behavior: A biological approach , 2006, Neuroscience & Biobehavioral Reviews.

[12]  S. Bookheimer.  Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[13]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[14]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[15]  Dorothee J. Chwilla,et al.  Monitoring in Language Perception , 2009, Lang. Linguistics Compass.

[16]  H. Kolk,et al.  The interplay of heuristics and parsing routines in sentence comprehension: Evidence from ERPs and reaction times , 2007, Biological Psychology.

[17]  Knud Lambrecht,et al.  Information structure and sentence form , 1994 .

[18]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[19]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[20]  Van Berkum,et al.  The electrophysiology of discourse and conversation , 2012 .

[21]  Angela D. Friederici,et al.  Isn't It Ironic? An Electrophysiological Exploration of Figurative Language Processing , 2011, Journal of Cognitive Neuroscience.

[22]  Siobhan Chapman.  Logic and Conversation , 2005 .

[23]  Mante S. Nieuwland,et al.  Establishing reference in language comprehension: An electrophysiological perspective , 2007, Brain Research.

[24]  P. Johnson-Laird.  Mental models , 1989 .

[25]  Dale J. Barr.  Perspective Taking and Its Impostors in Language Use , 2014 .

[26]  Ina Bornkessel-Schlesewsky,et al.  Meaningful physical changes mediate lexical–semantic integration: Top-down and form-based bottom-up information sources interact in the N400 , 2011, Neuropsychologia.

[27]  David Poeppel,et al.  Functional Anatomic Models of Language: Assembling the Pieces , 2008, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[28]  C. Van Petten,et al.  Prediction during language comprehension: benefits, costs, and ERP components. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[30]  I. Noveck,et al.  Characterizing the time course of an implicature: An evoked potentials study , 2003, Brain and Language.

[31]  Utako Minai,et al.  Pragmatic inferences modulate N400 during sentence comprehension: Evidence from picture–sentence verification , 2013, Neuroscience Letters.

[32]  A. Friederici.  Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[33]  Stefan Heim,et al.  Prosodic pitch accents in language comprehension and production: ERP data and acoustic analyses. , 2006, Acta neurobiologiae experimentalis.

[34]  Colin M. Brown,et al.  Early referential context effects in sentence processing: Evidence from event-related brain potentials , 1999 .

[35]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[36]  Jacqueline Nadel,et al.  Anatomical Connectivity Influences both Intra- and Inter-Brain Synchronizations , 2012, PloS one.

[37]  Angela D. Friederici,et al.  Pathways to language: fiber tracts in the human brain , 2009, Trends in Cognitive Sciences.

[38]  Ulrike Toepel,et al.  Catching the news: Processing strategies in listening to dialogs as measured by ERPs , 2007, Behavioral and Brain Functions.

[39]  J. Elman.  On the Meaning of Words and Dinosaur Bones: Lexical Knowledge Without a Lexicon , 2009, Cogn. Sci..

[40]  Gina R Kuperberg,et al.  The time course of building discourse coherence in schizophrenia: an ERP investigation. , 2007, Psychophysiology.

[41]  D. Caplan,et al.  Electrophysiological distinctions in processing conceptual relationships within simple sentences. , 2003, Brain research. Cognitive brain research.

[42]  J. Decety,et al.  The Role of the Right Temporoparietal Junction in Social Interaction: How Low-Level Computational Processes Contribute to Meta-Cognition , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[43]  Derek Bousfield,et al.  Impoliteness in interaction , 2008 .

[44]  J. Elman.  An alternative view of the mental lexicon , 2004, Trends in Cognitive Sciences.

[45]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[46]  Peter,et al.  Semantic Unification , 2008 .

[47]  Y. Grodzinsky,et al.  The battle for Broca’s region , 2008, Trends in Cognitive Sciences.

[48]  Kai Alter,et al.  Prosody in Dialogues and Single Sentences: How Prosody can influence Speech Perception , 2004 .

[49]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[50]  Petra Hendriks,et al.  Questions Left Unanswered: How the Brain Responds to Missing Information , 2013, PloS one.

[51]  L. Astolfi,et al.  Social neuroscience and hyperscanning techniques: Past, present and future , 2014, Neuroscience & Biobehavioral Reviews.

[52]  Colin M. Brown,et al.  The N400 as a function of the level of processing. , 1995, Psychophysiology.

[53]  William D. Marslen-Wilson,et al.  Left inferior frontal cortex and syntax: function, structure and behaviour in patients with left hemisphere damage , 2011, Brain : a journal of neurology.

[54]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[55]  D. Chwilla,et al.  The interplay between mood and language comprehension: Evidence from P600 to semantic reversal anomalies , 2013, Neuropsychologia.

[56]  Van Berkum,et al.  The neuropragmatics of 'simple' utterance comprehension: An ERP review , 2009 .

[57]  Matthias Schlesewsky,et al.  Contextual information modulates initial processes of syntactic integration: the role of inter- versus intrasentential predictions. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[58]  Masato Fukuda,et al.  Frontopolar activation during face-to-face conversation: An in situ study using near-infrared spectroscopy , 2010, Neuropsychologia.

[59]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[60]  P. Burkhardt.  The P600 reflects cost of new information in discourse memory , 2007, Neuroreport.

[61]  Anita Steube,et al.  Misleading dialogues: Human's brain reaction to prosodic information , 2001 .

[62]  E. Goffman.  Interaction Ritual: Essays on Face-To-Face Behavior , 1967 .

[63]  Jonathan Culpeper,et al.  Towards an anatomy of impoliteness. , 1996 .

[64]  Anne Lacheret,et al.  On-line Processing of Pop-Out Words in Spoken French Dialogues , 2005, Journal of Cognitive Neuroscience.

[65]  P. Gordon,et al.  Coreference and lexical repetition: Mechanisms of discourse integration , 2007, Memory & cognition.

[66]  P. Hagoort.  On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[67]  G. Nunberg.  The non-uniqueness of semantic solutions: Polysemy , 1979 .

[68]  F. Pulvermüller.  Brain reflections of words and their meaning , 2001, Trends in Cognitive Sciences.

[69]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[70]  John C. J. Hoeks,et al.  A time and place for language comprehension: mapping the N400 and the P600 to a minimal cortical network , 2013, Front. Hum. Neurosci..

[71]  Colin M. Brown,et al.  Semantic Integration in Sentences and Discourse: Evidence from the N400 , 1999, Journal of Cognitive Neuroscience.

[72]  H. Kolk,et al.  Monitoring in language perception: The effect of misspellings of words in highly constrained sentences , 2006, Brain Research.

[73]  E. Goffman.  The Presentation of Self in Everyday Life , 1959 .

[74]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[75]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[76]  Z. Ye,et al.  Involvement of cognitive control in sentence comprehension: Evidence from ERPs , 2008, Brain Research.

[77]  Peter Hagoort,et al.  Semantic illusion depends on information structure: ERP evidence , 2009, Brain Research.

[78]  Maria Polinsky,et al.  Violations of information structure: An electrophysiological study of answers to wh-questions , 2007, Brain and Language.

[79]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[80]  H. Kolk,et al.  An ERP study of P600 effects elicited by semantic anomalies. , 2005, Brain research. Cognitive brain research.

[81]  P. Gordon,et al.  Electrophysiological Evidence for Reversed Lexical Repetition Effects in Language Processing , 2004, Journal of Cognitive Neuroscience.

[82]  J. Grafman,et al.  An integrative cognitive neuroscience theory of social reasoning and moral judgment. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[83]  Giosuè Baggio,et al.  The balance between memory and unification in semantics: A dynamic account of the N400 , 2011 .

[84]  Henrik Walter,et al.  Intentional Minds: A Philosophical Analysis of Intention Tested through fMRI Experiments Involving People with Schizophrenia, People with Autism, and Healthy Individuals , 2011, Front. Hum. Neurosci..

[85]  Mante S. Nieuwland,et al.  On sense and reference: Examining the functional neuroanatomy of referential processing , 2007, NeuroImage.

[86]  Gregory Hickok,et al.  The Role of Broca's Area in Sentence Comprehension , 2011, Journal of Cognitive Neuroscience.

[87]  Mante S. Nieuwland,et al.  On the incrementality of pragmatic processing: An ERP investigation of informativeness and pragmatic abilities. , 2010, Journal of memory and language.

[88]  Penelope Brown,et al.  Politeness: Some Universals in Language Usage , 1989 .

[89]  Kara D. Federmeier,et al.  Chapter 1 Time for Meaning: Electrophysiology Provides Insights into the Dynamics of Representation and Processing in Semantic Memory , 2009 .

[90]  Katrin Amunts,et al.  Architecture and organizational principles of Broca's region , 2012, Trends in Cognitive Sciences.

[91]  M. Kutas,et al.  Psycholinguistics Electrified II (1994–2005) , 2006 .

[92]  P. Morosan,et al.  Broca's Region: Novel Organizational Principles and Multiple Receptor Mapping , 2010, PLoS biology.

[93]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[94]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[95]  B. Keysar.  Communication and miscommunication: The role of egocentric processes , 2007 .

[96]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[97]  Ryan C. Taylor.  Tracking referents : markedness, world knowledge and pronoun resolution , 2013 .

[98]  Peter Hagoort,et al.  About Edible Restaurants: Conflicts between Syntax and Semantics as Revealed by ERPs , 2010, Front. Psychology.

[99]  Matthias Schlesewsky,et al.  An alternative perspective on “semantic P600” effects in language comprehension , 2008, Brain Research Reviews.

[100]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[101]  Megan A. Boudewyn,et al.  Processing new and repeated names: Effects of coreference on repetition priming with speech and fast RSVP , 2007, Brain Research.

[102]  Uli Sauerland,et al.  Semantics and Pragmatics: From Experiment to Theory , 2009 .

[103]  H. H. Clark,et al.  Understanding by addressees and overhearers , 1989, Cognitive Psychology.

[104]  Steven H. Lewis,et al.  Listener Responsiveness and the Coordination of Conversation , 1982 .

[105]  P. Hagoort.  Interplay between Syntax and Semantics during Sentence Comprehension: ERP Effects of Combining Syntactic and Semantic Violations , 2003, Journal of Cognitive Neuroscience.

[106]  Keith A. Johnson,et al.  Cortical Hubs Revealed by Intrinsic Functional Connectivity: Mapping, Assessment of Stability, and Relation to Alzheimer's Disease , 2009, The Journal of Neuroscience.

[107]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[108]  Peter Hagoort,et al.  The Neural Integration of Speaker and Message , 2008, Journal of Cognitive Neuroscience.

[109]  Jos J. A. Van Berkum,et al.  What makes a discourse constraining? Comparing the effects of discourse message and scenario fit on the discourse-dependent N400 effect , 2007, Brain Research.

[110]  Gisela Redeker,et al.  Less Is Not More: Neural Responses to Missing and Superfluous Accents in Context , 2012, Journal of Cognitive Neuroscience.

[111]  Hartmut Fitz,et al.  Getting real about Semantic Illusions: Rethinking the functional role of the P600 in language comprehension , 2012, Brain Research.

[112]  Suzanne Mannes,et al.  Global Semantic Expectancy and Language Comprehension , 1994, Journal of Cognitive Neuroscience.

[113]  Dorothee J. Chwilla,et al.  Monitoring in Language Perception: Mild and Strong Conflicts Elicit Different ERP Patterns , 2010, Journal of Cognitive Neuroscience.

[114]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[115]  Mante S. Nieuwland,et al.  Testing the limits of the semantic illusion phenomenon: ERPs reveal temporary semantic change deafness in discourse comprehension. , 2005, Brain research. Cognitive brain research.

[116]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[117]  Cornelius Weiller,et al.  Please don’t underestimate the ventral pathway in language , 2009, Trends in Cognitive Sciences.

[118]  Peter Hagoort,et al.  Beyond the sentence given , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[119]  Peter Hagoort,et al.  Pitch accent and lexical tone processing in Chinese discourse comprehension: An ERP study , 2008, Brain Research.

[120]  Ulrike Toepel,et al.  On the independence of information structural processing from prosody , 2004 .

[121]  B. R. Schlenker.  Impression Management: The Self-Concept, Social Identity, and Interpersonal Relations , 1980 .

[122]  Mante S. Nieuwland,et al.  Who are you talking about? Tracking discourse-level referential processing with ERPs , 2007 .

[123]  W. Chafe.  Givenness, contrastiveness, definiteness, subjects, topics, and point of view , 1976 .

[124]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[125]  Petra Burkhardt,et al.  Inferential bridging relations reveal distinct neural mechanisms: Evidence from event-related brain potentials , 2006, Brain and Language.

[126]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[127]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[128]  L. Osterhout,et al.  The independence of combinatory semantic processing: Evidence from event-related potentials , 2005 .

[129]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[130]  Peter Hagoort,et al.  Event-related Potential Evidence on the Influence of Accentuation in Spoken Discourse Comprehension in Chinese , 2008, Journal of Cognitive Neuroscience.

[131]  Dorothee J. Chwilla,et al.  When Heuristics Clash with Parsing Routines: ERP Evidence for Conflict Monitoring in Sentence Perception , 2006, Journal of Cognitive Neuroscience.

[132]  Marcel Bastiaansen,et al.  The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect , 2011, Neuropsychologia.