Neural correlates and network connectivity underlying narrative production and comprehension: A combined fMRI and PET study

The neural correlates of narrative production and comprehension remain poorly understood. Here, using positron emission tomography (PET), functional magnetic resonance imaging (fMRI), contrast and functional network connectivity analyses we comprehensively characterize the neural mechanisms underlying these complex behaviors. Eighteen healthy subjects told and listened to fictional stories during scanning. In addition to traditional language areas (e.g., left inferior frontal and posterior middle temporal gyri), both narrative production and comprehension engaged regions associated with mentalizing and situation model construction (e.g., dorsomedial prefrontal cortex, precuneus and inferior parietal lobules) as well as neocortical premotor areas, such as the pre-supplementary motor area and left dorsal premotor cortex. Narrative comprehension alone showed marked bilaterality, activating right hemisphere homologs of perisylvian language areas. Narrative production remained predominantly left lateralized, uniquely activating executive and motor-related regions essential to language formulation and articulation. Connectivity analyses revealed strong associations between language areas and the superior and middle temporal gyri during both tasks. However, only during storytelling were these same language-related regions connected to cortical and subcortical motor regions. In contrast, during story comprehension alone, they were strongly linked to regions supporting mentalizing. Thus, when employed in a more complex, ecologically-valid context, language production and comprehension show both overlapping and idiosyncratic patterns of activation and functional connectivity. Importantly, in each case the language system is integrated with regions that support other cognitive and sensorimotor domains.

[1]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[2]  Jordan Grafman,et al.  Discourse production following injury to the dorsolateral prefrontal cortex , 2012, Neuropsychologia.

[3]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[4]  Elizabeth Jefferies,et al.  Semantic Processing in the Anterior Temporal Lobes: A Meta-analysis of the Functional Neuroimaging Literature , 2010, Journal of Cognitive Neuroscience.

[5]  Richard S. J. Frackowiak,et al.  Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension , 1995, Cognition.

[6]  V. Haughton,et al.  Frequencies contributing to functional connectivity in the cerebral cortex in "resting-state" data. , 2001, AJNR. American journal of neuroradiology.

[7]  Cosimo Urgesi,et al.  Please Get to the Point! A Cortical Correlate of Linguistic Informativeness , 2012, Journal of Cognitive Neuroscience.

[8]  Ivan Toni,et al.  A Dissociation Between Linguistic and Communicative Abilities in the Human Brain , 2010, Psychological science.

[9]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[10]  Tim Shallice,et al.  The different neural correlates of action and functional knowledge in semantic memory: an FMRI study. , 2008, Cerebral cortex.

[11]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[12]  C. Frith,et al.  Distinct regions of medial rostral prefrontal cortex supporting social and nonsocial functions. , 2007, Social cognitive and affective neuroscience.

[13]  M. Jung-Beeman Bilateral brain processes for comprehending natural language , 2005, Trends in Cognitive Sciences.

[14]  Daniel J. Acheson,et al.  A Common Neural Substrate for Language Production and Verbal Working Memory , 2011, Journal of Cognitive Neuroscience.

[15]  C. Neil Macrae,et al.  The Link between Social Cognition and Self-referential Thought in the Medial Prefrontal Cortex , 2005, Journal of Cognitive Neuroscience.

[16]  Lee Ryan,et al.  Role of the striatum in language: Syntactic and conceptual sequencing , 2013, Brain and Language.

[17]  J. Rowe,et al.  What “Works” in Working Memory? Separate Systems for Selection and Updating of Critical Information , 2009, The Journal of Neuroscience.

[18]  R. Wise,et al.  Listening to narrative speech after aphasic stroke: the role of the left anterior temporal lobe. , 2006, Cerebral cortex.

[19]  D. Stuss,et al.  Adult clinical neuropsychology: lessons from studies of the frontal lobes. , 2002, Annual review of psychology.

[20]  Carlo Caltagirone,et al.  Cortico-subcortical underpinnings of narrative processing impairment in schizophrenia , 2010, Psychiatry Research: Neuroimaging.

[21]  Richard B. Ivry,et al.  Consensus Paper: Roles of the Cerebellum in Motor Control—The Diversity of Ideas on Cerebellar Involvement in Movement , 2011, The Cerebellum.

[22]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[23]  Kevin Murphy,et al.  Speech production: Wernicke, Broca and beyond. , 2002, Brain : a journal of neurology.

[24]  Kayoko Okada,et al.  Identification of lexical–phonological networks in the superior temporal sulcus using functional magnetic resonance imaging , 2006, Neuroreport.

[25]  Arthur C. Graesser,et al.  A theory of inference generation during text comprehension , 1993 .

[26]  Marco Iacoboni,et al.  The Essential Role of Premotor Cortex in Speech Perception , 2007, Current Biology.

[27]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[28]  Pia Tikka,et al.  Listening to an Audio Drama Activates Two Processing Networks, One for All Sounds, Another Exclusively for Speech , 2013, PloS one.

[29]  D. A. Robertson,et al.  Functional Neuroanatomy of the Cognitive Process of Mapping During Discourse Comprehension , 2000, Psychological science.

[30]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[31]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[32]  Rex E. Jung,et al.  A Baseline for the Multivariate Comparison of Resting-State Networks , 2011, Front. Syst. Neurosci..

[33]  Tülay Adali,et al.  Comparison of multi‐subject ICA methods for analysis of fMRI data , 2010, Human brain mapping.

[34]  M. Just,et al.  Brain correlates of discourse processing: An fMRI investigation of irony and conventional metaphor comprehension , 2006, Neuropsychologia.

[35]  Evelyn C. Ferstl,et al.  The role of coherence and cohesion in text comprehension: an event-related fMRI study. , 2001, Brain research. Cognitive brain research.

[36]  Marc Joliot,et al.  Brain activity at rest: a multiscale hierarchical functional organization. , 2011, Journal of neurophysiology.

[37]  P. Greenfield,et al.  Language, tools and brain: The ontogeny and phylogeny of hierarchically organized sequential behavior , 1991, Behavioral and Brain Sciences.

[38]  Bernard Mazoyer,et al.  What is right-hemisphere contribution to phonological, lexico-semantic, and sentence processing? Insights from a meta-analysis , 2011, NeuroImage.

[39]  M. Just,et al.  Differentiable cortical networks for inferences concerning people's intentions versus physical causality , 2011, Human brain mapping.

[40]  Peter Indefrey,et al.  The Spatial and Temporal Signatures of Word Production Components: A Critical Update , 2011, Front. Psychology.

[41]  R. Mar The neuropsychology of narrative: story comprehension, story production and their interrelation , 2004, Neuropsychologia.

[42]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[43]  P. Pietrini,et al.  Where the brain appreciates the moral of a story. , 1995, Neuroreport.

[44]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[45]  Peter A. Bandettini,et al.  Separating respiratory-variation-related fluctuations from neuronal-activity-related fluctuations in fMRI , 2006, NeuroImage.

[46]  Peter Hagoort,et al.  Neural responses to the production and comprehension of syntax in identical utterances , 2004, Brain and Language.

[47]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[48]  The Big Picture: Storytelling Ability in Adults with Autism Spectrum Conditions , 2012, Journal of autism and developmental disorders.

[49]  K. R. Ridderinkhof,et al.  Striatum and pre-SMA facilitate decision-making under time pressure , 2008, Proceedings of the National Academy of Sciences.

[50]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[51]  Jeffrey M. Zacks,et al.  Human Brain Activity Time-Locked to Narrative Event Boundaries , 2007, Psychological science.

[52]  N. Geschwind Language and the brain. , 1972, Scientific American.

[53]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[54]  Phillip J. Holcomb,et al.  Making sense of discourse: An fMRI study of causal inferencing across sentences , 2006, NeuroImage.

[55]  A. Toyomura,et al.  Neural substrates of irony comprehension: A functional MRI study , 2010, Brain Research.

[56]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[57]  M. Corbetta,et al.  Episodic Memory Retrieval, Parietal Cortex, and the Default Mode Network: Functional and Topographic Analyses , 2011, The Journal of Neuroscience.

[58]  Gregory McCarthy,et al.  Reading about the actions of others: Biological motion imagery and action congruency influence brain activity , 2010, Neuropsychologia.

[59]  A. Marini Characteristics of Narrative Discourse Processing after Damage to the Right Hemisphere , 2012, Seminars in Speech and Language.

[60]  Evelyn C. Ferstl,et al.  Emotional and Temporal Aspects of Situation Model Processing during Text Comprehension: An Event-Related fMRI Study , 2005, Journal of Cognitive Neuroscience.

[61]  R W Cox,et al.  Magnetic field changes in the human brain due to swallowing or speaking , 1998, Magnetic resonance in medicine.

[62]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[63]  Donald T. Stuss,et al.  Remembering and Knowing in Patients with Frontal Lobe Injuries , 2003, Cortex.

[64]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[65]  Jeffrey M. Zacks,et al.  Neural substrates of narrative comprehension and memory , 2008, NeuroImage.

[66]  Peter Hagoort,et al.  When Elephants Fly: Differential Sensitivity of Right and Left Inferior Frontal Gyri to Discourse and World Knowledge , 2009, Journal of Cognitive Neuroscience.

[67]  M. Tomasello Origins of human communication , 2008 .

[68]  Matthias Schlesewsky,et al.  Processing linguistic complexity and grammaticality in the left frontal cortex. , 2005, Cerebral cortex.

[69]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[70]  Evelyn C. Ferstl,et al.  The extended language network: A meta‐analysis of neuroimaging studies on text comprehension , 2008, Human brain mapping.

[71]  C L Ludlow,et al.  Functional neuroanatomy of human vocalization: an H215O PET study. , 2005, Cerebral cortex.

[72]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[73]  Genevieve A. Davis,et al.  Referential cohesion and logical coherence of narration after closed head injury , 2004, Brain and Language.

[74]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[75]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[76]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[77]  M. Rushworth,et al.  Organization of action sequences and the role of the pre-SMA. , 2004, Journal of neurophysiology.

[78]  Dorothy V M Bishop,et al.  Narrative skills of children with communication impairments. , 2003, International journal of language & communication disorders.

[79]  Remco J. Renken,et al.  Cerebral representations of space and time , 2009, NeuroImage.

[80]  Florian Th. Siebörger,et al.  Making sense of nonsense: An fMRI study of task induced inference processes during discourse comprehension , 2007, Brain Research.

[81]  Tilo Kircher,et al.  Neural correlates of narrative shifts during auditory story comprehension , 2009, NeuroImage.

[82]  S. Scott,et al.  A Common System for the Comprehension and Production of Narrative Speech , 2007, The Journal of Neuroscience.

[83]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[84]  Iroise Dumontheil,et al.  The gateway hypothesis of rostral prefrontal cortex (area 10) function , 2007, Trends in Cognitive Sciences.

[85]  Jiang Xu,et al.  Language in context: emergent features of word, sentence, and narrative comprehension , 2005, NeuroImage.

[86]  P. Ruby,et al.  What is self-specific? Theoretical investigation and critical review of neuroimaging results. , 2009, Psychological review.

[87]  Douglas C. Noll,et al.  Overt Verbal Responding during fMRI Scanning: Empirical Investigations of Problems and Potential Solutions , 1999, NeuroImage.

[88]  M. Raichle,et al.  Anatomic Localization and Quantitative Analysis of Gradient Refocused Echo-Planar fMRI Susceptibility Artifacts , 1997, NeuroImage.

[89]  Paul W. Burgess,et al.  Distinct roles for lateral and medial rostral prefrontal cortex in source monitoring of perceived and imagined events , 2008, Neuropsychologia.

[90]  John A. Detre,et al.  SPEECH PRODUCTION : AN fMRI STUDY USING CONTINUOUS ARTERIAL SPIN LABELING , 2008 .

[91]  B. Dubois,et al.  Functions of the left superior frontal gyrus in humans: a lesion study. , 2006, Brain : a journal of neurology.

[92]  Daniel Bullock,et al.  Neural Representations and Mechanisms for the Performance of Simple Speech Sequences , 2010, Journal of Cognitive Neuroscience.

[93]  K Ugurbil,et al.  Human primary visual cortex and lateral geniculate nucleus activation during visual imagery , 1998, Neuroreport.

[94]  Istvan Molnar-Szakacs,et al.  Beyond superior temporal cortex: intersubject correlations in narrative speech comprehension. , 2008, Cerebral cortex.

[95]  B. Mazoyer,et al.  A Common Language Network for Comprehension and Production: A Contribution to the Definition of Language Epicenters with PET , 2000, NeuroImage.

[96]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[97]  Norihiro Sadato,et al.  Neural substrates of sarcasm: A functional magnetic-resonance imaging study , 2006, Brain Research.

[98]  G. Capilouto,et al.  Considering a multi-level approach to understanding maintenance of global coherence in adults with aphasia , 2012, Aphasiology.

[99]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[100]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[101]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[102]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[103]  Vince D. Calhoun,et al.  A method for functional network connectivity among spatially independent resting-state components in schizophrenia , 2008, NeuroImage.

[104]  Heather Harris Wright,et al.  Evaluating measures of global coherence ability in stories in adults. , 2013, International journal of language & communication disorders.

[105]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[106]  A. Braun,et al.  Neural Correlates of Lyrical Improvisation: An fMRI Study of Freestyle Rap , 2012, Scientific Reports.

[107]  Volkmar Glauche,et al.  Ventral and dorsal pathways for language , 2008, Proceedings of the National Academy of Sciences.

[108]  J. Hoit,et al.  Influence of continuous speaking on ventilation. , 2000, Journal of speech, language, and hearing research : JSLHR.

[109]  S. Carey,et al.  Understanding other minds: linking developmental psychology and functional neuroimaging. , 2004, Annual review of psychology.

[110]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[111]  Christian Scheiber,et al.  Neural substrates of animal mental imagery: calcarine sulcus and dorsal pathway involvement — an fMRI study , 2002, Brain Research.

[112]  Juan Antonio Hernández Tamames,et al.  Brain activation in discourse comprehension: A 3t fMRI study , 2008, NeuroImage.

[113]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994, Psychological review.

[114]  Alan C. Evans,et al.  Role of the human anterior cingulate cortex in the control of oculomotor, manual, and speech responses: a positron emission tomography study. , 1993, Journal of neurophysiology.

[115]  Harold Goodglass,et al.  Phonological factors in auditory comprehension in aphasia , 1977, Neuropsychologia.

[116]  C. Tompkins,et al.  Coarse coding and discourse comprehension in adults with right hemisphere brain damage , 2008, Aphasiology.

[117]  E. Jefferies,et al.  Amodal semantic representations depend on both anterior temporal lobes: Evidence from repetitive transcranial magnetic stimulation , 2010, Neuropsychologia.

[118]  A. Braun,et al.  The neural organization of discourse: an H2 15O-PET study of narrative production in English and American sign language. , 2001, Brain : a journal of neurology.

[119]  Philip N. Johnson-Laird,et al.  Mental Models in Cognitive Science , 1980, Cogn. Sci..

[120]  Manfred Herrmann,et al.  Comparison of two Simon tasks: Neuronal correlates of conflict resolution based on coherent motion perception , 2006, NeuroImage.

[121]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[122]  M. Kawato,et al.  Individuals' and groups' intentions in the medial prefrontal cortex , 2011, Neuroreport.

[123]  Samuel Kaski,et al.  Identifying fragments of natural speech from the listener's MEG signals , 2013, Human brain mapping.

[124]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[125]  D. Kimura,et al.  Motor functions of the left hemisphere. , 1974, Brain : a journal of neurology.

[126]  J. Desmond,et al.  The contributions of cerebro-cerebellar circuitry to executive verbal working memory , 2010, Cortex.

[127]  Ricardo Vig Overlearning in Marginal Distribution-Based ICA: Analysis and Solutions , 2003 .

[128]  M. Mesulam,et al.  Dissociations between fluency and agrammatism in primary progressive aphasia , 2012, Aphasiology.

[129]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[130]  S. Blumstein,et al.  An Event-Related fMRI Investigation of Implicit Semantic Priming , 2003, Journal of Cognitive Neuroscience.

[131]  A. Braun,et al.  Comparison of continuous overt speech fMRI using BOLD and arterial spin labeling , 2005, Human brain mapping.

[132]  Karl J. Friston,et al.  Distribution of cortical neural networks involved in word comprehension and word retrieval. , 1991, Brain : a journal of neurology.

[133]  N. Sadato,et al.  Perspective-taking as part of narrative comprehension: A functional MRI study , 2009, Neuropsychologia.