The interface between language and attention: prosodic focus marking recruits a general attention network in spoken language comprehension.

In spoken language, pitch accent can mark certain information as focus, whereby more attentional resources are allocated to the focused information. Using functional magnetic resonance imaging, this study examined whether pitch accent, used for marking focus, recruited general attention networks during sentence comprehension. In a language task, we independently manipulated the prosody and semantic/pragmatic congruence of sentences. We found that semantic/pragmatic processing affected bilateral inferior and middle frontal gyrus. The prosody manipulation showed bilateral involvement of the superior/inferior parietal cortex, superior and middle temporal cortex, as well as inferior, middle, and posterior parts of the frontal cortex. We compared these regions with attention networks localized in an auditory spatial attention task. Both tasks activated bilateral superior/inferior parietal cortex, superior temporal cortex, and left precentral cortex. Furthermore, an interaction between prosody and congruence was observed in bilateral inferior parietal regions: for incongruent sentences, but not for congruent ones, there was a larger activation if the incongruent word carried a pitch accent, than if it did not. The common activations between the language task and the spatial attention task demonstrate that pitch accent activates a domain general attention network, which is sensitive to semantic/pragmatic aspects of language. Therefore, attention and language comprehension are highly interactive.

[1]  Daniel Büring,et al.  Semantics, Intonation and Information Structure , 2007 .

[2]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[3]  Peter Hagoort,et al.  When Elephants Fly: Differential Sensitivity of Right and Left Inferior Frontal Gyri to Discourse and World Knowledge , 2009, Journal of Cognitive Neuroscience.

[4]  P. Hornby Surface structure and presupposition , 1974 .

[5]  P. Hagoort,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2004, Science.

[6]  Marc Brysbaert,et al.  SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles , 2010, Behavior research methods.

[7]  Peter Hagoort,et al.  Semantic illusion depends on information structure: ERP evidence , 2009, Brain Research.

[8]  A. Friederici,et al.  Functional MR imaging exposes differential brain responses to syntax and prosody during auditory sentence comprehension , 2003, Journal of Neurolinguistics.

[9]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[10]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[11]  J. Fodor,et al.  Semantic focus and sentence comprehension , 1979, Cognition.

[12]  Jian Huang,et al.  Involvement of left inferior frontal gyrus in sentence-level semantic integration , 2009, NeuroImage.

[13]  Marcel Bastiaansen,et al.  The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect , 2011, Neuropsychologia.

[14]  Peter,et al.  Semantic Unification , 2008 .

[15]  Mary E. Beckman,et al.  The Parsing of Prosody , 1996 .

[16]  Mario Dzemidzic,et al.  Neural circuitry underlying sentence-level linguistic prosody , 2005, NeuroImage.

[17]  Sarah Shomstein,et al.  Parietal Cortex Mediates Voluntary Control of Spatial and Nonspatial Auditory Attention , 2006, The Journal of Neuroscience.

[18]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[19]  M. Lowe,et al.  Hemispheric asymmetries in phonological processing of tones versus segmental units , 2010, Neuroreport.

[20]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.

[21]  M. Corbetta,et al.  Voluntary orienting is dissociated from target detection in human posterior parietal cortex , 2000, Nature Neuroscience.

[22]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[23]  Thomas Kotschi,et al.  Information Structure in Spoken Discourse , 2006 .

[24]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[25]  M. Halliday NOTES ON TRANSITIVITY AND THEME IN ENGLISH. PART 2 , 1967 .

[26]  M. Baciu,et al.  An fMRI study of the perception of contrastive prosodic focus in French , 2010, Speech Prosody 2010.

[27]  Louis ten Bosch,et al.  Acoustical features as predictors for prominence in read aloud dutch sentences used in ANN's , 1999, EUROSPEECH.

[28]  K. Rayner,et al.  Linguistic focus affects eye movements during reading , 1997, Memory & cognition.

[29]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[30]  Mariko Osaka,et al.  Neural bases of focusing attention in working memory: An fMRI study based on group differences , 2007, Cognitive, affective & behavioral neuroscience.

[31]  C. Reiss,et al.  The Oxford Handbook of Linguistic Interfaces , 2007 .

[32]  Robert Asher,et al.  The Encyclopedia of Language and Linguistics , 1995 .

[33]  Marcel Bastiaansen,et al.  Information Structure Influences Depth of Syntactic Processing: Event-Related Potential Evidence for the Chomsky Illusion , 2012, PloS one.

[34]  Peter Hagoort,et al.  UvA-DARE (Digital Academic Repository) Unification of speaker and meaning in language comprehension: an fMRI study , 2022 .

[35]  S. Brédart,et al.  Moses strikes again: Focalization effect on a semantic illusion , 1988 .

[36]  N. Miller,et al.  What makes acquired foreign accent syndrome foreign? , 2006, Journal of Neurolinguistics.

[37]  Lee M. Miller,et al.  Auditory attentional control and selection during cocktail party listening. , 2010, Cerebral cortex.

[38]  Carlos Gussenhoven,et al.  Notions and subnotions in information structure , 2008 .

[39]  Angelien Sanderman,et al.  On the perceptual strength of prosodic boundaries and its relation to suprasegmental cues , 1994 .

[40]  M Erb,et al.  Distinct frontal regions subserve evaluation of linguistic and emotional aspects of speech intonation. , 2004, Cerebral cortex.

[41]  M. Corbetta,et al.  Quantitative analysis of attention and detection signals during visual search. , 2003, Journal of neurophysiology.

[42]  Gereon R. Fink,et al.  Cue validity modulates the neural correlates of covert endogenous orienting of attention in parietal and frontal cortex , 2006, NeuroImage.

[43]  Carlos Gussenhoven,et al.  Prosody and information structure: An fMRI study , 2006 .

[44]  Hanna Damasio,et al.  A morphometric analysis of auditory brain regions in congenitally deaf adults , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[45]  M. Mattson,et al.  From words to meaning: A semantic illusion , 1981 .

[46]  Kristina M. Visscher,et al.  A Core System for the Implementation of Task Sets , 2006, Neuron.

[47]  Joseph T. Devlin,et al.  Orienting attention to semantic categories , 2006, NeuroImage.

[48]  L Frazier,et al.  Construal: Overview, Motivation, and Some New Evidence , 1997, Journal of psycholinguistic research.

[49]  Karl J. Friston,et al.  CHAPTER 2 – Statistical parametric mapping , 2007 .

[50]  S. Brédart,et al.  The Moses illusion: A follow-up on the focalization effect , 1989 .

[51]  M. Corbetta,et al.  Neural Systems for Visual Orienting and Their Relationships to Spatial Working Memory , 2002, Journal of Cognitive Neuroscience.

[52]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[53]  L. Stowe,et al.  Rethinking the neurological basis of language , 2005 .

[54]  M. Lowe,et al.  Selective attention to lexical tones recruits left dorsal frontoparietal network , 2003, Neuroreport.

[55]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[56]  John C. Adair,et al.  The neural networks underlying endogenous auditory covert orienting and reorienting , 2006, NeuroImage.

[57]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[58]  S. Shipp The brain circuitry of attention , 2004, Trends in Cognitive Sciences.

[59]  Juha Salmi,et al.  Orienting and maintenance of spatial attention in audition and vision: multimodal and modality-specific brain activations , 2007, Brain Structure and Function.

[60]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.