Co-localizing linguistic and musical syntax with intracranial EEG

Despite general agreement on shared syntactic resources in music and language, the neuroanatomical underpinnings of this overlap remain largely unexplored. While previous studies mainly considered frontal areas as supramodal grammar processors, the domain-general syntactic role of temporal areas has been so far neglected. Here we capitalized on the excellent spatial and temporal resolution of subdural EEG recordings to co-localize low-level syntactic processes in music and language in the temporal lobe in a within-subject design. We used Brain Surface Current Density mapping to localize and compare neural generators of the early negativities evoked by violations of phrase structure grammar in both music and spoken language. The results show that the processing of syntactic violations relies in both domains on bilateral temporo-fronto-parietal neural networks. We found considerable overlap of these networks in the superior temporal lobe, but also differences in the hemispheric timing and relative weighting of their fronto-temporal constituents. While alluding to the dissimilarity in how shared neural resources may be configured depending on the musical or linguistic nature of the perceived stimulus, the combined data lend support for a co-localization of early musical and linguistic syntax processing in the temporal lobe.

[1]  S. Koelsch Toward a Neural Basis of Music Perception – A Review and Updated Model , 2011, Front. Psychology.

[2]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[3]  M. Fuchs,et al.  Linear and nonlinear current density reconstructions. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[4]  D. Swinney,et al.  Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing , 2005, Human brain mapping.

[5]  Mark D'Esposito,et al.  Repetition Suppression and Reactivation in Auditory–Verbal Short-Term Recognition Memory , 2008, Cerebral cortex.

[6]  Thomas F Münte,et al.  An fMRI study of canonical and noncanonical word order in German , 2007, Human brain mapping.

[7]  Kevin P. Hinshaw,et al.  Functional Roles of Broca's Area and SMG: Evidence from Cortical Stimulation Mapping in a Deaf Signer , 1999, NeuroImage.

[8]  S. Koelsch Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[9]  Lorraine K Tyler,et al.  Fronto-temporal brain systems supporting spoken language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  P Praamstra,et al.  Linear estimation discriminates midline sources and a motor cortex contribution to the readiness potential. , 1996, Electroencephalography and clinical neurophysiology.

[11]  R. Duckrow,et al.  Concerning the observation of an electrical potential at a distance from an intracranial electrode contact , 2009, Clinical Neurophysiology.

[12]  Alan C. Evans,et al.  An MRI-Based Probabilistic Atlas of Neuroanatomy , 1994 .

[13]  Angela D. Friederici,et al.  Functional Neural Networks of Semantic and Syntactic Processes in the Developing Brain , 2007, Journal of Cognitive Neuroscience.

[14]  Jonah Katz,et al.  The Identity Thesis for Language and Music , 2011 .

[15]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[16]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[17]  B. Tillmann,et al.  Sensory versus cognitive components in harmonic priming. , 2003, Journal of experimental psychology. Human perception and performance.

[18]  P Kahane,et al.  Intracranial EEG and human brain mapping , 2003, Journal of Physiology-Paris.

[19]  Nancy Kanwisher,et al.  Functional specificity for high-level linguistic processing in the human brain , 2011, Proceedings of the National Academy of Sciences.

[20]  G. Schlaug,et al.  Testing for causality with transcranial direct current stimulation: pitch memory and the left supramarginal gyrus , 2006, Neuroreport.

[21]  Lutz Jäncke,et al.  Functional anatomy of pitch memory—an fMRI study with sparse temporal sampling , 2003, NeuroImage.

[22]  Steven Brown,et al.  The Origins of Music: Edited by Nils L. Wallin, Björn Merker, and Steven Brown, Cambridge, MA: The MIT Press, 2000, xii+ 498 pages, ISBN 0-262-23206-5, US$60.00 , 2000 .

[23]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[24]  Matthias Dümpelmann,et al.  3D source localization derived from subdural strip and grid electrodes: A simulation study , 2009, Clinical Neurophysiology.

[25]  Karl J. Friston,et al.  PHRENOLOGY : What Can Neuroimaging Tell Us About Distributed Circuitry ? , 2005 .

[26]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[27]  Aniruddh D. Patel,et al.  Making psycholinguistics musical: Self-paced reading time evidence for shared processing of linguistic and musical syntax , 2009, Psychonomic bulletin & review.

[28]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[29]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[30]  D. Sammler,et al.  Untangling syntactic and sensory processing: an ERP study of music perception. , 2007, Psychophysiology.

[31]  C. Krumhansl The Cognition of Tonality – as We Know it Today , 2004 .

[32]  R J Ilmoniemi,et al.  Estimates of neuronal current distributions. , 1991, Acta oto-laryngologica. Supplementum.

[33]  A. Friederici,et al.  Electrophysiological Evidence for Two Steps in Syntactic Analysis: Early Automatic and Late Controlled Processes , 1999, Journal of Cognitive Neuroscience.

[34]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[35]  Michael J. Martinez,et al.  Music and language side by side in the brain: a PET study of the generation of melodies and sentences , 2006, The European journal of neuroscience.

[36]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[37]  F. Pulvermüller,et al.  Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes , 2006, Progress in Neurobiology.

[38]  Stefan Koelsch,et al.  Musical training modulates the development of syntax processing in children , 2009, NeuroImage.

[39]  S. Koelsch Music-syntactic processing and auditory memory: similarities and differences between ERAN and MMN. , 2009, Psychophysiology.

[40]  Vinod Menon,et al.  Musical structure is processed in “language” areas of the brain: a possible role for Brodmann Area 47 in temporal coherence , 2003, NeuroImage.

[41]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[42]  C. Fiebach,et al.  Processing lexical semantic and syntactic information in first and second language: fMRI evidence from German and Russian , 2005, Human brain mapping.

[43]  Robert J. Zatorre,et al.  A role for the right superior temporal sulcus in categorical perception of musical chords , 2011, Neuropsychologia.

[44]  Angela D. Friederici,et al.  It's Early: Event-related Potential Evidence for Initial Interaction of Syntax and Prosody in Speech Comprehension , 2006, Journal of Cognitive Neuroscience.

[45]  Aniruddh D. Patel,et al.  Structural integration in language and music: Evidence for a shared system , 2009, Memory & cognition.

[46]  Aniruddh D. Patel,et al.  Musical syntactic processing in agrammatic Broca's aphasia , 2008 .

[47]  David Poeppel,et al.  Functional Anatomic Models of Language: Assembling the Pieces , 2008, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[48]  Jonas Obleser,et al.  Disentangling syntax and intelligibility in auditory language comprehension , 2009, Human brain mapping.

[49]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[50]  P. Janata,et al.  Activation of the inferior frontal cortex in musical priming. , 2003, Annals of the New York Academy of Sciences.

[51]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[52]  K. Müller,et al.  Functional architecture of verbal and tonal working memory: An FMRI study , 2009, Human brain mapping.

[53]  E. Brattico,et al.  Distinct neural responses to chord violations: A multiple source analysis study , 2011, Brain Research.

[54]  S. Dehaene,et al.  Direct Intracranial, fMRI, and Lesion Evidence for the Causal Role of Left Inferotemporal Cortex in Reading , 2006, Neuron.

[55]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[56]  Alan C. Evans,et al.  Neural mechanisms underlying melodic perception and memory for pitch , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  A. Friederici,et al.  Lateralization of auditory language functions: A dynamic dual pathway model , 2004, Brain and Language.

[58]  H. Rabagliati,et al.  Sensitivity to syntax in visual cortex , 2009, Cognition.

[59]  S. Bookheimer,et al.  Dissociating Neural Mechanisms of Temporal Sequencing and Processing Phonemes , 2003, Neuron.

[60]  Arthur W. Toga,et al.  A Probabilistic Atlas of the Human Brain: Theory and Rationale for Its Development The International Consortium for Brain Mapping (ICBM) , 1995, NeuroImage.

[61]  R. Zatorre,et al.  A role for the intraparietal sulcus in transforming musical pitch information. , 2010, Cerebral cortex.

[62]  Eric Halgren,et al.  Sequential Processing of Lexical, Grammatical, and Phonological Information Within Broca’s Area , 2009, Science.

[63]  Gregory Hickok,et al.  Functional Anatomy of Language and Music Perception: Temporal and Structural Factors Investigated Using Functional Magnetic Resonance Imaging , 2011, The Journal of Neuroscience.

[64]  Anna S. Hasting,et al.  Syntax as a reflex: Neurophysiological evidence for early automaticity of grammatical processing , 2008, Brain and Language.

[65]  Daniela Sammler,et al.  The neuroanatomical overlap of syntax processing in music and language : Evidence from lesion and intracranial ERP studies , 2009 .

[66]  Manuela M Marin Effects of Early Musical Training on Musical and Linguistic Syntactic Abilities , 2009, Annals of the New York Academy of Sciences.

[67]  Angela D. Friederici,et al.  Magnetic Field Tomography Analysis of Continuous Speech , 2004, Brain Topography.

[68]  A. Friederici,et al.  Violation of syntax and prosody—Disentangling their contributions to the early left anterior negativity (ELAN) , 2011, Neuroscience Letters.

[69]  Angela D. Friederici,et al.  Syntactic and auditory spatial processing in the human temporal cortex: An MEG study , 2011, NeuroImage.

[70]  M. Fuchs,et al.  Development of Volume Conductor and Source Models to Localize Epileptic Foci , 2007, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[71]  Stefan Koelsch,et al.  Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns. , 2008, Cerebral cortex.

[72]  D. Kovalev,et al.  Rapid and fully automated visualization of subdural electrodes in the presurgical evaluation of epilepsy patients. , 2005, AJNR. American journal of neuroradiology.

[73]  R. Ilmoniemi,et al.  Functional Specialization of the Human Auditory Cortex in Processing Phonetic and Musical Sounds: A Magnetoencephalographic (MEG) Study , 1999, NeuroImage.

[74]  Martin Rohrmeier,et al.  Towards a generative syntax of tonal harmony , 2011 .

[75]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[76]  A. Friederici,et al.  Investigating the Relationship of Music and Language in Children , 2005, Annals of the New York Academy of Sciences.

[77]  Bernard Mazoyer,et al.  What is right-hemisphere contribution to phonological, lexico-semantic, and sentence processing? Insights from a meta-analysis , 2011, NeuroImage.

[78]  Daniel J. Acheson,et al.  Increased Alpha-Band Power during the Retention of Shapes and Shape-Location Associations in Visual Short-Term Memory , 2011, Front. Psychology.

[79]  Nancy Kanwisher,et al.  Syntactic processing in the human brain: What we know, what we don’t know, and a suggestion for how to proceed , 2011, Brain and Language.

[80]  Jean-Jacques Rousseau,et al.  Essay on the Origin of Languages and Writings Related to Music , 1998 .

[81]  M. Ullman A neurocognitive perspective on language: The declarative/procedural model , 2001, Nature Reviews Neuroscience.

[82]  Angela D. Friederici,et al.  Localization of the syntactic mismatch negativity in the temporal cortex: An MEG study , 2009, NeuroImage.

[83]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[84]  P. Pye-Smith The Descent of Man, and Selection in Relation to Sex , 1871, Nature.

[85]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[86]  Stefan Koelsch,et al.  Bach Speaks: A Cortical “Language-Network” Serves the Processing of Music , 2002, NeuroImage.

[87]  Stefan Koelsch,et al.  Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex , 2006, NeuroImage.

[88]  C. Büchel,et al.  Broca's area and the language instinct , 2003, Nature Neuroscience.

[89]  T. Bullock,et al.  EEG coherence has structure in the millimeter domain: subdural and hippocampal recordings from epileptic patients. , 1995, Electroencephalography and clinical neurophysiology.

[90]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[91]  Peter Hagoort,et al.  Retrieval and unification of syntactic structure in sentence comprehension: an FMRI study using word-category ambiguity. , 2009, Cerebral cortex.

[92]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[93]  Nathan E. Crone,et al.  Subdural electrodes , 2010, Clinical Neurophysiology.

[94]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[95]  W. Freeman,et al.  Spatio-temporal correlations in human gamma band electrocorticograms. , 1996, Electroencephalography and clinical neurophysiology.

[96]  Vincent J. Schmithorst,et al.  Separate cortical networks involved in music perception: preliminary functional MRI evidence for modularity of music processing , 2005, NeuroImage.

[97]  D Y von Cramon,et al.  Language related brain potentials in patients with cortical and subcortical left hemisphere lesions. , 1999, Brain : a journal of neurology.

[98]  Thomas R. Knösche,et al.  ASA-Advanced Source Analysis of Continuous and Event-Related EEG/MEG Signals , 2003, Brain Topography.

[99]  S. Scott,et al.  Converging Language Streams in the Human Temporal Lobe , 2006, The Journal of Neuroscience.

[100]  William D. Marslen-Wilson,et al.  Left inferior frontal cortex and syntax: function, structure and behaviour in patients with left hemisphere damage , 2011, Brain : a journal of neurology.

[101]  Stefan Koelsch,et al.  Adults and children processing music: An fMRI study , 2005, NeuroImage.

[102]  J. Bharucha,et al.  Priming of chords: Spreading activation or overlapping frequency spectra? , 1987, Perception & psychophysics.

[103]  Stefan Koelsch,et al.  Neuroarchitecture of verbal and tonal working memory in nonmusicians and musicians , 2011, Human brain mapping.

[104]  Ludovico Minati,et al.  FMRI/ERP of musical syntax: comparison of melodies and unstructured note sequences , 2008, Neuroreport.

[105]  G A Ojemann,et al.  Individual variability in cortical localization of language. , 1979, Journal of neurosurgery.

[106]  Julie A Fiez,et al.  Functional dissociations within the inferior parietal cortex in verbal working memory , 2004, NeuroImage.

[107]  Stefan Koelsch,et al.  Interaction between Syntax Processing in Language and in Music: An ERP Study , 2005, Journal of Cognitive Neuroscience.

[108]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[109]  F. Pulvermüller A brain perspective on language mechanisms: from discrete neuronal ensembles to serial order , 2002, Progress in Neurobiology.

[110]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[111]  Peter Hagoort,et al.  Reflections on the neurobiology of syntax , 2009 .

[112]  Karsten Steinhauer,et al.  On the early left-anterior negativity (ELAN) in syntax studies , 2012, Brain and Language.

[113]  L. Craighero,et al.  Broca's Area in Language, Action, and Music , 2009, Annals of the New York Academy of Sciences.

[114]  Bin He,et al.  Three-dimensional brain current source reconstruction from intra-cranial ECoG recordings , 2008, NeuroImage.

[115]  Andreas Schulze-Bonhage,et al.  Signal quality of simultaneously recorded invasive and non-invasive EEG , 2009, NeuroImage.

[116]  V. Menon,et al.  Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. , 2011, Cerebral cortex.

[117]  Simon Kirby,et al.  Biological Foundations and Origin of Syntax , 2009 .

[118]  A. Friederici,et al.  Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. , 1993, Brain research. Cognitive brain research.

[119]  Ellen F. Lau,et al.  The role of structural prediction in rapid syntactic analysis , 2006, Brain and Language.

[120]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[121]  Stefan Koelsch,et al.  Effects of Selective Attention on Syntax Processing in Music and Language , 2011, Journal of Cognitive Neuroscience.

[122]  A. Friederici,et al.  Neapolitan chords activate the area of Broca. A magnetoencephalographic study. , 2001, Annals of the New York Academy of Sciences.

[123]  Stanislas Dehaene,et al.  Distinct unimodal and multimodal regions for word processing in the left temporal cortex , 2004, NeuroImage.

[124]  William Bond,et al.  Interaction Between Syntaxin 8 and HECTd3, a HECT Domain Ligase , 2009, Cellular and Molecular Neurobiology.

[125]  Stefan Koelsch,et al.  Brain and Music , 2012 .

[126]  Rainer Goebel,et al.  Measuring structural–functional correspondence: Spatial variability of specialised brain regions after macro-anatomical alignment , 2012, NeuroImage.

[127]  Y. Grodzinsky,et al.  The battle for Broca’s region , 2008, Trends in Cognitive Sciences.

[128]  C. Price The anatomy of language: a review of 100 fMRI studies published in 2009 , 2010, Annals of the New York Academy of Sciences.

[129]  C. Fiebach,et al.  Dynamic Anticipatory Processing of Hierarchical Sequential Events: a Common Role for Broca's Area and Ventral Premotor Cortex Across Domains? , 2006, Cortex.

[130]  Oleg Korzyukov,et al.  Generators of the intracranial P50 response in auditory sensory gating , 2007, NeuroImage.

[131]  Alfonso Caramazza,et al.  Agrammatic Broca's Aphasia Is Not Associated with a Single Pattern of Comprehension Performance , 2001, Brain and Language.

[132]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[133]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[134]  Seung-Goo Kim,et al.  The Effect of Conditional Probability of Chord Progression on Brain Response: An MEG Study , 2011, PloS one.

[135]  Stefan Koelsch,et al.  Children with Specific Language Impairment Also Show Impairment of Music-syntactic Processing , 2008, Journal of Cognitive Neuroscience.

[136]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[137]  Angela D. Friederici,et al.  Pathways to language: fiber tracts in the human brain , 2009, Trends in Cognitive Sciences.

[138]  Noam Chomsky,et al.  The Minimalist Program , 1992 .

[139]  E. Bigand,et al.  Perceiving musical tension in long chord sequences , 1999, Psychological research.

[140]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[141]  G. Hickok,et al.  Auditory–Motor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003 .

[142]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[143]  A. Friederici,et al.  Are left fronto-temporal brain areas a prerequisite for normal music-syntactic processing? , 2011, Cortex.

[144]  B. Feige,et al.  The Role of Higher-Order Motor Areas in Voluntary Movement as Revealed by High-Resolution EEG and fMRI , 1999, NeuroImage.

[145]  T. R. Knösche,et al.  Processing of Syntactic Information Monitored by Brain Surface Current Density Mapping Based on MEG , 2004, Brain Topography.

[146]  A. Roepstorff,et al.  Predictive coding of music – Brain responses to rhythmic incongruity , 2009, Cortex.

[147]  G. Thierry,et al.  Renewal of the neurophysiology of language: functional neuroimaging. , 2005, Physiological reviews.

[148]  M. Tettamanti,et al.  Broca's Area: a Supramodal Hierarchical Processor? , 2006, Cortex.