The relationship between the neural computations for speech and music perception is context-dependent: an activation likelihood estimate study

The relationship between the neurobiology of speech and music has been investigated for more than a century. There remains no widespread agreement regarding how (or to what extent) music perception utilizes the neural circuitry that is engaged in speech processing, particularly at the cortical level. Prominent models such as Patel's Shared Syntactic Integration Resource Hypothesis (SSIRH) and Koelsch's neurocognitive model of music perception suggest a high degree of overlap, particularly in the frontal lobe, but also perhaps more distinct representations in the temporal lobe with hemispheric asymmetries. The present meta-analysis study used activation likelihood estimate analyses to identify the brain regions consistently activated for music as compared to speech across the functional neuroimaging (fMRI and PET) literature. Eighty music and 91 speech neuroimaging studies of healthy adult control subjects were analyzed. Peak activations reported in the music and speech studies were divided into four paradigm categories: passive listening, discrimination tasks, error/anomaly detection tasks and memory-related tasks. We then compared activation likelihood estimates within each category for music vs. speech, and each music condition with passive listening. We found that listening to music and to speech preferentially activate distinct temporo-parietal bilateral cortical networks. We also found music and speech to have shared resources in the left pars opercularis but speech-specific resources in the left pars triangularis. The extent to which music recruited speech-activated frontal resources was modulated by task. While there are certainly limitations to meta-analysis techniques particularly regarding sensitivity, this work suggests that the extent of shared resources between speech and music may be task-dependent and highlights the need to consider how task effects may be affecting conclusions regarding the neurobiology of speech and music.

[1]  M. Lamb,et al.  The Two Sides of Perception , 1998, Trends in Cognitive Sciences.

[2]  Barbara Tillmann,et al.  The Influence of Task-Irrelevant Music on Language Processing: Syntactic and Semantic Structures , 2011, Front. Psychology.

[3]  A. Friederici,et al.  Music, language and meaning: brain signatures of semantic processing , 2004, Nature Neuroscience.

[4]  Patrick Chauvel,et al.  From Perception to Recognition Memory: Time Course and Lateralization of Neural Substrates of Word and Abstract Picture Processing , 2011, Journal of Cognitive Neuroscience.

[5]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[6]  Aleksandr R. Luria,et al.  Aphasia in a composer , 1965 .

[7]  A. Anwander,et al.  Connectivity-Based Parcellation of Broca's Area. , 2006, Cerebral cortex.

[8]  Gregory Hickok,et al.  The Role of Broca's Area in Sentence Comprehension , 2011, Journal of Cognitive Neuroscience.

[9]  Simon B Eickhoff,et al.  Minimizing within‐experiment and within‐group effects in activation likelihood estimation meta‐analyses , 2012, Human brain mapping.

[10]  Aniruddh D. Patel Why would Musical Training Benefit the Neural Encoding of Speech? The OPERA Hypothesis , 2011, Front. Psychology.

[11]  E. Schellenberg,et al.  Children's implicit knowledge of harmony in Western music. , 2005, Developmental science.

[12]  Barbara Tillmann,et al.  Music and Language Perception: Expectations, Structural Integration, and Cognitive Sequencing , 2012, Top. Cogn. Sci..

[13]  A. Friederici,et al.  Are left fronto-temporal brain areas a prerequisite for normal music-syntactic processing? , 2011, Cortex.

[14]  Kevin G. Munhall,et al.  Functional Overlap between Regions Involved in Speech Perception and in Monitoring One's Own Voice during Speech Production , 2010, Journal of Cognitive Neuroscience.

[15]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[16]  Nancy Kanwisher,et al.  Some Regions within Broca's Area Do Respond More Strongly to Sentences than to Linguistically Degraded Stimuli: A Comment on Rogalsky and Hickok (2011) , 2011, Journal of Cognitive Neuroscience.

[17]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[18]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[19]  A Yamadori,et al.  Preservation of singing in Broca's aphasia. , 1977, Journal of neurology, neurosurgery, and psychiatry.

[20]  M. Schönwiesner,et al.  Heschl's gyrus, posterior superior temporal gyrus, and mid-ventrolateral prefrontal cortex have different roles in the detection of acoustic changes. , 2007, Journal of neurophysiology.

[21]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[22]  I. Peretz,et al.  Evidence for the role of the right auditory cortex in fine pitch resolution , 2008, Neuropsychologia.

[23]  I. Peretz,et al.  Musical scale properties are automatically processed in the human auditory cortex , 2006, Brain Research.

[24]  Gregory Hickok,et al.  Selective attention to semantic and syntactic features modulates sentence processing networks in anterior temporal cortex. , 2009, Cerebral cortex.

[25]  J. Trueswell,et al.  Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension , 2005, Cognitive, affective & behavioral neuroscience.

[26]  Jessica A. Grahn,et al.  Advances in neuroimaging techniques: implications for the shared syntactic integration resource hypothesis , 2011 .

[27]  H. Kowarzyk Structure and Function. , 1910, Nature.

[28]  I. Peretz The nature of music from a biological perspective , 2006, Cognition.

[29]  Tim Shallice,et al.  Functional imaging and neuropsychology findings: how can they be linked? , 2003, NeuroImage.

[30]  S. Scott,et al.  Converging Language Streams in the Human Temporal Lobe , 2006, The Journal of Neuroscience.

[31]  L. Slevc,et al.  Processing structure in language and music: a case for shared reliance on cognitive control , 2015, Psychonomic bulletin & review.

[32]  A. Kleinschmidt,et al.  Modulation of neural responses to speech by directing attention to voices or verbal content. , 2003, Brain research. Cognitive brain research.

[33]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[34]  Pierre Perruchet,et al.  Challenging prior evidence for a shared syntactic processor for language and music , 2013, Psychonomic bulletin & review.

[35]  J. Sergent About face: left-hemisphere involvement in processing physiognomies. , 1982, Journal of experimental psychology. Human perception and performance.

[36]  Lutz Jäncke,et al.  Neurofunctional and behavioral correlates of phonetic and temporal categorization in musically trained and untrained subjects. , 2012, Cerebral cortex.

[37]  K. Zilles,et al.  Coordinate‐based activation likelihood estimation meta‐analysis of neuroimaging data: A random‐effects approach based on empirical estimates of spatial uncertainty , 2009, Human brain mapping.

[38]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[39]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[40]  S. Koelsch Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[41]  K. Alho,et al.  Lateralized automatic auditory processing of phonetic versus musical information: A PET study , 2000, Human brain mapping.

[42]  E. Capitani,et al.  Spared musical abilities in a conductor with global aphasia and ideomotor apraxia. , 1985, Journal of neurology, neurosurgery, and psychiatry.

[43]  Marcus T. Pearce,et al.  Melodic pitch expectation interacts with neural responses to syntactic but not semantic violations , 2013, Cortex.

[44]  Walter A. Siebel,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.12 December 2005 Towards , 2022 .

[45]  V. Menon,et al.  Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. , 2011, Cerebral cortex.

[46]  André Brechmann,et al.  The cognitive auditory cortex: Task-specificity of stimulus representations , 2007, Hearing Research.

[47]  Laurie A. Dinnebeil Top-Down and Bottom-Up , 2014 .

[48]  C. Rorden,et al.  Stereotaxic display of brain lesions. , 2000, Behavioural neurology.

[49]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[50]  M. Besson,et al.  AN EVENT-RELATED POTENTIAL (ERP) STUDY OF MUSICAL EXPECTANCY : COMPARISON OF MUSICIANS WITH NONMUSICIANS , 1995 .

[51]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[52]  Isabelle Peretz,et al.  Morphometry of the amusic brain: a two-site study. , 2006, Brain : a journal of neurology.

[53]  Patti Adank,et al.  Design choices in imaging speech comprehension: An Activation Likelihood Estimation (ALE) meta-analysis , 2012, NeuroImage.

[54]  M. Schwartz,et al.  The dorsal stream contribution to phonological retrieval in object naming. , 2012, Brain : a journal of neurology.

[55]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[56]  G. Hickok,et al.  Auditory–Motor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003 .

[57]  John C. Trueswell,et al.  Co-localization of Stroop and Syntactic Ambiguity Resolution in Broca's Area: Implications for the Neural Basis of Sentence Processing , 2009, Journal of Cognitive Neuroscience.

[58]  Sylvie Belleville,et al.  Dissociations Entre Musique et Langage Apres Atteinte Cerebrale: Un Nouveau Cas D'amusie Sans Aphasie , 1997 .

[59]  Angela R. Laird,et al.  Activation likelihood estimation meta-analysis revisited , 2012, NeuroImage.

[60]  H. Scheich,et al.  Phonetic Perception and the Temporal Cortex , 2002, NeuroImage.

[61]  I. Peretz,et al.  Varieties of Musical Disorders , 2003, Annals of the New York Academy of Sciences.

[62]  D Schön,et al.  Comparison between Language and Music , 2001, Annals of the New York Academy of Sciences.

[63]  Lisa D. Sanders,et al.  Local and global auditory processing: Behavioral and ERP evidence , 2007, Neuropsychologia.

[64]  Aniruddh D. Patel Language, music, and the brain: a resource-sharing framework , 2011 .

[65]  Christian Schwarzbauer,et al.  Evaluating an acoustically quiet EPI sequence for use in fMRI studies of speech and auditory processing , 2010, NeuroImage.

[66]  Stefanie E. Kuchinsky,et al.  The Cingulo-Opercular Network Provides Word-Recognition Benefit , 2013, The Journal of Neuroscience.

[67]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[68]  Colin M. Macleod Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[69]  Mari Tervaniemi,et al.  Musical Sound Processing in the Human Brain , 2001 .

[70]  Gregory Hickok,et al.  What Does Broca's Area Activation to Sentences Reflect? , 2011, Journal of Cognitive Neuroscience.

[71]  I. Peretz,et al.  What is specific to music processing? Insights from congenital amusia , 2003, Trends in Cognitive Sciences.

[72]  J. Winn,et al.  Brain , 1878, The Lancet.

[73]  Cynthia R Hunter Is the time course of lexical activation and competition in spoken word recognition affected by adult aging? An event-related potential (ERP) study , 2016, Neuropsychologia.

[74]  Aniruddh D. Patel,et al.  Making psycholinguistics musical: Self-paced reading time evidence for shared processing of linguistic and musical syntax , 2009, Psychonomic bulletin & review.

[75]  Jonas Obleser,et al.  Disentangling syntax and intelligibility in auditory language comprehension , 2009, Human brain mapping.

[76]  M. Tervaniemi,et al.  Musical sound processing in the human brain. Evidence from electric and magnetic recordings. , 2001, Annals of the New York Academy of Sciences.

[77]  Mathias S. Oechslin,et al.  Absolute Pitch—Functional Evidence of Speech-Relevant Auditory Acuity , 2009, Cerebral cortex.

[78]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[79]  M. Tervaniemi,et al.  Lateralization of auditory-cortex functions , 2003, Brain Research Reviews.

[80]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[81]  R. Adolphs,et al.  Neural systems behind word and concept retrieval , 2004, Cognition.

[82]  D. Shankweiler,et al.  An Event-related Neuroimaging Study Distinguishing Form and Content in Sentence Processing , 2000, Journal of Cognitive Neuroscience.

[83]  S. Henschen ON THE FUNCTION OF THE RIGHT HEMISPHERE OF THE BRAIN IN RELATION TO THE LEFT IN SPEECH, MUSIC AND CALCULATION , 1926 .

[84]  I. Peretz,et al.  [Dissociations between music and language functions after cerebral resection: A new case of amusia without aphasia]. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[85]  F. Lhermitte,et al.  LE DEFICIT MUSICAL DES APHASIQUES , 1973 .

[86]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[87]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[88]  M. Schönwiesner,et al.  Hemispheric asymmetry for spectral and temporal processing in the human antero‐lateral auditory belt cortex , 2005, The European journal of neuroscience.

[89]  N. Andreasen,et al.  Anatomic and Functional Variability: The Effects of Filter Size in Group fMRI Data Analysis , 2001, NeuroImage.

[90]  Aniruddh D. Patel,et al.  Structural integration in language and music: Evidence for a shared system , 2009, Memory & cognition.

[91]  Jiang Xu,et al.  Language in context: emergent features of word, sentence, and narrative comprehension , 2005, NeuroImage.

[92]  Isabelle Peretz,et al.  Processing Prosodic and Musical Patterns: A Neuropsychological Investigation , 1998, Brain and Language.

[93]  C. Price The anatomy of language: a review of 100 fMRI studies published in 2009 , 2010, Annals of the New York Academy of Sciences.

[94]  Stefan Koelsch,et al.  Interaction between Syntax Processing in Language and in Music: An ERP Study , 2005, Journal of Cognitive Neuroscience.

[95]  L. Jäncke Music, memory and emotion , 2008, Journal of biology.

[96]  L. Cuddy,et al.  Dissociation of musical tonality and pitch memory from nonmusical cognitive abilities. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[97]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[98]  F. Boller,et al.  Absence of Amusia and Preserved Naming of Musical Instruments in an Aphasic Composer , 2000, Cortex.

[99]  N. Shah,et al.  Top-down and bottom-up modulation of language related areas – An fMRI Study , 2003, BMC Neuroscience.

[100]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. , 1996, Journal of neurophysiology.

[101]  L. Slevc,et al.  Language and music: sound, structure, and meaning. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[102]  G. Hickok,et al.  AuditoryMotor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003, Journal of Cognitive Neuroscience.

[103]  Cara L. Wong,et al.  The function of the anterior temporal lobe: A review of the empirical evidence , 2012, Brain Research.

[104]  M S Gazzaniga,et al.  Right hemisphere language following brain bisection. A 20-year perspective. , 1983, American Psychologist.

[105]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[106]  C Hublet,et al.  Functional dissociations following bilateral lesions of auditory cortex. , 1994, Brain : a journal of neurology.

[107]  R. Ilmoniemi,et al.  Functional Specialization of the Human Auditory Cortex in Processing Phonetic and Musical Sounds: A Magnetoencephalographic (MEG) Study , 1999, NeuroImage.

[108]  Robert J Zatorre,et al.  Neural specializations for speech and pitch: moving beyond the dichotomies , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[109]  H. Coslett,et al.  Localization of sublexical speech perception components , 2010, Brain and Language.

[110]  Tracy Love,et al.  Speech repetition as a window on the neurobiology of auditory–motor integration for speech: A voxel-based lesion symptom mapping study , 2015, Neuropsychologia.

[111]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[112]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[113]  A. Schleicher,et al.  Broca's region revisited: Cytoarchitecture and intersubject variability , 1999, The Journal of comparative neurology.

[114]  K. Emmorey The Role of Broca’s Area in Sign Language , 2006 .

[115]  Leonid Perlovsky,et al.  Cognitive interference can be mitigated by consonant music and facilitated by dissonant music , 2013, Scientific Reports.

[116]  Lutz Jäncke,et al.  The Neural Correlate of Speech Rhythm as Evidenced by Metrical Speech Processing , 2008, Journal of Cognitive Neuroscience.

[117]  Stefan Koelsch,et al.  Toward the Neural Basis of Processing Structure in Music , 2003, Annals of the New York Academy of Sciences.

[118]  Bruce L. Miller,et al.  What Role Does the Anterior Temporal Lobe Play in Sentence-level Processing? Neural Correlates of Syntactic Processing in Semantic Variant Primary Progressive Aphasia , 2014, Journal of Cognitive Neuroscience.

[119]  S. Koelsch Toward a Neural Basis of Music Perception – A Review and Updated Model , 2011, Front. Psychology.

[120]  K. Müller,et al.  Functional architecture of verbal and tonal working memory: An FMRI study , 2009, Human brain mapping.

[121]  Stefan Koelsch,et al.  Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns. , 2008, Cerebral cortex.

[122]  I. Peretz,et al.  Brain organization for music processing. , 2005, Annual review of psychology.

[123]  K. Berman,et al.  Human Dorsal and Ventral Auditory Streams Subserve Rehearsal-Based and Echoic Processes during Verbal Working Memory , 2005, Neuron.

[124]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[125]  Harold Goodglass,et al.  Interaction between phonological and semantic factors in auditory comprehension , 1981, Neuropsychologia.

[126]  D. Swinney,et al.  Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing , 2005, Human brain mapping.

[127]  Aniruddh D. Patel The Relationship of Music to the Melody of Speech and to Syntactic Processing Disorders in Aphasia , 2005, Annals of the New York Academy of Sciences.

[128]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[129]  Gregory Hickok,et al.  Sentence processing selectivity in Broca's area: evident for structure but not syntactic movement , 2015, Language, cognition and neuroscience.

[130]  I. Peretz,et al.  Harmonic priming in an amusic patient: The power of implicit tasks , 2007, Cognitive neuropsychology.

[131]  Aniruddh D. Patel Sharing and Nonsharing of Brain Resources for Language and Music , 2013 .

[132]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[133]  M. Besson,et al.  Transfer of Training between Music and Speech: Common Processing, Attention, and Memory , 2011, Front. Psychology.

[134]  M. Bozkurt,et al.  Functional anatomy. , 1980, Equine veterinary journal.

[135]  Stefan Koelsch,et al.  Comparing the Processing of Music and Language Meaning Using EEG and fMRI Provides Evidence for Similar and Distinct Neural Representations , 2008, PloS one.

[136]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. , 1996, Journal of neurophysiology.

[137]  Nancy Kanwisher,et al.  Functional specificity for high-level linguistic processing in the human brain , 2011, Proceedings of the National Academy of Sciences.

[138]  Kayoko Okada,et al.  Conduction aphasia, sensory-motor integration, and phonological short-term memory – An aggregate analysis of lesion and fMRI data , 2011, Brain and Language.

[139]  Gregory Hickok,et al.  Functional Anatomy of Language and Music Perception: Temporal and Structural Factors Investigated Using Functional Magnetic Resonance Imaging , 2011, The Journal of Neuroscience.