Neural Correlates of Music Listening and Recall in the Human Brain

Previous neuroimaging studies have identified various brain regions that are activated by music listening or recall. However, little is known about how these brain regions represent the time course and temporal features of music during listening and recall. Here we analyzed neural activity in different brain regions associated with music listening and recall using electrocorticography recordings obtained from 10 epilepsy patients of both genders implanted with subdural electrodes. Electrocorticography signals were recorded while subjects were listening to familiar instrumental music or recalling the same music pieces by imagery. During the onset phase (0–500 ms), music listening initiated cortical activity in high-gamma band in the temporal lobe and supramarginal gyrus, followed by the precentral gyrus and the inferior frontal gyrus. In contrast, during music recall, the high-gamma band activity first appeared in the inferior frontal gyrus and precentral gyrus, and then spread to the temporal lobe, showing a reversed temporal sequential order. During the sustained phase (after 500 ms), delta band and high-gamma band responses in the supramarginal gyrus, temporal and frontal lobes dynamically tracked the intensity envelope of the music during listening or recall with distinct temporal delays. During music listening, the neural tracking by the frontal lobe lagged behind that of the temporal lobe; whereas during music recall, the neural tracking by the frontal lobe preceded that of the temporal lobe. These findings demonstrate bottom-up and top-down processes in the cerebral cortex during music listening and recall and provide important insights into music processing by the human brain. SIGNIFICANCE STATEMENT Understanding how the brain analyzes, stores, and retrieves music remains one of the most challenging problems in neuroscience. By analyzing direct neural recordings obtained from the human brain, we observed dispersed and overlapping brain regions associated with music listening and recall. Music listening initiated cortical activity in high-gamma band starting from the temporal lobe and ending at the inferior frontal gyrus. A reversed temporal flow was observed in high-gamma response during music recall. Neural responses of frontal and temporal lobes dynamically tracked the intensity envelope of music that was presented or imagined during listening or recall. These findings demonstrate bottom-up and top-down processes in the cerebral cortex during music listening and recall.

[1]  Matthew K. Leonard,et al.  Neural Encoding of Auditory Features during Music Perception and Imagery , 2018, Cerebral cortex.

[2]  B. Ross,et al.  Beta-Band Oscillations Represent Auditory Beat and Its Metrical Hierarchy in Perception and Imagery , 2015, The Journal of Neuroscience.

[3]  D. Poeppel,et al.  Cortical entrainment to music and its modulation by expertise , 2015, Proceedings of the National Academy of Sciences.

[4]  Bob McMurray,et al.  Functional organization of human auditory cortex: Investigation of response latencies through direct recordings , 2014, NeuroImage.

[5]  G. Curio,et al.  ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song , 2014, Front. Hum. Neurosci..

[6]  Matthew K. Leonard,et al.  Dynamic speech representations in the human temporal lobe , 2014, Trends in Cognitive Sciences.

[7]  Brian N. Pasley,et al.  Decoding spectrotemporal features of overt and covert speech from the human cortex , 2014, Front. Neuroeng..

[8]  R. Rodríguez-Romero,et al.  Brain lateralization and neural plasticity for musical and cognitive abilities in an epileptic musician , 2013, Front. Hum. Neurosci..

[9]  Jason Farquhar,et al.  Shared processing of perception and imagery of music in decomposed EEG , 2013, NeuroImage.

[10]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[11]  C. Stevens,et al.  Mental Imagery for Musical Changes in Loudness , 2012, Front. Psychology.

[12]  David Poeppel,et al.  Mental imagery of speech: linking motor and perceptual systems through internal simulation and estimation , 2012, Front. Hum. Neurosci..

[13]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[14]  Gerwin Schalk,et al.  Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening , 2012, NeuroImage.

[15]  Robert J. Zatorre,et al.  Neuronal Correlates of Perception, Imagery, and Memory for Familiar Tunes , 2012, Journal of Cognitive Neuroscience.

[16]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[17]  C. Price,et al.  A Generative Model of Speech Production in Broca’s and Wernicke’s Areas , 2011, Front. Psychology.

[18]  Jason Farquhar,et al.  Name that tune: Decoding music from the listening brain , 2011, NeuroImage.

[19]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[20]  Robert T. Knight,et al.  Spatiotemporal imaging of cortical activation during verb generation and picture naming , 2010, NeuroImage.

[21]  Timothy L Hubbard,et al.  Auditory imagery: empirical findings. , 2010, Psychological bulletin.

[22]  J. Rauschecker,et al.  Brain Activation during Anticipation of Sound Sequences , 2009, The Journal of Neuroscience.

[23]  Christo Pantev,et al.  Neural basis of music imagery and the effect of musical expertise , 2008, The European journal of neuroscience.

[24]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[25]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[26]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[27]  Luigi Cattaneo,et al.  Covert Speech Arrest Induced by rTMS over Both Motor and Nonmotor Left Hemisphere Frontal Sites , 2005, Journal of Cognitive Neuroscience.

[28]  S. Kosslyn Mental images and the Brain , 2005, Cognitive neuropsychology.

[29]  David J. M. Kraemer,et al.  Musical imagery: Sound of silence activates auditory cortex , 2005, Nature.

[30]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[31]  M. Tervaniemi,et al.  Lateralization of auditory-cortex functions , 2003, Brain Research Reviews.

[32]  Alan R Palmer,et al.  Amplitude and frequency-modulated stimuli activate common regions of human auditory cortex. , 2003, Cerebral cortex.

[33]  Scott T. Grafton,et al.  Swinging in the brain: shared neural substrates for behaviors related to sequencing and music , 2003, Nature Neuroscience.

[34]  A. Henik,et al.  Auditory imagery from musical notation in expert musicians , 2003, Perception & psychophysics.

[35]  P. Janata,et al.  Activation of the inferior frontal cortex in musical priming. , 2003, Annals of the New York Academy of Sciences.

[36]  Stefan Koelsch,et al.  Bach Speaks: A Cortical “Language-Network” Serves the Processing of Music , 2002, NeuroImage.

[37]  Riitta Hari,et al.  Mind's Ear in a Musician: Where and When in the Brain , 2002, NeuroImage.

[38]  I. Johnsrude,et al.  Spectral and temporal processing in human auditory cortex. , 2002, Cerebral cortex.

[39]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[40]  Seung-Schik Yoo,et al.  Human brain mapping of auditory imagery: event-related functional MRI study , 2001, Neuroreport.

[41]  R. Zatorre,et al.  Spectral and temporal processing in human auditory cortex. , 2001, Cerebral cortex.

[42]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[43]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[44]  Randy L. Buckner,et al.  An Event-Related fMRI Study of Overt and Covert Word Stem Completion , 2001, NeuroImage.

[45]  S. Petersen,et al.  Comparison of Brain Activation during Word Retrieval Done Silently and Aloud Using fMRI , 2000, Brain and Cognition.

[46]  I. Johnsrude,et al.  A common neural substrate for the analysis of pitch and duration pattern in segmented sound? , 1999, Neuroreport.

[47]  Alan C. Evans,et al.  Localization of cerebral activity during simple singing. , 1999, Neuroreport.

[48]  R. Zatorre,et al.  When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. , 1999, Cerebral cortex.

[49]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[50]  Alan C. Evans,et al.  Cerebellar Contributions to Motor Timing: A PET Study of Auditory and Visual Rhythm Reproduction , 1998, Journal of Cognitive Neuroscience.

[51]  N Cowan,et al.  Can auditory memory for tone pitch be rehearsed? , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[52]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[53]  Clement T. Yu,et al.  A Theory of Translation From Relational Queries to Hierarchical Queries , 1995, IEEE Trans. Knowl. Data Eng..

[54]  Mariko Mikumo,et al.  Motor Encoding Strategy for Pitches of Melodies , 1994 .

[55]  Alan C. Evans,et al.  Neural mechanisms underlying melodic perception and memory for pitch , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Alan C. Evans,et al.  Lateralization of phonetic and pitch discrimination in speech processing. , 1992, Science.

[57]  R. Zatorre,et al.  Role of the right temporal neocortex in retention of pitch in auditory short-term memory. , 1991, Brain : a journal of neurology.

[58]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[59]  D. Deutsch Tones and Numbers: Specificity of Interference in Immediate Memory , 1970, Science.

[60]  Sebastian Stober,et al.  Towards Music Imagery Information Retrieval: Introducing the OpenMIIR Dataset of EEG Recordings from Music Perception and Imagination , 2015, ISMIR.

[61]  Werner Lutzenberger,et al.  Cortical Oscillatory Activity and the Dynamics of Auditory Memory Processing , 2005, Reviews in the neurosciences.

[62]  Petr Janata,et al.  Brain Electrical Activity Evoked by Mental Formation of Auditory Expectations and Images , 2004, Brain Topography.

[63]  C. Palmer,et al.  Auditory feedback and memory for music performance: Sound evidence for an encoding effect , 2003, Memory & cognition.

[64]  R. Zatorre,et al.  Functional specificity in the right human auditory cortex for perceiving pitch direction. , 2000, Brain : a journal of neurology.

[65]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[66]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[67]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.