The auditory scene: An fMRI study on melody and accompaniment in professional pianists

The auditory scene is a mental representation of individual sounds extracted from the summed sound waveform reaching the ears of the listeners. Musical contexts represent particularly complex cases of auditory scenes. In such a scenario, melody may be seen as the main object moving on a background represented by the accompaniment. Both melody and accompaniment vary in time according to harmonic rules, forming a typical texture with melody in the most prominent, salient voice. In the present sparse acquisition functional magnetic resonance imaging study, we investigated the interplay between melody and accompaniment in trained pianists, by observing the activation responses elicited by processing: (1) melody placed in the upper and lower texture voices, leading to, respectively, a higher and lower auditory salience; (2) harmonic violations occurring in either the melody, the accompaniment, or both. The results indicated that the neural activation elicited by the processing of polyphonic compositions in expert musicians depends upon the upper versus lower position of the melodic line in the texture, and showed an overall greater activation for the harmonic processing of melody over accompaniment. Both these two predominant effects were characterized by the involvement of the posterior cingulate cortex and precuneus, among other associative brain regions. We discuss the prominent role of the posterior medial cortex in the processing of melodic and harmonic information in the auditory stream, and propose to frame this processing in relation to the cognitive construction of complex multimodal sensory imagery scenes.

[1]  S. Koelsch Towards a neural basis of processing musical semantics. , 2011, Physics of life reviews.

[2]  Marc Leman,et al.  The Cortical Topography of Tonal Structures Underlying Western Music , 2002, Science.

[3]  I Peretz,et al.  Perceiving the tonal ending of tune excerpts: the roles of pre-existing representation and musical expertise. , 1995, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[4]  Peter E. Keller,et al.  The importance of integration and top-down salience when listening to complex multi-part musical stimuli , 2013, NeuroImage.

[5]  S. Trehub,et al.  Key membership and implied harmony in Western tonal music: Developmental perspectives , 1994, Perception & psychophysics.

[6]  S. Koelsch Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[7]  Kerry M. M. Walker,et al.  Cortical encoding of pitch: Recent results and open questions , 2011, Hearing Research.

[8]  John D E Gabrieli,et al.  Assessing the influence of scanner background noise on auditory processing. I. An fMRI study comparing three experimental designs with varying degrees of scanner noise , 2007, Human brain mapping.

[9]  Vincent J. Schmithorst,et al.  Separate cortical networks involved in music perception: preliminary functional MRI evidence for modularity of music processing , 2005, NeuroImage.

[10]  Michael T. Ullman,et al.  Double dissociation between rules and memory in music: An event-related potential study , 2007, NeuroImage.

[11]  Benjamin Martin Bly,et al.  The effects of learning on event-related potential correlates of musical expectancy. , 2008, Psychophysiology.

[12]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[13]  Stefan Koelsch,et al.  Adults and children processing music: An fMRI study , 2005, NeuroImage.

[14]  Stefan Koelsch,et al.  Decrease in early right alpha band phase synchronization and late gamma band oscillations in processing syntax in music , 2009, Human brain mapping.

[15]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[16]  I. Peretz,et al.  Musical scale properties are automatically processed in the human auditory cortex , 2006, Brain Research.

[17]  Tülay Adali,et al.  Comparison of multi‐subject ICA methods for analysis of fMRI data , 2010, Human brain mapping.

[18]  Robert J Zatorre,et al.  Music and the Brain , 2003, Annals of the New York Academy of Sciences.

[19]  B Tillmann,et al.  Global context effect in normal and scrambled musical sequences. , 2001, Journal of experimental psychology. Human perception and performance.

[20]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[21]  Walter A. Siebel,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.12 December 2005 Towards , 2022 .

[22]  K Takeda,et al.  Activated brain regions in musicians during an ensemble: a PET study. , 2001, Brain research. Cognitive brain research.

[23]  Riitta Hari,et al.  Mind's Ear in a Musician: Where and When in the Brain , 2002, NeuroImage.

[24]  Erika Skoe,et al.  Selective Subcortical Enhancement of Musical Intervals in Musicians , 2009, The Journal of Neuroscience.

[25]  Daniel S. Margulies,et al.  Delineating self-referential processing from episodic memory retrieval: Common and dissociable networks , 2010, NeuroImage.

[26]  B. Tillmann Implicit Investigations of Tonal Knowledge in Nonmusician Listeners , 2005, Annals of the New York Academy of Sciences.

[27]  S. Trehub Musical Predispositions in Infancy , 2001, Annals of the New York Academy of Sciences.

[28]  Hans-Jochen Heinze,et al.  Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction , 2006, NeuroImage.

[29]  Jens Haueisen,et al.  Involuntary Motor Activity in Pianists Evoked by Music Perception , 2001, Journal of Cognitive Neuroscience.

[30]  Mikko Sams,et al.  Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm , 2012, NeuroImage.

[31]  Stefan Koelsch,et al.  Spatial selective attention in a complex auditory environment such as polyphonic music. , 2010, The Journal of the Acoustical Society of America.

[32]  R. Näätänen,et al.  The mismatch negativity (MMN): towards the optimal paradigm , 2004, Clinical Neurophysiology.

[33]  E. Maguire,et al.  The Well-Worn Route and the Path Less Traveled Distinct Neural Bases of Route Following and Wayfinding in Humans , 2003, Neuron.

[34]  Laurel J. Trainor,et al.  Automatic Encoding of Polyphonic Melodies in Musicians and Nonmusicians , 2005, Journal of Cognitive Neuroscience.

[35]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[36]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[37]  Thomas Fritz,et al.  Investigating brain response to music: A comparison of different fMRI acquisition schemes , 2011, NeuroImage.

[38]  B. Levine,et al.  The functional neuroanatomy of autobiographical memory: A meta-analysis , 2006, Neuropsychologia.

[39]  J. Thiran,et al.  Distinct Pathways Involved in Sound Recognition and Localization: A Human fMRI Study , 2000, NeuroImage.

[40]  María Herrojo Ruiz,et al.  Unsupervised statistical learning underpins computational, behavioural, and neural manifestations of musical expectation , 2010, NeuroImage.

[41]  Stefan Koelsch,et al.  Differences in Electric Brain Responses to Melodies and Chords , 2010, Journal of Cognitive Neuroscience.

[42]  Alan C. Evans,et al.  Event-Related fMRI of the Auditory Cortex , 1998, NeuroImage.

[43]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[44]  Olivier Macherey,et al.  Perception of Musical Timbre by Cochlear Implant Listeners: A Multidimensional Scaling Study , 2013, Ear and hearing.

[45]  B. Delgutte,et al.  Neurobiological Foundations for the Theory of Harmony in Western Tonal Music , 2001, Annals of the New York Academy of Sciences.

[46]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[47]  D. Wessel,et al.  Harmonic expectation and affect in Western music: Effects of attention and training , 2007, Perception & psychophysics.

[48]  E. Brattico,et al.  Distinct neural responses to chord violations: A multiple source analysis study , 2011, Brain Research.

[49]  Adriaan Moelker,et al.  Acoustic noise concerns in functional magnetic resonance imaging , 2003, Human brain mapping.

[50]  J. Bartlett,et al.  Effects of aging and musical experience on the representation of tonal hierarchies. , 1996, Psychology and aging.

[51]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[52]  D. Hassabis,et al.  Using Imagination to Understand the Neural Basis of Episodic Memory , 2007, The Journal of Neuroscience.

[53]  C Palmer,et al.  Harmonic, melodic, and frequency height influences in the perception of multivoiced music , 1994, Perception & psychophysics.

[54]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[55]  Alan C. Evans,et al.  Auditory Attention to Space and Frequency Activates Similar Cerebral Systems , 1999, NeuroImage.

[56]  Dharshan Kumaran,et al.  The Human Hippocampus: Cognitive Maps or Relational Memory? , 2005, The Journal of Neuroscience.

[57]  E. Saltzman,et al.  Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions , 2007, The Journal of Neuroscience.

[58]  M. Tervaniemi,et al.  Representation of harmony rules in the human brain: Further evidence from event-related potentials , 2007, Brain Research.

[59]  E A Maguire,et al.  Neuroimaging studies of autobiographical event memory. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[60]  Jun Hatazawa,et al.  The anterior portion of the bilateral temporal lobes participates in music perception: a positron emission tomography study. , 2003, AJNR. American journal of neuroradiology.

[61]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[62]  P. Janata,et al.  Activation of the inferior frontal cortex in musical priming. , 2003, Annals of the New York Academy of Sciences.

[63]  R. Bowtell,et al.  “sparse” temporal sampling in auditory fMRI , 1999, Human brain mapping.

[64]  Lutz Jäncke,et al.  Neural activity associated with self-reflection , 2012, BMC Neuroscience.

[65]  S. Trehub,et al.  Infants' perception of melodies: the role of melodic contour. , 1984, Child development.

[66]  Scott T. Grafton,et al.  Wandering Minds: The Default Network and Stimulus-Independent Thought , 2007, Science.

[67]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[68]  S. Koelsch Significance of Broca's Area and Ventral Premotor Cortex for Music-Syntactic Processing , 2006, Cortex.

[69]  中村 聡 Analysis of music-brain interaction with simultaneous measurement of regional cerebral blood flow and electroencephalogram beta rhythm in human subjects , 2000 .

[70]  Scott K. Holland,et al.  The effect of musical training on music processing: a functional magnetic resonance imaging study in humans , 2003, Neuroscience Letters.

[71]  M. Raichle Two views of brain function , 2010, Trends in Cognitive Sciences.

[72]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[73]  S. Koelsch Toward a Neural Basis of Music Perception – A Review and Updated Model , 2011, Front. Psychology.

[74]  D. Perani,et al.  Functional specializations for music processing in the human newborn brain , 2010, Proceedings of the National Academy of Sciences.

[75]  G. Glover,et al.  Assessing the influence of scanner background noise on auditory processing. II. An fMRI study comparing auditory processing in the absence and presence of recorded scanner noise using a sparse design , 2007, Human brain mapping.

[76]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[77]  Stefan Koelsch,et al.  Bach Speaks: A Cortical “Language-Network” Serves the Processing of Music , 2002, NeuroImage.

[78]  Stefan Koelsch,et al.  Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex , 2006, NeuroImage.

[79]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[80]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .