Automatic Encoding of Polyphonic Melodies in Musicians and Nonmusicians

In music, multiple musical objects often overlap in time. Western polyphonic music contains multiple simultaneous melodic lines (referred to as voices) of equal importance. Previous electrophysiological studies have shown that pitch changes in a single melody are automatically encoded in memory traces, as indexed by mismatch negativity (MMN) and its magnetic counterpart (MMNm), and that this encoding process is enhanced by musical experience. In the present study, we examined whether two simultaneous melodies in polyphonic music are represented as separate entities in the auditory memory trace. Musicians and untrained controls were tested in both magnetoencephalogram and behavioral sessions. Polyphonic stimuli were created by combining two melodies (A and B), each consisting of the same five notes but in a different order. Melody A was in the high voice and Melody B in the low voice in one condition, and this was reversed in the other condition. On 50 of trials, a deviant final (5th) note was played either in the high or in the low voice, and it either went outside the key of the melody or remained within the key. These four deviations occurred with equal probability of 12.5 each. Clear MMNm was obtained for most changes in both groups, despite the 50 deviance level, with a larger amplitude in musicians than in controls. The response pattern was consistent across groups, with larger MMNm for deviants in the high voice than in the low voice, and larger MMNm for in-key than out-of-key changes, despite better behavioral performance for out-of-key changes. The results suggest that melodic information in each voice in polyphonic music is encoded in the sensory memory trace, that the higher voice is more salient than the lower, and that tonality may be processed primarily at cognitive stages subsequent to MMN generation.

[1]  Jeff Miller,et al.  Storage of feature conjunctions in transient auditory memory. , 1997, Psychophysiology.

[2]  C Alain,et al.  Event-related brain activity associated with auditory pattern processing. , 1998, Neuroreport.

[3]  R. Ilmoniemi,et al.  Responses of the primary auditory cortex to pitch changes in a sequence of tone pips: Neuromagnetic recordings in man , 1984, Neuroscience Letters.

[4]  I. Winkler,et al.  Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). , 2001, Psychophysiology.

[5]  I. Nelken,et al.  Processing of low-probability sounds by cortical neurons , 2003, Nature Neuroscience.

[6]  Judy Edworthy,et al.  Attending To Two Melodies At Once: the of Key Relatedness , 1981 .

[7]  R. Näätänen,et al.  Cortical activity elicited by changes in auditory stimuli: different sources for the magnetic N100m and mismatch responses. , 1991, Psychophysiology.

[8]  Daniel Brandeis,et al.  Human central auditory plasticity associated with tone sequence learning. , 2004, Learning & memory.

[9]  Petr Janata,et al.  ERP Measures Assay the Degree of Expectancy Violation of Harmonic Contexts in Music , 1995, Journal of Cognitive Neuroscience.

[10]  D Deacon,et al.  Automatic change detection: does the auditory system use representations of individual stimulus features or gestalts? , 1998, Psychophysiology.

[11]  S. Trehub,et al.  Key membership and implied harmony in Western tonal music: Developmental perspectives , 1994, Perception & psychophysics.

[12]  W. Teder-Sälejärvi,et al.  Preattentive evaluation of multiple perceptual streams in human audition , 2003, Neuroreport.

[13]  T. Bever,et al.  Cerebral Dominance in Musicians and Nonmusicians , 1974, Science.

[14]  Peter R. Johnson Dichotically-Stimulated Ear Differences in Musicians and Nonmusicians , 1977, Cortex.

[15]  C. Krumhansl,et al.  Music psychology:tonal structures in perception and memory. , 1991, Annual review of psychology.

[16]  Erich Schröger,et al.  Human pre-attentive auditory change-detection with single, double, and triple deviations as revealed by mismatch negativity additivity , 2001, Neuroscience Letters.

[17]  Risto Näätänen,et al.  The additivity of the auditory feature analysis in the human brain as indexed by the mismatch negativity: 1+1≈2 but 1+1+1<3 , 2001, Neuroscience Letters.

[18]  W. Ritter,et al.  Feature conjunctions and auditory sensory memory , 1998, Brain Research.

[19]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[20]  K Takeda,et al.  Activated brain regions in musicians during an ensemble: a PET study. , 2001, Brain research. Cognitive brain research.

[21]  P. Janata,et al.  Listening to polyphonic music recruits domain-general attention and working memory circuits , 2002, Cognitive, affective & behavioral neuroscience.

[22]  C Palmer,et al.  Harmonic, melodic, and frequency height influences in the perception of multivoiced music , 1994, Perception & psychophysics.

[23]  R. Ilmoniemi,et al.  Language-specific phoneme representations revealed by electric and magnetic brain responses , 1997, Nature.

[24]  Shawn A. Weil,et al.  Change detection in multi-voice music: the role of musical structure, musical training, and task demands. , 2002, Journal of experimental psychology. Human perception and performance.

[25]  R. Näätänen,et al.  Short-term habituation and dishabituation of the mismatch negativity of the ERP. , 1984, Psychophysiology.

[26]  F. Perrin,et al.  Separate Representation of Stimulus Frequency, Intensity, and Duration in Auditory Sensory Memory: An Event-Related Potential and Dipole-Model Analysis , 1995, Journal of Cognitive Neuroscience.

[27]  B. Rockstroh,et al.  Increased Cortical Representation of the Fingers of the Left Hand in String Players , 1995, Science.

[28]  C Alain,et al.  Separate memory-related processing for auditory frequency and patterns. , 1999, Psychophysiology.

[29]  D L Woods,et al.  Lesions of frontal cortex diminish the auditory mismatch negativity. , 1994, Electroencephalography and clinical neurophysiology.

[30]  N. Kraus,et al.  The time course of auditory perceptual learning: neurophysiological changes during speech‐sound training , 1998, Neuroreport.

[31]  Arlette Zenatti,et al.  Le développement génétique de la perception musicale , 1969 .

[32]  R. Ilmoniemi,et al.  Functional Specialization of the Human Auditory Cortex in Processing Phonetic and Musical Sounds: A Magnetoencephalographic (MEG) Study , 1999, NeuroImage.

[33]  W. Ritter,et al.  Attention affects the organization of auditory input associated with the mismatch negativity system , 1998, Brain Research.

[34]  M Huotilainen,et al.  Changes in acoustic features and their conjunctions are processed by separate neuronal populations , 2001, Neuroreport.

[35]  I. Winkler,et al.  Top-down effects can modify the initially stimulus-driven auditory organization. , 2002, Brain research. Cognitive brain research.

[36]  R. Kakigi,et al.  Musical Training Enhances Automatic Encoding of Melodic Contour and Interval Structure , 2004, Journal of Cognitive Neuroscience.

[37]  R. Näätänen,et al.  The mismatch negativity (MMN): towards the optimal paradigm , 2004, Clinical Neurophysiology.

[38]  R Näätänen,et al.  The additivity of the auditory feature analysis in the human brain as indexed by the mismatch negativity: 1+1 approximately 2 but 1+1+1<3. , 2001, Neuroscience letters.

[39]  R Näätänen,et al.  Can echoic memory store two traces simultaneously? A study of event-related brain potentials. , 1992, Psychophysiology.

[40]  H. Yabe,et al.  Mismatch negativity (MMN) reveals sound grouping in the human brain , 2000, Neuroreport.

[41]  H W Gordon,et al.  Hemispheric asymmetries in the perception of musical chords. , 1970, Cortex; a journal devoted to the study of the nervous system and behavior.

[42]  S. Dalebout,et al.  Mismatch negativity to acoustic differences not differentiated behaviorally. , 1999, Journal of the American Academy of Audiology.

[43]  W. Ritter,et al.  Storage of information in transient auditory memory. , 1996, Brain research. Cognitive brain research.

[44]  C D Tesche,et al.  Signal-space projections of MEG data characterize both distributed and well-localized neuronal sources. , 1995, Electroencephalography and clinical neurophysiology.

[45]  E. Altenmüller,et al.  Event-related brain potentials to sound omissions differ in musicians and non-musicians , 2001, Neuroscience Letters.

[46]  Mikko Sams,et al.  Responses of the human auditory cortex to changes in one versus two stimulus features , 2004, Experimental Brain Research.

[47]  I. Peretz,et al.  Musical scale properties are automatically processed in the human auditory cortex , 2006, Brain Research.

[48]  R. Näätänen,et al.  Binaural information can converge in abstract memory traces. , 1998, Psychophysiology.

[49]  Debashis Kushary,et al.  Bootstrap Methods and Their Application , 2000, Technometrics.

[50]  M. Scherg,et al.  A Source Analysis of the Late Human Auditory Evoked Potentials , 1989, Journal of Cognitive Neuroscience.

[51]  Risto Näätänen,et al.  Simultaneous storage of two complex temporal sound patterns in auditory sensory memory , 2002, Neuroreport.

[52]  R. Knight,et al.  A distributed cortical network for auditory sensory memory in humans , 1998, Brain Research.

[53]  A. Dale,et al.  Human posterior auditory cortex gates novel sounds to consciousness. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[54]  R J Ilmoniemi,et al.  Tonotopic auditory cortex and the magnetoencephalographic (MEG) equivalent of the mismatch negativity. , 1993, Psychophysiology.

[55]  T. Bever,et al.  Hemispheric asymmetries in the perception of musical intervals as a function of musical experience and family handedness background , 1980, Brain and Language.

[56]  C Alain,et al.  Brain indices of automatic pattern processing , 1994, Neuroreport.

[57]  F. Perrin,et al.  Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. , 1990, Psychophysiology.

[58]  Risto N t nen Attention and brain function , 1992 .

[59]  K. Alho,et al.  Lateralized automatic auditory processing of phonetic versus musical information: A PET study , 2000, Human brain mapping.

[60]  E B Ringelstein,et al.  The cerebral haemodynamics of music perception. A transcranial Doppler sonography study. , 1999, Brain : a journal of neurology.

[61]  A. Pegna,et al.  Hemispheric dominance for melody recognition in musicians and non-musicians , 1995, Neuropsychologia.

[62]  I. Winkler,et al.  Human auditory cortex tracks task-irrelevant sound sources , 2003, Neuroreport.

[63]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[64]  I. Winkler,et al.  Organizing sound sequences in the human brain: the interplay of auditory streaming and temporal integration 1 1 Published on the World Wide Web on 27 February 2001. , 2001, Brain Research.

[65]  G. Schlaug,et al.  In vivo evidence of structural brain asymmetry in musicians , 1995, Science.

[66]  M. Tervaniemi,et al.  Superior pre-attentive auditory processing in musicians. , 1999, Neuroreport.

[67]  R Näätänen,et al.  Preattentive processing of spectral, temporal, and structural characteristics of acoustic regularities: a mismatch negativity study. , 2001, Psychophysiology.

[68]  L M Parsons,et al.  Exploring the Functional Neuroanatomy of Music Performance, Perception, and Comprehension , 2001, Annals of the New York Academy of Sciences.

[69]  L. Trainor,et al.  Automatic and Controlled Processing of Melodic Contour and Interval Information Measured by Electrical Brain Activity , 2002, Journal of Cognitive Neuroscience.

[70]  R Hari,et al.  Deviant auditory stimuli activate human left and right auditory cortex differently. , 1996, Cerebral cortex.

[71]  M. Hirshkowitz,et al.  EEG alpha asymmetry in musicians and non-musicians: A study of hemispheric specialization , 1978, Neuropsychologia.

[72]  M Hoke,et al.  Evoked magnetic responses of the human auditory cortex to minor pitch changes: localization of the mismatch field. , 1992, Electroencephalography and clinical neurophysiology.

[73]  K. Finke,et al.  Hemispheric dominance in the processing of J. S. Bach fugues: a transcranial Doppler sonography (TCD) study with musicians , 1998, Neuropsychologia.

[74]  R. Ilmoniemi,et al.  Superior formation of cortical memory traces for melodic patterns in musicians. , 2001, Learning & memory.

[75]  M. Besson,et al.  AN EVENT-RELATED POTENTIAL (ERP) STUDY OF MUSICAL EXPECTANCY : COMPARISON OF MUSICIANS WITH NONMUSICIANS , 1995 .

[76]  Daniel Reisberg,et al.  On the Perception of Interleaved Melodies , 1995 .

[77]  I. Winkler,et al.  Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity , 1999, Neuroscience Letters.

[78]  T. Picton,et al.  Mismatch Negativity: Different Water in the Same River , 2000, Audiology and Neurotology.

[79]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[80]  H. Hake,et al.  On the Masking Pattern of a Simple Auditory Stimulus , 1950 .

[81]  B. Ross,et al.  Evidence for training-induced crossmodal reorganization of cortical functions in trumpet players , 2003, Neuroreport.

[82]  N. Morton,et al.  Mode of processing and hemisphere differences in the judgement of musical stimuli. , 1989, British journal of psychology.

[83]  R. Näätänen,et al.  Auditory frequency discrimination and event-related potentials. , 1985, Electroencephalography and clinical neurophysiology.

[84]  W. Ritter,et al.  An investigation of the auditory streaming effect using event-related brain potentials. , 1999, Psychophysiology.

[85]  T. Gunter,et al.  Music matters: preattentive musicality of the human brain. , 2002, Psychophysiology.

[86]  T. Elbert,et al.  Specific tonotopic organizations of different areas of the human auditory cortex revealed by simultaneous magnetic and electric recordings. , 1995, Electroencephalography and clinical neurophysiology.