Parallel pitch processing in speech and melody: A study of the interference of musical melody on lexical pitch perception in speakers of Mandarin

Music and language have long been considered two distinct cognitive faculties governed by domain-specific cognitive and neural mechanisms. Recent work into the domain-specificity of pitch processing in both domains appears to suggest pitch processing to be governed by shared neural mechanisms. The current study aimed to explore the domain-specificity of pitch processing by simultaneously presenting pitch contours in speech and music to speakers of a tonal language, and measuring behavioral response and event-related potentials (ERPs). Native speakers of Mandarin were exposed to concurrent pitch contours in melody and speech. Contours in melody emulated those in speech were either congruent or incongruent with the pitch contour of the lexical tone (i.e., rising or falling). Component magnitudes of the N2b and N400 were used as indices of lexical processing. We found that the N2b was modulated by melodic pitch; incongruent item evoked significantly stronger amplitude. There was a trend of N400 to be modulated in the same way. Interestingly, these effects were present only on rising tones. Amplitude and time-course of the N2b and N400 may suggest an interference of melodic pitch contours with both early and late stages of phonological and semantic processing.

[1]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[2]  I. Peretz,et al.  Neural overlap in processing music and speech , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  V. Menon,et al.  Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. , 2011, Cerebral cortex.

[4]  Mante S. Nieuwland,et al.  When Peanuts Fall in Love: N400 Evidence for the Power of Discourse , 2005, Journal of Cognitive Neuroscience.

[5]  A. Friederici,et al.  Music, language and meaning: brain signatures of semantic processing , 2004, Nature Neuroscience.

[6]  I. Peretz,et al.  Mode and tempo relative contributions to “happy-sad” judgements in equitone melodies , 2003, Cognition & emotion.

[7]  Antje S. Meyer,et al.  Neurophysiological Manifestations of Phonological Processing: Latency Variation of a Negative ERP Component Timelocked to Phonological Mismatch , 1994, Journal of Cognitive Neuroscience.

[8]  Hsuan-Chih Chen,et al.  Brain Responses to Segmentally and Tonally Induced Semantic Violations in Cantonese , 2005, Journal of Cognitive Neuroscience.

[9]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[10]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[11]  Lutz Jäncke,et al.  Enhancement of Auditory-evoked Potentials in Musicians Reflects an Influence of Expertise but not Selective Attention , 2008, Journal of Cognitive Neuroscience.

[12]  Isabelle Peretz,et al.  Neurobiology of Congenital Amusia , 2016, Trends in Cognitive Sciences.

[13]  Colin M. Brown,et al.  Electrophysiological Evidence for Early Contextual Influences during Spoken-Word Recognition: N200 Versus N400 Effects , 2001, Journal of Cognitive Neuroscience.

[14]  Isabelle Peretz,et al.  Processing interactions between phonology and melody: Vowels sing but consonants speak , 2009, Cognition.

[15]  Stefan Koelsch,et al.  Comparing the Processing of Music and Language Meaning Using EEG and fMRI Provides Evidence for Similar and Distinct Neural Representations , 2008, PloS one.

[16]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[17]  John F Connolly,et al.  Latency shifts in the N2b component track phonological deviations in spoken words , 2000, Clinical Neurophysiology.

[18]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[19]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[20]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[21]  G. Schlaug,et al.  From Singing to Speaking: Why Singing May Lead to Recovery of Expressive Language Function in Patients with Broca's Aphasia. , 2008, Music perception.

[22]  G. Bidelman,et al.  Pitch expertise is not created equal: Cross-domain effects of musicianship and tone language experience on neural and behavioural discrimination of speech and music , 2015, Neuropsychologia.

[23]  R. Näätänen,et al.  Sequential effects on the ERP in discriminating two stimuli , 1983, Biological Psychology.

[24]  Henkjan Honing,et al.  Top–Down Modulation on the Perception and Categorization of Identical Pitch Contours in Speech and Music , 2016, Front. Psychol..

[25]  Nicole M. Russo,et al.  Musical experience shapes human brainstem encoding of linguistic pitch patterns , 2007, Nature Neuroscience.

[26]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[27]  Lutz Jäncke,et al.  The Plasticity of the Superior Longitudinal Fasciculus as a Function of Musical Expertise: A Diffusion Tensor Imaging Study , 2009, Front. Hum. Neurosci..

[28]  I. Peretz.  Music, Language and Modularity Framed in Action , 2009 .

[29]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[30]  J. Swaminathan,et al.  Experience-dependent neural representation of dynamic pitch in the brainstem , 2009, Neuroreport.

[31]  A. Krishnan,et al.  Musicians and tone-language speakers share enhanced brainstem encoding but not perceptual benefits for musical pitch , 2011, Brain and Cognition.

[32]  I. Peretz,et al.  What is specific to music processing? Insights from congenital amusia , 2003, Trends in Cognitive Sciences.

[33]  F. Perrin,et al.  Modulation of the N400 potential during auditory phonological/semantic interaction. , 2003, Brain research. Cognitive brain research.

[34]  B. Wright,et al.  The influence of linguistic experience on the cognitive processing of pitch in speech and nonspeech sounds. , 2006, Journal of experimental psychology. Human perception and performance.

[35]  Jessica M. Foxton,et al.  SPEECH INTONATION PERCEPTION DEFICITS IN MUSICAL TONE DEAFNESS (CONGENITAL AMUSIA) , 2008 .

[36]  Lutz Jäncke,et al.  Processing of Voiced and Unvoiced Acoustic Stimuli in Musicians , 2011, Front. Psychology.

[37]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[38]  P. Boersma.  Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[39]  Aniruddh D. Patel.  Sharing and Nonsharing of Brain Resources for Language and Music , 2013 .

[40]  R. Zatorre,et al.  Musical Melody and Speech Intonation: Singing a Different Tune , 2012, PLoS biology.

[41]  Elke B Lange,et al.  Dual representation of item positions in verbal short-term memory: Evidence for two access modes , 2010, The European journal of cognitive psychology.

[42]  Winfried Schlee,et al.  Top-Down Modulation of the Auditory Steady-State Response in a Task-Switch Paradigm , 2008, Front. Hum. Neurosci..

[43]  M. Brysbaert,et al.  SUBTLEX-CH: Chinese Word and Character Frequencies Based on Film Subtitles , 2010, PloS one.

[44]  I. Peretz,et al.  Early integration of vowel and pitch processing: A mismatch negativity study , 2010, Clinical Neurophysiology.

[45]  Henkjan Honing,et al.  Musicality as an upbeat to music: Introduction and research agenda , 2018 .

[46]  Josh H. McDermott,et al.  Distinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition , 2015, Neuron.

[47]  Bharath Chandrasekaran,et al.  Neuroplasticity in the processing of pitch dimensions: a multidimensional scaling analysis of the mismatch negativity. , 2007, Restorative neurology and neuroscience.

[48]  D. Deutsch,et al.  Speech versus song: multiple pitch-sensitive areas revealed by a naturally occurring musical illusion. , 2013, Cerebral cortex.

[49]  Chunyan Guo,et al.  Task modulation of disyllabic spoken word recognition in Mandarin Chinese: a unimodal ERP study , 2016, Scientific Reports.

[50]  Stefan Koelsch,et al.  Interaction between Syntax Processing in Language and in Music: An ERP Study , 2005, Journal of Cognitive Neuroscience.

[51]  Chun-yan Guo,et al.  The time course of spoken word recognition in Mandarin Chinese: A unimodal ERP study , 2014, Neuropsychologia.

[52]  Aniruddh D. Patel.  Language, music, and the brain: a resource-sharing framework , 2011 .

[53]  Isabelle Peretz,et al.  Congenital Amusia (or Tone-Deafness) Interferes with Pitch Processing in Tone Languages , 2011, Front. Psychology.

[54]  M. Kutas,et al.  Electrophysiological estimates of the time course of semantic and phonological encoding during implicit picture naming. , 2000, Psychophysiology.

[55]  A. Krishnan,et al.  Relative influence of musical and linguistic experience on early cortical processing of pitch contours , 2009, Brain and Language.

[56]  A D Friederici,et al.  Top‐down modulation of auditory processing: effects of sound context, musical expertise and attentional focus , 2009, The European journal of neuroscience.

[57]  L. Gerken,et al.  The Development of Affective Responses to Modality and Melodic Contour , 1995 .

[58]  G. Bidelman,et al.  Tone Language Speakers and Musicians Share Enhanced Perceptual and Cognitive Abilities for Musical Pitch: Evidence for Bidirectionality between the Domains of Language and Music , 2013, PloS one.

[59]  W. Ritter,et al.  The relationship between N2 and N400: scalp distribution, stimulus probability, and task relevance. , 1991, Psychophysiology.

[60]  Mathias S. Oechslin,et al.  Absolute Pitch—Functional Evidence of Speech-Relevant Auditory Acuity , 2009, Cerebral cortex.

[61]  I. Peretz,et al.  Fine-grained pitch processing of music and speech in congenital amusia. , 2011, The Journal of the Acoustical Society of America.

[63]  Gregory Hickok,et al.  Functional Anatomy of Language and Music Perception: Temporal and Structural Factors Investigated Using Functional Magnetic Resonance Imaging , 2011, The Journal of Neuroscience.

[64]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[65]  Lutz Jäncke,et al.  The encoding of vowels and temporal speech cues in the auditory cortex of professional musicians: An EEG study , 2013, Neuropsychologia.

[66]  Gavin M. Bidelman,et al.  Musicians demonstrate experience-dependent brainstem enhancement of musical scale features within continuously gliding pitch , 2011, Neuroscience Letters.

[67]  A. Kübler,et al.  Task instructions modulate the attentional mode affecting the auditory MMN and the semantic N400 , 2014, Front. Hum. Neurosci..

[68]  M. Besson,et al.  Behavioral and Electrophysiological Study of Phonological Priming between Bisyllabic Spoken Words , 2001, Journal of Cognitive Neuroscience.

[69]  Enzo Cocca,et al.  Lakeside Cemeteries in the Sahara: 5000 Years of Holocene Population and Environmental Change , 2008, PloS one.

[70]  Isabelle Peretz,et al.  Tonal Language Processing in Congenital Amusia , 2009, Annals of the New York Academy of Sciences.

[71]  Marta Olivetti Belardinelli,et al.  Influence of Musical Expertise on Segmental and Tonal Processing in Mandarin Chinese , 2011, Journal of Cognitive Neuroscience.

[72]  Yisheng Xu,et al.  Specificity of experience-dependent pitch representation in the brainstem , 2006, Neuroreport.

[73]  M. O. Belardinelli,et al.  From melody to lexical tone: Musical ability enhances specific aspects of foreign language perception , 2010 .

[74]  James M. McQueen,et al.  Speech and music shape the listening brain: evidence for shared domain-general mechanisms , 2013, Front. Psychol..