Top–Down Modulation on the Perception and Categorization of Identical Pitch Contours in Speech and Music

Whether pitch in language and music is governed by domain-specific or domain-general cognitive mechanisms is contentiously debated. The aim of the present study was to investigate whether mechanisms governing pitch contour perception operate differently when pitch information is interpreted as either speech or music. By modulating listening mode, this study aspired to demonstrate that pitch contour perception relies on domain-specific cognitive mechanisms, which are regulated by top-down influences from language and music. Three groups of participants (Mandarin speakers, Dutch speaking non-musicians, and Dutch musicians) were exposed to identical pitch contours, and tested on their ability to identify these contours in a language and musical context. Stimuli consisted of disyllabic words spoken in Mandarin, and melodic tonal analogs, embedded in a linguistic and melodic carrier phrase, respectively. Participants classified identical pitch contours as significantly different depending on listening mode. Top-down influences from language appeared to alter the perception of pitch contour in speakers of Mandarin. This was not the case for non-musician speakers of Dutch. Moreover, this effect was lacking in Dutch speaking musicians. The classification patterns of pitch contours in language and music seem to suggest that domain-specific categorization is modulated by top-down influences from language and music.

[1]  Jackson T Gandour,et al.  LANGUAGE EXPERIENCE SHAPES PROCESSING OF PITCH RELEVANT INFORMATION IN THE HUMAN BRAINSTEM AND AUDITORY CORTEX: ELECTROPHYSIOLOGICAL EVIDENCE. , 2014, Acoustics Australia.

[2]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[3]  P. Gregersen,et al.  Absolute pitch: prevalence, ethnic variation, and estimation of the genetic component. , 1999, American journal of human genetics.

[4]  Gang Peng,et al.  The influence of language experience on categorical perception of pitch contours , 2010, J. Phonetics.

[5]  J. Hart,et al.  On the anatomy of intonation , 1968 .

[6]  Paul Rowlett,et al.  The French language today : a linguistic introduction, 2nd ed , 2000 .

[7]  Erik D. Thiessen,et al.  Infant-Directed Speech Facilitates Word Segmentation. , 2005, Infancy : the official journal of the International Society on Infant Studies.

[8]  P. Rowlett,et al.  The French Language Today : A Linguistic Introduction , 2003 .

[9]  E. Bialystok,et al.  Musical expertise, bilingualism, and executive functioning. , 2009, Journal of experimental psychology. Human perception and performance.

[10]  R. Zatorre,et al.  Musical Melody and Speech Intonation: Singing a Different Tune , 2012, PLoS biology.

[11]  D. Pisoni Identification and discrimination of the relative onset time of two component tones: implications for voicing perception in stops. , 1977, The Journal of the Acoustical Society of America.

[12]  J. Saffran,et al.  Music and Language: A Developmental Comparison , 2004 .

[13]  Adrian Battye,et al.  The French Language Today , 1992 .

[14]  Isabelle Peretz,et al.  Without it no music: cognition, biology and evolution of musicality , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  Gavin M. Bidelman,et al.  Musicians demonstrate experience-dependent brainstem enhancement of musical scale features within continuously gliding pitch , 2011, Neuroscience Letters.

[16]  Alexander L. Francis,et al.  Effects of Language Experience and Stimulus Complexity on the Categorical Perception of Pitch Direction , 2006 .

[17]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[18]  D. Deutsch,et al.  Absolute Pitch, Speech, and Tone Language: Some Experiments and a Proposed Framework , 2004 .

[19]  N. Freimer,et al.  Absolute pitch: an approach for identification of genetic and nongenetic components. , 1998, American journal of human genetics.

[20]  V. Menon,et al.  Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. , 2011, Cerebral cortex.

[21]  D. Deutsch,et al.  Absolute pitch among American and Chinese conservatory students: prevalence differences, and evidence for a speech-related critical period. , 2006, The Journal of the Acoustical Society of America.

[22]  A. Krishnan,et al.  Relative influence of musical and linguistic experience on early cortical processing of pitch contours , 2009, Brain and Language.

[23]  G. Bidelman,et al.  Tone Language Speakers and Musicians Share Enhanced Perceptual and Cognitive Abilities for Musical Pitch: Evidence for Bidirectionality between the Domains of Language and Music , 2013, PloS one.

[24]  W. D. Ward,et al.  Categorical perception--phenomenon or epiphenomenon: evidence from experiments in the perception of melodic musical intervals. , 1978, The Journal of the Acoustical Society of America.

[25]  Pierre A. Hallé,et al.  Identification and discrimination of Mandarin Chinese tones by Mandarin Chinese vs. French listeners , 2004, J. Phonetics.

[26]  Aniruddh D. Patel Why would Musical Training Benefit the Neural Encoding of Speech? The OPERA Hypothesis , 2011, Front. Psychology.

[27]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[28]  P. Boersma Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[29]  Robert L. Goldstone,et al.  Categorical perception. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[30]  M. Bal The effects of language , 1989 .

[31]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[32]  M. O. Belardinelli,et al.  From melody to lexical tone: Musical ability enhances specific aspects of foreign language perception , 2010 .

[34]  D. D. Greenwood Critical Bandwidth and the Frequency Coordinates of the Basilar Membrane , 1961 .

[35]  P. K. P. Mok,et al.  The separation between music and speech: evidence from the perception of Cantonese tones. , 2012, The Journal of the Acoustical Society of America.

[36]  Klaus R. Scherer,et al.  The role of intonation in emotional expressions , 2005, Speech Commun..

[37]  Peter Q. Pfordresher,et al.  Native Experience with a Tone Language Enhances Pitch Discrimination and the Timing of Neural Responses to Pitch Change , 2011, Front. Psychology.

[38]  Mireille Besson,et al.  Musicians Detect Pitch Violation in a Foreign Language Better Than Nonmusicians: Behavioral and Electrophysiological Evidence , 2007, Journal of Cognitive Neuroscience.

[39]  Chao-Yang Lee,et al.  Identification of Mandarin tones by English-speaking musicians and nonmusicians. , 2008, The Journal of the Acoustical Society of America.

[40]  P. Gregersen,et al.  Early childhood music education and predisposition to absolute pitch: teasing apart genes and environment. , 2001, American journal of medical genetics.

[41]  Humayun Rashid,et al.  Language of Change , 2008, AMCIS.

[42]  B. Wright,et al.  The influence of linguistic experience on the cognitive processing of pitch in speech and nonspeech sounds. , 2006, Journal of experimental psychology. Human perception and performance.

[43]  Aniruddh D. Patel Language, music, and the brain: a resource-sharing framework , 2011 .

[44]  Robert J. Zatorre,et al.  Predispositions and Plasticity in Music and Speech Learning: Neural Correlates and Implications , 2013, Science.

[45]  E. Brattico,et al.  Cognitive Control in Auditory Working Memory Is Enhanced in Musicians , 2010, PloS one.

[46]  James M. McQueen,et al.  Speech and music shape the listening brain: evidence for shared domain-general mechanisms , 2013, Front. Psychol..

[47]  P. Gregersen Letter to the Editor Early Childhood Music Education and Predisposition to Absolute Pitch: Teasing Apart Genes and Environment , 2001 .

[48]  D. Deutsch,et al.  Absolute pitch among students in an American music conservatory: association with tone language fluency. , 2009, The Journal of the Acoustical Society of America.

[49]  D. Deutsch,et al.  Speech versus song: multiple pitch-sensitive areas revealed by a naturally occurring musical illusion. , 2013, Cerebral cortex.

[50]  M. Bozkurt,et al.  Functional anatomy. , 1980, Equine veterinary journal.

[51]  I. Peretz,et al.  Neural overlap in processing music and speech , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[52]  Gregory Hickok,et al.  Functional Anatomy of Language and Music Perception: Temporal and Structural Factors Investigated Using Functional Magnetic Resonance Imaging , 2011, The Journal of Neuroscience.

[53]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[54]  D. Schön,et al.  The music of speech: music training facilitates pitch processing in both music and language. , 2004, Psychophysiology.

[55]  D. J. Hermes,et al.  The frequency scale of speech intonation. , 1991, The Journal of the Acoustical Society of America.

[56]  Mireille Besson,et al.  Musician Children Detect Pitch Violations in Both Music and Language Better than Nonmusician Children: Behavioral and Electrophysiological Approaches , 2006, Journal of Cognitive Neuroscience.

[57]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[58]  A. Krishnan,et al.  Musicians and tone-language speakers share enhanced brainstem encoding but not perceptual benefits for musical pitch , 2011, Brain and Cognition.

[59]  Bharath Chandrasekaran,et al.  Neuroplasticity in the processing of pitch dimensions: a multidimensional scaling analysis of the mismatch negativity. , 2007, Restorative neurology and neuroscience.

[60]  M. Brysbaert,et al.  SUBTLEX-CH: Chinese Word and Character Frequencies Based on Film Subtitles , 2010, PloS one.

[61]  H. Shu,et al.  Musical experience modulates categorical perception of lexical tones in native Chinese speakers , 2015, Front. Psychol..

[62]  W. Siegel,et al.  Categorical perception of tonal intervais: Musicians can’t tellsharp fromflat , 1977 .

[63]  Thierry Nazzi,et al.  DISCRIMINATION OF PITCH CONTOURS BY NEONATES , 1998 .

[64]  W. Dowling,et al.  Contour, interval, and pitch recognition in memory for melodies. , 1971, The Journal of the Acoustical Society of America.

[65]  Ann R. Bradlow,et al.  Lexical tone perception in musicians and non-musicians , 2005, INTERSPEECH.

[66]  A. Basu,et al.  Genome-wide study of families with absolute pitch reveals linkage to 8q24.21 and locus heterogeneity. , 2009, American journal of human genetics.

[67]  R. Zatorre Category-boundary effects and speeded sorting with a harmonic musical-interval continuum: evidence for dual processing. , 1983, Journal of experimental psychology. Human perception and performance.

[68]  A. Friederici,et al.  Differential roles of right temporal cortex and broca's area in pitch processing: Evidence from music and mandarin , 2013, Human brain mapping.

[69]  M. Coltheart,et al.  Modularity of music processing , 2003, Nature Neuroscience.

[70]  M. Bangert,et al.  Perception of Words and Pitch Patterns in Song and Speech , 2012, Front. Psychology.

[71]  R A Harshman,et al.  Crosslanguage Differences in Tone Perception: a Multidimensional Scaling Investigation , 1978, Language and speech.

[72]  I. Peretz Music, Language and Modularity Framed in Action , 2009 .

[73]  Marta Olivetti Belardinelli,et al.  Influence of Musical Expertise on Segmental and Tonal Processing in Mandarin Chinese , 2011, Journal of Cognitive Neuroscience.

[74]  Nicole M. Russo,et al.  Musical experience shapes human brainstem encoding of linguistic pitch patterns , 2007, Nature Neuroscience.

[75]  R. Krantz,et al.  On the Perception of Tone , 2003 .

[76]  G. Bidelman,et al.  Pitch expertise is not created equal: Cross-domain effects of musicianship and tone language experience on neural and behavioural discrimination of speech and music , 2015, Neuropsychologia.

[77]  W. Dowling Scale and contour: Two components of a theory of memory for melodies. , 1978 .

[78]  Peter Q. Pfordresher,et al.  Enhanced production and perception of musical pitch in tone language speakers , 2009, Attention, perception & psychophysics.

[79]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[80]  William Forde Thompson,et al.  Intervals and Scales , 2013 .

[81]  S. L. Campbell,et al.  Frequency and frequency-ratio resolution by possessors of absolute and relative pitch: examples of categorical perception. , 1994, The Journal of the Acoustical Society of America.