Neuroplasticity in the processing of pitch dimensions: a multidimensional scaling analysis of the mismatch negativity.

PURPOSE An auditory electrophysiological study was conducted to explore the influence of language experience on the saliency of dimensions underlying cortical pitch processing. METHODS Mismatch negativity (MMN) responses to Mandarin tones were recorded in Chinese and English participants (n=10 per group) using a passive oddball paradigm. Stimuli consisted of three tones (T1: high level; T2: high rising; T3: low falling-rising). There were three oddball conditions (standard/deviant): T1/T2, T1/T3, T2/T3. In the T1/T2 and T1/T3 conditions, each tonal pair represented a contrast between a level and a contour tone; the T2/T3 condition, a contrast between two contour tones. Twenty dissimilarity matrices were created using the MMN mean amplitude measured from the Fz location for each condition per participant, and analyzed by an individual differences multidimensional scaling model. RESULTS Two pitch dimensions were revealed, interpretively labeled as 'height' and 'contour'. The latter was found to be more important for Chinese than English subjects. Using individual weights on the contour dimension, a discriminant function showed that 17 out of 20 participants were correctly classified into their respective language groups. CONCLUSIONS The MMN can serve as an index of pitch features that are differentially weighted depending on a listener's experience with lexical tones and their acoustic correlates within a particular tone space.

[1]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[2]  R. Näätänen,et al.  Development of language-specific phoneme representations in the infant brain , 1998, Nature Neuroscience.

[3]  Emmanuel Dupoux,et al.  Electrophysiological Correlates of Phonological Processing: A Cross-linguistic Study , 2000, Journal of Cognitive Neuroscience.

[4]  Eckart Altenmüller,et al.  The fate of sounds in conductors' brains: an ERP study. , 2003, Brain research. Cognitive brain research.

[5]  Bharath Chandrasekaran,et al.  Mismatch negativity to pitch contours is influenced by language experience , 2007, Brain Research.

[6]  R Näätänen,et al.  [The mismatch negativity as an index of the perception of speech sounds by the human brain]. , 2000, Rossiiskii fiziologicheskii zhurnal imeni I.M. Sechenova.

[7]  R. Näätänen,et al.  Selective tuning of cortical sound‐feature processing by language experience , 2006, The European journal of neuroscience.

[8]  P. Cariani,et al.  Encoding of pitch in the human brainstem is sensitive to language experience. , 2005, Brain research. Cognitive brain research.

[9]  A. Liberman,et al.  An effect of linguistic experience: The discrimination of [r] and [l] by native speakers of Japanese and English , 1975 .

[10]  Risto Näätänen,et al.  Linguistic relevance of duration within the native language determines the accuracy of speech-sound duration processing. , 2003, Brain research. Cognitive brain research.

[11]  J. Gandour.  The Handbook of East Asian Psycholinguistics: Brain mapping of Chinese speech prosody , 2006 .

[12]  J. Algina,et al.  Generalized eta and omega squared statistics: measures of effect size for some common research designs. , 2003, Psychological methods.

[13]  R. Ilmoniemi,et al.  Superior formation of cortical memory traces for melodic patterns in musicians. , 2001, Learning & memory.

[14]  J. Hirsch,et al.  fMRI Evidence for Cortical Modification during Learning of Mandarin Lexical Tone , 2003, Journal of Cognitive Neuroscience.

[15]  N. Kraus,et al.  Speech Sound Representation in the Brain , 2000, Audiology and Neurotology.

[16]  M. Tervaniemi,et al.  Sound processing in amateur musicians and nonmusicians: event-related potential and behavioral indices , 2006, Neuroreport.

[17]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[18]  C. Kiriloff,et al.  On the Auditory Perception of Tones in Mandarin , 1969 .

[19]  H. Goto,et al.  Auditory perception by normal Japanese adults of the sounds "L" and "R". , 1971, Neuropsychologia.

[20]  R. Kakigi,et al.  Musical Training Enhances Automatic Encoding of Melodic Contour and Interval Structure , 2004, Journal of Cognitive Neuroscience.

[21]  M. Lowe,et al.  A Cross-Linguistic fMRI Study of Spectral and Temporal Cues Underlying Phonological Processing , 2002, Journal of Cognitive Neuroscience.

[22]  Yi Xu.  Contextual tonal variations in Mandarin , 1997 .

[23]  M. Tervaniemi,et al.  Superior pre-attentive auditory processing in musicians. , 1999, Neuroreport.

[24]  D. Lancker,et al.  A Crosslinguistic PET Study of Tone Perception , 2000, Journal of Cognitive Neuroscience.

[25]  M. Dorman,et al.  Neurophysiologic correlates of cross-language phonetic perception. , 2000, The Journal of the Acoustical Society of America.

[26]  Stephen McAdams,et al.  Separate Neural Processing of Timbre Dimensions in Auditory Sensory Memory , 2006, Journal of Cognitive Neuroscience.

[27]  M. Coltheart,et al.  Modularity of music processing , 2003, Nature Neuroscience.

[28]  Tsan Huang.  Language-specificity in auditory perception of Chinese tones , 2004 .

[29]  Mario Dzemidzic,et al.  Activation of the left planum temporale in pitch processing is shaped by language experience , 2006, Human brain mapping.

[30]  Valéria Csépe,et al.  Suprasegmental speech cues are automatically processed by the human brain: a mismatch negativity study , 2004, Neuroscience Letters.

[31]  O Bertrand,et al.  Analysis of speech sounds is left-hemisphere predominant at 100-150ms after sound onset. , 1999, Neuroreport.

[32]  R. Näätänen.  The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). , 2001, Psychophysiology.

[33]  R. Ilmoniemi,et al.  Language-specific phoneme representations revealed by electric and magnetic brain responses , 1997, Nature.

[34]  M. Dorman,et al.  Cortical auditory evoked potential correlates of categorical perception of voice-onset time. , 1999, The Journal of the Acoustical Society of America.

[35]  J. Howie,et al.  Acoustical Studies of Mandarin Vowels and Tones , 1976 .

[36]  R A Harshman,et al.  Crosslanguage Differences in Tone Perception: a Multidimensional Scaling Investigation , 1978, Language and speech.

[37]  I. Peretz.  The nature of music from a biological perspective , 2006, Cognition.

[38]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[39]  Rl Sutton-Spence.  Encyclopedia of Language and Linguistics 2nd Edition , 2006 .

[40]  D. Klatt,et al.  Analysis, synthesis, and perception of voice quality variations among female and male talkers. , 1990, The Journal of the Acoustical Society of America.

[41]  T. Carrell,et al.  Central Auditory System Plasticity Associated with Speech Discrimination Training , 1995, Journal of Cognitive Neuroscience.

[42]  Keith Johnson,et al.  The Role of Speech Perception in Phonology , 2001 .

[43]  Alexander L. Francis,et al.  Selective attention and the acquisition of new phonetic categories. , 2002, Journal of experimental psychology. Human perception and performance.

[44]  Y. Tohkura,et al.  A perceptual interference account of acquisition difficulties for non-native phonemes , 2003, Cognition.

[45]  P. Alku,et al.  Mismatch negativity (MMN) elicited by changes in phoneme length: A cross-linguistic study , 2006, Brain Research.

[46]  Rolph E. Anderson,et al.  Multivariate Data Analysis: Text and Readings , 1979 .

[47]  A. Jongman,et al.  Training American listeners to perceive Mandarin tones. , 1999, The Journal of the Acoustical Society of America.

[48]  R. Ilmoniemi,et al.  Brain responses reveal the learning of foreign language phonemes. , 1999, Psychophysiology.

[49]  Jack Gandour,et al.  Tone Dissimiliarity Judgments by Chinese Listeners. , 1984 .

[50]  T. J.  Tone : Neurophonetics , 2022 .

[51]  S. McAdams,et al.  Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones. , 2005, The Journal of the Acoustical Society of America.

[52]  Dennis H. Klatt,et al.  Software for a cascade/parallel formant synthesizer , 1980 .

[53]  Phipps Arabie,et al.  Three-way scaling and clustering. , 1987 .

[54]  Yisheng Xu,et al.  Specificity of experience-dependent pitch representation in the brainstem , 2006, Neuroreport.

[55]  Keith Johnson,et al.  A Model of the Interplay of Speech Perception and Phonology , 2001 .

[56]  Jack Gandour,et al.  Tone perception in Far Eastern languages. , 1983 .