Effects of production training and perception training on lexical tone perception – A behavioral and ERP study

The present study recorded both behavioral data and event-related brain potentials to examine the effectiveness of a perception-only training and a perception-plus-production training procedure on the intentional and unintentional perception of lexical tone by native English listeners. In the behavioral task, both the perception-only and the perception-plus-production groups improved on the tone discrimination abilities after the training session. Moreover, the participants in both groups generalized the improvements gained through the trained stimuli to the untrained stimuli. In the ERP task, the Mismatch Negativity was smaller in the post-training task than in the pre-training task. However, the two training groups did not differ in tone processing at the intentional or unintentional level after training. These results suggest that the employment of the motor system does not specifically benefit the tone perceptual skills. Furthermore, the present study investigated whether some tone pairs are more easily confused than others by native English listeners, and whether the order of tone presentation influences non-native tone discrimination. In the behavioral task, Tone2-Tone1 (rising-level) and Tone2-Tone4 (rising-falling) were the most difficult tone pairs, while Tone1-Tone2 and Tone4-Tone2 were the easiest tone pairs, even though they involved the same tone contrasts respectively. In the ERP task, the native English listeners had good discrimination when Tone2 and Tone4 were embedded in strings of Tone1, while poor discrimination when Tone1 was inserted in the context of Tone2 or Tone4. These asymmetries in tone perception might be attributed to the interference of native intonation system and can be altered by training.

[1]  D. Poeppel,et al.  Towards a functional neuroanatomy of speech perception , 2000, Trends in Cognitive Sciences.

[2]  Marco Iacoboni,et al.  Neural responses to non-native phonemes varying in producibility: Evidence for the sensorimotor nature of speech perception , 2006, NeuroImage.

[3]  A J van Hessen,et al.  Modeling phoneme perception. II: A model of stop consonant discrimination. , 1992, The Journal of the Acoustical Society of America.

[4]  Wendy Herd The Perceptual and Production Training of /d, tap, r/ in L2 Spanish: Behavioral, Psycholinguistic, and Neurolinguistic Evidence , 2011 .

[5]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[6]  Jack Gandour,et al.  Tone perception in Far Eastern languages. , 1983 .

[7]  H. Bekkering,et al.  Imitation Improves Language Comprehension , 2010, Psychological science.

[8]  David Poeppel,et al.  Pure word deafness and the bilateral processing of the speech code , 2001, Cogn. Sci..

[9]  T. Gottfried,et al.  Effect of linguistic experience on the identification of Mandarin Chinese vowels and tones , 1997 .

[10]  Catherine T Best,et al.  Perception of non-native tonal contrasts : effects of native phonological and phonetic influences , 2006 .

[11]  K. Stevens,et al.  Linguistic experience alters phonetic perception in infants by 6 months of age. , 1992, Science.

[12]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[13]  A. Jongman,et al.  Training American listeners to perceive Mandarin tones. , 1999, The Journal of the Acoustical Society of America.

[14]  Melissa Baese-Berk,et al.  An Examination of the Relationship Between Speech Perception and Production , 2010 .

[15]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[16]  R. Näätänen,et al.  The mismatch negativity (MMN): towards the optimal paradigm , 2004, Clinical Neurophysiology.

[17]  N. Cowan,et al.  The use of auditory and phonetic memory in vowel discrimination. , 1986, The Journal of the Acoustical Society of America.

[18]  A. Jongman,et al.  Acoustic and perceptual evaluation of Mandarin tone productions before and after perceptual training. , 2003, The Journal of the Acoustical Society of America.

[19]  N. Kraus,et al.  The time course of auditory perceptual learning: neurophysiological changes during speech‐sound training , 1998, Neuroreport.

[20]  Tyler K. Perrachione,et al.  Learning pitch patterns in lexical identification by native English-speaking adults , 2007, Applied Psycholinguistics.

[21]  E. Kaan,et al.  Thai lexical tone perception in native speakers of Thai, English and Mandarin Chinese: An event-related potentials training study , 2008, BMC Neuroscience.

[22]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[23]  Bharath Chandrasekaran,et al.  Neuroplasticity in the processing of pitch dimensions: a multidimensional scaling analysis of the mismatch negativity. , 2007, Restorative neurology and neuroscience.

[24]  Antje S. Meyer,et al.  An MEG Study of Picture Naming , 1998, Journal of Cognitive Neuroscience.

[25]  P Iverson,et al.  Mapping the perceptual magnet effect for speech using signal detection theory and multidimensional scaling. , 1995, The Journal of the Acoustical Society of America.

[26]  Jeffery A. Jones,et al.  Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory–auditory/orosensory internal models , 2004, NeuroImage.

[27]  J. Werker,et al.  Developmental changes in perception of nonnative vowel contrasts. , 1994, Journal of experimental psychology. Human perception and performance.

[28]  Ratree Wayland,et al.  Comparison of Vocalists and Instrumentalists on Lexical Tone Perception and Production Tasks , 2011, ICPhS.

[29]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[30]  David B. Pisoni,et al.  Intelligibility of normal speech I: Global and fine-grained acoustic-phonetic talker characteristics , 1996, Speech Commun..

[31]  Alexander L. Francis,et al.  Stimulus presentation order and the perception of lexical tones in Cantonese. , 2003, The Journal of the Acoustical Society of America.

[32]  E. Schröger,et al.  Discrimination of personally significant from nonsignificant sounds: A training study , 2013, Cognitive, affective & behavioral neuroscience.

[33]  Ratree Wayland,et al.  Training English and Chinese Listeners to Perceive Thai Tones: A Preliminary Report , 2004 .

[34]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[35]  P. Cariani,et al.  Encoding of pitch in the human brainstem is sensitive to language experience. , 2005, Brain research. Cognitive brain research.

[36]  S. Hillyard,et al.  The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones. , 1991, Psychophysiology.

[37]  Erika Skoe,et al.  Plasticity in the Adult Human Auditory Brainstem following Short-term Linguistic Training , 2008, Journal of Cognitive Neuroscience.

[38]  R. Näätänen,et al.  Early selective-attention effects on the evoked potential: A critical review and reinterpretation , 1979, Biological Psychology.

[39]  Friedemann Pulvermüller,et al.  Motor cortex maps articulatory features of speech sounds , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[40]  David A. Medler,et al.  Neural correlates of sensory and decision processes in auditory object identification , 2004, Nature Neuroscience.

[41]  C. Best A direct realist view of cross-language speech perception , 1995 .

[42]  R. Knight,et al.  A distributed cortical network for auditory sensory memory in humans , 1998, Brain Research.

[43]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[44]  Mark A. Chevillet,et al.  Automatic Phoneme Category Selectivity in the Dorsal Auditory Stream , 2013, The Journal of Neuroscience.

[45]  M. Huotilainen,et al.  Event-related potentials associated with second language learning in children , 2003, Clinical Neurophysiology.

[46]  Aaron R. Seitz,et al.  A common framework for perceptual learning , 2007, Current Opinion in Neurobiology.

[47]  D. Pisoni Auditory and phonetic memory codes in the discrimination of consonants and vowels , 1973, Perception & psychophysics.

[48]  R Näätänen,et al.  Mismatch negativity--a unique measure of sensory processing in audition. , 1995, The International journal of neuroscience.

[49]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[50]  Masa-aki Sato,et al.  Premotor cortex mediates perceptual performance , 2010, NeuroImage.

[51]  T. Carrell,et al.  Central auditory system plasticity: generalization to novel stimuli following listening training. , 1997, The Journal of the Acoustical Society of America.

[52]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[53]  Kimberly M. Fenn,et al.  Perceptual learning of Cantonese lexical tones by tone and non-tone language speakers , 2008, J. Phonetics.

[54]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[55]  J. Werker,et al.  When does native language input affect phonetic perception? The precocious case of lexical tone , 2013 .

[56]  Bin Li,et al.  Effects of two training procedures in cross-language perception of tones , 2008, J. Phonetics.

[57]  E. Kaan,et al.  Effects of native language and training on lexical tone perception: An event-related potential study , 2007, Brain Research.

[58]  Yukari Hirata,et al.  Computer Assisted Pronunciation Training for Native English Speakers Learning Japanese Pitch and Durational Contrasts , 2004 .

[59]  Yinjuan Du,et al.  Noise differentially impacts phoneme representations in the auditory and speech motor systems , 2014, Proceedings of the National Academy of Sciences.

[60]  Gregor Kohls,et al.  Extracting rules: early and late mismatch negativity to tone patterns , 2005, Neuroreport.