The effect of phonetic production training with visual feedback on the perception and production of foreign speech sounds.

Second-language learners often experience major difficulties in producing non-native speech sounds. This paper introduces a training method that uses a real-time analysis of the acoustic properties of vowels produced by non-native speakers to provide them with immediate, trial-by-trial visual feedback about their articulation alongside that of the same vowels produced by native speakers. The Mahalanobis acoustic distance between non-native productions and target native acoustic spaces was used to assess L2 production accuracy. The experiment shows that 1 h of training per vowel improves the production of four non-native Danish vowels: the learners' productions were closer to the corresponding Danish target vowels after training. The production performance of a control group remained unchanged. Comparisons of pre- and post-training vowel discrimination performance in the experimental group showed improvements in perception. Correlational analyses of training-related changes in production and perception revealed no relationship. These results suggest, first, that this training method is effective in improving non-native vowel production. Second, training purely on production improves perception. Finally, it appears that improvements in production and perception do not systematically progress at equal rates within individuals.

[1]  Christophe Pallier,et al.  Anatomical correlates of foreign speech sound production. , 2006, Cerebral cortex.

[2]  Bryan Gick,et al.  Ultrasound Technology and SecondLanguage Acquisition Research , 2006 .

[3]  Janice Wing Sze Wong,et al.  The effects of perceptual and/or productive training on the perception and production of English vowels /ɪ/ and /iː/ by Cantonese ESL learners , 2013, INTERSPEECH.

[4]  Hans Basbøll,et al.  The phonology of Danish , 2005 .

[5]  David B. Pisoni,et al.  Auditory vs. Articulatory Training in Exotic Sounds. , 1970 .

[6]  Teresa Lopez-Soto,et al.  Relation of perception training to production of codas in English as a Second Language , 2009 .

[7]  Hideki Kawahara,et al.  Computer-based second language production training by using spectrographic representation and HMM-based speech recognition scores , 1998, ICSLP.

[8]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[9]  Philip C. Loizou,et al.  COLEA: A MATLAB software tool for speech analysis , 1998 .

[10]  Daniel R. Lametti,et al.  Plasticity in the Human Speech Motor System Drives Changes in Speech Perception , 2014, The Journal of Neuroscience.

[11]  D. Pisoni,et al.  Training Japanese listeners to identify English /r/ and /l/. II: The role of phonetic environment and talker variability in learning new perceptual categories. , 1993, The Journal of the Acoustical Society of America.

[12]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[13]  James Emil Flege,et al.  Factors affecting degree of foreign accent in an L2: a review , 2001, J. Phonetics.

[14]  Preben Wik.  Designing a virtual language tutor , 2004 .

[15]  W. Strange,et al.  The acquisition of /r/ and /l/ by Japanese learners of English: Evidence that speech production can precede speech perception , 1982, Applied Psycholinguistics.

[16]  Ulrich H. Frauenfelder,et al.  On the effects of L2 perception and of individual differences in L1 production on L2 pronunciation , 2014, Front. Psychol..

[17]  J. H. Leather,et al.  Interrelation of perceptual and productive learning in the initial acquisition of second language tone , 1996 .

[18]  Frank H. Guenther,et al.  A neural network model of speech acquisition and motor equivalent speech production , 2004, Biological Cybernetics.

[19]  Sharon Peperkamp,et al.  The Relation Between Perception and Production in L2 Phonological Processing , 2011, INTERSPEECH.

[20]  Claire Pillot-Loiseau,et al.  Contribution of ultrasound visualisation to improving the production of the French /y/-/u/ contrast by four Japanese learners , 2013 .

[21]  D. Pisoni,et al.  Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production. , 1997, The Journal of the Acoustical Society of America.

[22]  Laurent Dekydtspotter,et al.  Direct mapping of acoustics to phonology: On the lexical encoding of front rounded vowels in L1 English– L2 French acquisition , 2012 .

[23]  Louis-Jean Boë,et al.  Auditory normalization of French vowels synthesized by an articulatory model simulating growth from birth to adulthood. , 2002, The Journal of the Acoustical Society of America.

[24]  Michael Carey,et al.  CALL Visual Feedback for Pronunciation of Vowels: Kay Sona-Match , 2015 .

[25]  Anne-Marie Öster.  Auditory and Visual Feedback in Spoken L 2 Teaching , 2007 .

[26]  Paul Boersma,et al.  Bridging the gap between second-language speech perception research and phonological theory , 2004 .

[27]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[28]  Patrick C M Wong,et al.  Learning a novel phonological contrast depends on interactions between individual differences and training paradigm design. , 2011, The Journal of the Acoustical Society of America.

[29]  F. Alario,et al.  The Functional Origin of the Foreign Accent , 2010, Psychological science.

[30]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[31]  Véronique Delvaux,et al.  Production training in second language acquisition: a comparison between objective measures and subjective judgments , 2013, INTERSPEECH.

[32]  C. Pallier,et al.  The Influence of Native-Language Phonology on Lexical Access: Exemplar-Based Versus Abstract Lexical Entries , 2001, Psychological science.

[33]  Slim Ouni,et al.  Pronunciation training: the role of eye and ear , 2008, INTERSPEECH.

[34]  R. Lyster,et al.  Effects of Form-Focused Instruction and Corrective Feedback on L2 Pronunciation Development of /ɹ/ by Japanese Learners of English , 2012 .

[35]  John R. Lindsay Smith,et al.  Learning to Pronounce Vowel Sounds in a Foreign Language using Acoustic Measurements of the Vocal Tract as Feedback in Real Time , 1998 .

[36]  J. Flege,et al.  Interactions between the Native and Second-language Phonetic Systems , 2001 .

[37]  Michael Erb,et al.  Language aptitude for pronunciation in advanced second language (L2) Learners: Behavioural predictors and neural substrates , 2013, Brain and Language.

[38]  See-Gyoon Park,et al.  Cross-language vowel perception and production by Japanese and Korean learners of English , 1997 .

[39]  J. Flege.  Second Language Speech Learning Theory , Findings , and Problems , 2006 .

[40]  Matthew H. Davis,et al.  Learning and Consolidation of Novel Spoken Words , 2009, Journal of Cognitive Neuroscience.

[41]  Robert Leech,et al.  A comparison of sensory-motor activity during speech in first and second languages. , 2011, Journal of neurophysiology.

[42]  I. R. MacKay,et al.  Native Italian speakers' perception and production of English vowels. , 1999, The Journal of the Acoustical Society of America.

[43]  Anja K. Steinlen.  The influence of consonants on native and non-native vowel production : a cross-linguistic study , 2005 .

[44]  R. McCrae Cochrane,et al.  The acquisition of /r/ and /l/ by Japanese children and adults learning English as a second language , 1980 .