Synthetic Speech in Computer-Enhanced Foreign Language Learning

The goal of this chapter is to explain several experiments carried out by our research group to explore whether synthetic speech can be currently used to replace natural speech in listening materials for foreign language learning or not. For CALL purposes, synthetic speech in English was evaluated from the viewpoints of both foreign language learners and teachers. We conducted several surveys: (a) to find out if the synthetic speech generated by current TTS engines is as efficient as natural speech in training listening skills, (b) to identify the specific ways in which the evaluated synthetic speech is as good as natural speech, (c) to determine the relationship between changes in individual listening comprehension ability and the results of the quality evaluations of synthetic speech, and (d) to discuss the possible approaches for using synthetic speeches.

[1]  J. Rubin A Review of Second Language Listening Comprehension Research , 1994 .

[2]  Ilya Yaroslavsky,et al.  Persuasion and social perception of human vs. synthetic voice across person as source and computer as source conditions , 2006, Int. J. Hum. Comput. Stud..

[3]  Cristina Delogu,et al.  Cognitive factors in the evaluation of synthetic speech , 1998, Speech Commun..

[4]  Debra Hoven,et al.  A model for listening and viewing comprehension in multimedia environments , 1999 .

[5]  Carol A. Chapelle,et al.  Multimedia CALL: Lessons to be Learned from Research on Instructed SLA , 1998 .

[6]  Yu-Chih Sun,et al.  VOICE BLOG: AN EXPLORATORY STUDY OF LANGUAGE LEARNING , 2009 .

[7]  W. Strange,et al.  Effects of discrimination training on the perception of /r-l/ by Japanese adults learning English , 1984, Perception & psychophysics.

[8]  Marie-Josée Hamel,et al.  Establishing a Methodology for Benchmarking Speech Synthesis for Computer-Assisted Language Learning (CALL). , 2005 .

[9]  Hossein Nassaji The Relationship between Depth of Vocabulary Knowledge and L2 Learners' Lexical Inferencing Strategy Use and Success , 2004 .

[10]  Murray J. Munro,et al.  Computer-Based Training for Learning English Vowel Contrasts. , 2004 .

[11]  John L. Arnott,et al.  Emotional stress in synthetic speech: Progress and future directions , 1996, Speech Commun..

[12]  Alexander L. Francis,et al.  Effects of training on the acoustic phonetic representation of synthetic speech. , 2007, Journal of speech, language, and hearing research : JSLHR.

[13]  D. Jamieson,et al.  Training non-native speech contrasts in adults: Acquisition of the English /ð/-/θ/ contrast by francophones , 1986 .