Mobile speech recognition software: A tool for teaching second language pronunciation

This study examines the impact of the pedagogical use of mobile automatic speech recognition software (ASR) on the acquisition of the French vowel /y/ in production and perception. The participants were 42 beginner French students with no previous training in French phonetics and exposure to speech recognition software. They were divided into three experimental groups: (1) the ASR Group used an ASR application installed on their mobile devices to complete weekly pronunciation activities, with immediate written visual (textual) feedback provided by the software; (2) the Non-ASR Group completed the same weekly pronunciation activities in individual weekly sessions with a teacher, who provided immediate oral feedback using recast and repetitions; finally, (3) the Control Group participated in weekly individual meetings “to practice their conversation skills” with a teacher, who provided no pronunciation feedback. Following a pre-test/post-test design, our findings indicate that the ASR Group outperformed the other groups in French /y/ production, but not in perception.

[1]  Ronald P. Leow,et al.  Computerized Task-Based Exposure, Explicitness, Type of Feedback, and Spanish L2 Development , 2004 .

[2]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[3]  Keikichi Hirose,et al.  Teaching the pronunciation of Japanese double-mora phonemes using speech recognition technology , 2000, Speech Commun..

[4]  Yik-Cheung Tam,et al.  PLASER: Pronunciation Learning via Automatic Speech Recognition , 2003, HLT-NAACL 2003.

[5]  Maxine Eskenazi,et al.  USING AUTOMATIC SPEECH PROCESSING FOR FOREIGN LANGUAGE PRONUNCIATION TUTORING: SOME ISSUES AND A PROTOTYPE , 1999 .

[6]  Patricia Thornton,et al.  Using mobile phones in English education in Japan , 2005, J. Comput. Assist. Learn..

[7]  Debra M. Hardison.  Contextualized Computer-based L2 Prosody Training: Evaluating the Effects of Discourse Context and Video Input , 2013 .

[8]  H. Goto,et al.  Auditory perception by normal Japanese adults of the sounds "L" and "R". , 1971, Neuropsychologia.

[9]  D. Pisoni,et al.  Training Japanese listeners to identify English /r/ and /l/: a first report. , 1991, The Journal of the Acoustical Society of America.

[10]  Amy Sheldon.  THE RELATIONSHIP BETWEEN PRODUCTION AND PERCEPTION OF THE /r/‐/I/ CONTRAST IN KOREAN ADULTS LEARNING ENGLISH: A REPLY TO BORDEN, GERBER, AND MILS ARK1 , 1985 .

[11]  Amy Sheldon,et al.  Duration and Context Effects on the Perception of English /r/ and /l/: A Comparison of Cantonese and Japanese Speakers. , 1986 .

[12]  Diane Kewley-Port,et al.  Explicit Pronunciation Training Using Automatic Speech Recognition Technology , 2013 .

[13]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[14]  Dorothy M. Chun.  SIGNAL ANALYSIS SOFTWARE FOR TEACHING DISCOURSE INTONATION , 1998 .

[15]  Erika S. Levy,et al.  Production of French vowels by American-English learners of French: language experience, consonantal context, and the perception-production relationship. , 2010, The Journal of the Acoustical Society of America.

[16]  W. Littlewood.  The Task-Based Approach: Some Questions and Suggestions. , 2004 .

[17]  Kazumi Aizawa,et al.  Cell phones in task based learning - Are cell phones useful language learning tools? , 2004, ReCALL.

[18]  John M. Levis,et al.  COMPUTER TECHNOLOGY IN TEACHING AND RESEARCHING PRONUNCIATION , 2007, Annual Review of Applied Linguistics.

[19]  Erika S. Levy,et al.  Perception of French vowels by American English adults with and without French language experience , 2008, J. Phonetics.

[20]  Laura Catharine Smith,et al.  The Impact of L2 Dialect on Learning French Vowels: Native English Speakers Learning Québécois and European French , 2010 .

[21]  Vassilios Digalakis,et al.  Combination of machine scores for automatic grading of pronunciation quality , 2000, Speech Commun..

[22]  Rebecca Hincks.  Speech technologies for pronunciation feedback and evaluation , 2003, ReCALL.

[23]  Tracey M. Derwing,et al.  Evidence in Favor of a Broad Framework for Pronunciation Instruction , 1998 .

[24]  Steve J. Young,et al.  Phone-level pronunciation scoring and assessment for interactive language learning , 2000, Speech Commun..

[25]  Derek O. Bruff,et al.  Teaching with Classroom Response Systems: Creating Active Learning Environments , 2009 .

[26]  D. Pisoni,et al.  Training Japanese listeners to identify English /r/ and /l/. III. Long-term retention of new phonetic categories. , 1994, The Journal of the Acoustical Society of America.

[27]  David Nunan,et al.  Task-Based Language Teaching: A unit of work based on the six-step procedure presented in Chapter 2 , 2004 .

[28]  Stephen A LaRocca,et al.  On the Path to 2X Learning: Exploring the Possibilities of Advanced Speech Recognition. , 1999 .

[29]  Robert Godwin-Jones,et al.  EMERGING TECHNOLOGIES PERSONAL LEARNING ENVIRONMENTS , 2009 .

[30]  R. Dekeyser.  The effect of error correction on L2 grammar knowledge and oral proficiency , 1993 .

[31]  In-Seok Kim,et al.  Automatic Speech Recognition: Reliability and Pedagogical Implications for Teaching Pronunciation , 2006, J. Educ. Technol. Soc..

[32]  Claire Kennedy,et al.  L'italiano al telefonino: Using SMS to support beginners' language learning1 , 2008, ReCALL.

[33]  M. Warschauer.  Comparing Face-To-Face and Electronic Discussion in the Second Language Classroom , 2013, CALICO Journal.

[34]  Diego Giuliani,et al.  The effectiveness of computer assisted pronunciation training for foreign language learning by children , 2008 .

[35]  Kukulska-hulmeAgnes,et al.  An overview of mobile assisted language learning , 2008 .

[36]  Dorothy M. Chun,et al.  Effects of Multimedia Annotations on Vocabulary Acquisition , 1996 .

[37]  Michael Levy,et al.  Computer applications in second language acquisition : Foundations for teaching , testing and research , 2009 .

[38]  Robert D. King,et al.  Functional Load and Sound Change , 1967 .

[39]  Azizollah Dabaghi.  Corrective feedback in second languge acquisition : theory, research and practice , 2010 .

[40]  Rebecca Hincks,et al.  Measures and perceptions of liveliness in student oral presentation speech: A proposal for an automatic feedback mechanism , 2005 .

[41]  Silke M. Witt,et al.  Use of speech recognition in computer-assisted language learning , 2000 .

[42]  George Yule,et al.  Attempts to Improve English L2 Pronunciation: The Variable Effects of Different Types of Instruction , 1994 .

[43]  D. Pisoni,et al.  Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production. , 1997, The Journal of the Acoustical Society of America.

[44]  Jennifer Jenkins,et al.  The Phonology of English as an International Language: New Models, New Norms, New Goals , 2000 .

[45]  Glenn Stockwell,et al.  Investigating learner preparedness for and usage patterns of mobile learning , 2008, ReCALL.

[46]  Jack Mostow,et al.  Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You're Certain , 2013, CALICO Journal.

[47]  J. Flege.  Second Language Speech Learning Theory , Findings , and Problems , 2006 .