A Study of the Design and Implementation of the ASR-based iCASL System with Corrective Feedback to Facilitate English Learning

The purpose of the study is to explore and describe how to implement a pedagogical ASR-based intelligent computer-assisted speaking learning (iCASL) system to support adult learners with a private, flexible and individual learning environment to practice English pronunciation. The iCASL system integrates multiple levels of corrective feedback and allows learners to practice English speaking with immediate diagnosis of their utterances. The information of the multiple levels of feedback includes a list of words that are pronounced accurately and inaccurately, while audio recasting and demonstration of model utterances are adopted to facilitate speaking. To evaluate the effectiveness of the system, a total of 38 adults from Taiwan participated in this experiment, divided into an experimental and a control group. The control group practiced English speaking using the single-level-feedback system in which only a speaking score and waveform diagram was presented as feedback, while the experimental group was given the three-level-feedback iCASL system integrating implicit and explicit elements in the feedback presentation. The empirical evaluation reveals that there were significant differences between the pre-test and post-test speaking scores only for the learners with three-level-feedback iCASL system. The study is in accordance with the previous research that indicates specific feedback is needed and helpful for further enhancing their English pronunciation. Within the three-level feedback, the second level, which provides an explicit textual description with immediate recasting of the learners' utterances, is the most useful feedback for self-correcting learning. The learners received simultaneous dual information from the audio and visual presentation and hence had better potential to improve their English speaking than the learners who were provided with single modality feedback. Moreover, the learners were satisfied with the iCASL system for self-paced learning and they mentioned that the path suggestion function was especially beneficial because it helped them to manage their learning. The adult learners used the accumulated fragmented time of the informal learning opportunities to achieve improvement in their spoken language. Some research issues and suggestions are also presented for future reference.

[1]  Eric W. Hawkins,et al.  Modern Languages in the Curriculum , 1981 .

[2]  Fang Xu,et al.  The Role of Input and Interaction in Second Language Acquisition , 2010 .

[3]  Diego Giuliani,et al.  The effectiveness of computer assisted pronunciation training for foreign language learning by children , 2008 .

[4]  Kukulska-hulmeAgnes,et al.  An overview of mobile assisted language learning , 2008 .

[5]  Stephen G. Lambacher,et al.  A CALL Tool for Improving Second Language Acquisition of English Consonants by Japanese Learners. , 1999 .

[6]  Ya‐Chen Su,et al.  EFL teachers’ perceptions of English language policy at the elementary level in Taiwan , 2006 .

[7]  Shelley Shwu-Ching Young,et al.  Exploring young and adult learners' perceptions of corrective feedback in ASR-based CALL system , 2012, Br. J. Educ. Technol..

[8]  Olle Bälter,et al.  Designing the user interface of the computer-based speech training system ARTUR based on early user tests , 2006, Behav. Inf. Technol..

[9]  Richard Young,et al.  The Impact of Interaction on Comprehension , 1987 .

[10]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[11]  R. Lyster,et al.  CORRECTIVE FEEDBACK AND LEARNER UPTAKE , 1997, Studies in Second Language Acquisition.

[12]  Olle Bälter,et al.  Pronunciation feedback from real and virtual language teachers , 2007 .

[13]  Pao-Ta Yu,et al.  A Multimedia English Learning System Using HMMs to Improve Phonemic Awareness for English Learning , 2009, J. Educ. Technol. Soc..

[14]  In-Seok Kim,et al.  Automatic Speech Recognition: Reliability and Pedagogical Implications for Teaching Pronunciation , 2006, J. Educ. Technol. Soc..

[15]  Martha Bigelow,et al.  Literacy and the Processing of Oral Recasts in SLA. , 2006 .

[16]  Hsien-Chin Liou,et al.  A Study of web-based oral activities enhanced by Automatic Speech Recognition for EFL college learning , 2007 .

[17]  Charles Xiaoxue Wang,et al.  Integrating Second Life into an EFL Program in China: Research Collaboration across the Continents , 2009 .

[18]  Jyh-Shing Roger Jang,et al.  Computer assisted spoken English learning for Chinese in Taiwan , 2004, 2004 International Symposium on Chinese Spoken Language Processing.

[19]  Kuo-En Chang,et al.  The Effect of Concept Mapping to Enhance Text Comprehension and Summarization , 2002 .

[20]  Jui-hsiang Lu,et al.  Applying MyET Oral Practice Database to Upgrade College Students’ English Speaking Ability , 2010 .

[21]  Qing Ma,et al.  Computer assisted vocabulary learning: Design and evaluation , 2006 .

[22]  Alison Mackey,et al.  Interaction research in SLA : A meta-analysis and research synthesis , 2007 .

[23]  Helmer Strik,et al.  The Pedagogy-Technology Interface in Computer Assisted Pronunciation Training , 2002 .

[24]  Marcus Otlowski,et al.  Pronunciation: What are the expectations , 1998 .

[25]  Martha C. Pennington,et al.  Computer-Aided Pronunciation Pedagogy: Promise, Limitations, Directions* , 1999 .

[26]  Jyh-Shing Roger Jang,et al.  Using Tangible Companions for Enhancing Learning English Conversation , 2013, J. Educ. Technol. Soc..

[27]  Susan M. Gass,et al.  Input, Interaction, and Second Language Production , 1994, Studies in Second Language Acquisition.

[28]  Chu-Sing Yang,et al.  Ubiquitous English Learning System with Dynamic Personalized Guidance of Learning Portfolio , 2011, J. Educ. Technol. Soc..

[29]  Recep S. Arslan,et al.  How can the use of blog software facilitate the writing process of English language learners? , 2010 .

[30]  Alison Mackey,et al.  The Role of Input and Interaction in Second Language Acquisition Introduction to the Special Issue , 1998 .

[31]  Howard Hao-Jan Chen.  Developing and evaluating an oral skills training website supported by automatic speech recognition technology* , 2011, ReCALL.

[32]  Wu-Yuin Hwang,et al.  A Mobile Device and Online System with Contextual Familiarity and its Effects on English Learning on Campus , 2010, J. Educ. Technol. Soc..

[33]  Farzad Ehsani,et al.  Speech Technology in Computer-Assisted Language Learning: Strengths and Limitations of a New CALL Paradigm. , 1998 .