Enhancing speech recognition in developing language learning systems for low cost Androids

Learning to read correctly is a key requirement of language learning. In rural India, due to lack of teachers and technology, tablets offer a creative and motivating learning environment. Tablet technology has the advantage of mobility, allowing users to learn at their own pace and convenience. However, the non-availability of electricity and Internet can be unique challenges. At Amrita CREATE, language-learning solutions have been developed for students to learn and read on the tablets. It uses advanced speech recognition technique to provide feedback and intervention. Proposed system is unique in its ability to evaluate words and phrases and corrects the learner as they articulate the sentence. This system works without Internet and on the lower processing power of android tablets. Silence detection and multiple-synchronized recognition have been introduced in this paper which greatly enhance the ability to provide feedback to the user in real-time. The combination of the two helps in achieving successful recognition of longer and continuous sentence.

[1]  L. Uzun The Internet and computer enhanced foreign language learning and intercultural communication , 2012 .

[2]  Raghu Raman,et al.  Low cost tablet enhanced pedagogy for early grade reading: Indian context , 2014, 2014 IEEE Region 10 Humanitarian Technology Conference (R10 HTC).

[3]  Steve J. Young,et al.  Phone-level pronunciation scoring and assessment for interactive language learning , 2000, Speech Commun..

[4]  Mitch Weintraub,et al.  Automatic text-independent pronunciation scoring of foreign language student speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[5]  JackMervyn,et al.  Interactive language learning through speech-enabled virtual scenarios , 2012 .

[6]  Maxine Eskénazi,et al.  An overview of spoken language technology for education , 2009, Speech Commun..

[7]  Hsiao-Wuen Hon,et al.  An overview of the SPHINX speech recognition system , 1990, IEEE Trans. Acoust. Speech Signal Process..

[8]  Raghu Raman,et al.  A new approach to personalization: integrating e-learning and m-learning , 2012 .

[9]  Qin Lu,et al.  A Computer Assisted Language Learning System based on Error Trends Grouping , 2007, 2007 International Conference on Natural Language Processing and Knowledge Engineering.

[10]  Ronanki Srikanth,et al.  Automatic Pronunciation Scoring And Mispronunciation Detection Using CMUSphinx , 2012 .

[11]  Kristin Precoda,et al.  The SRI EduSpeak System: Recognition and Pronunciation Scoring for Language Learning , 2007 .

[12]  Mervyn A. Jack,et al.  Interactive Language Learning through Speech-Enabled Virtual Scenarios , 2012, Adv. Hum. Comput. Interact..

[13]  Farzad Ehsani,et al.  Speech Technology in Computer-Assisted Language Learning: Strengths and Limitations of a New CALL Paradigm. , 1998 .

[14]  Rodolfo Delmonte A Prosodic Module for Self-Learning Activities , 2002 .