TeachAR: An Interactive Augmented Reality Tool for Teaching Basic English to Non-native Children

TeachAR is an Augmented Reality (AR) tool for teaching English colors, shapes, and spatial relationships to young children aged 4 to 6 years old who are non-native speakers of English. TeachAR utilizes the ARToolkit plugin for the Unity game engine for square marker tracking and game development. The Microsoft Kinect's microphone and speech API is used for isolated word speech recognition, a webcam for image capturing and a desktop monitor for viewing the AR scene. Previous language learning AR applications usually use audio output, however TeachAR uses speech as input for language learning. This paper describes the TeachAR demonstration and user experience with the application.

[1]  Mark Billinghurst,et al.  Zengo Sayu: An Immersive Educational Environment for Learning Japanese , 1995 .

[2]  Mihaela Vorvoreanu,et al.  A Pilot Study Exploring Augmented Reality to Increase Motivation of Chinese College Students Learning English , 2014 .

[3]  Eva Hornecker,et al.  Supporting Early Literacy with Augmented Books - Experiences with an Exploratory Study , 2007, GI Jahrestagung.

[4]  Yu-Ju Lan,et al.  Language Learning in Virtual Reality Environments: Past, Present, and Future , 2015, J. Educ. Technol. Soc..

[5]  Ramu Parupalli,et al.  Mobile augmented reality application for Telugu language learning , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[6]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[7]  Matthew Kam,et al.  Improving literacy in developing countries using speech recognition-supported games on mobile devices , 2012, CHI.

[8]  Martin White,et al.  Web3D and Augmented Reality to support engineering education , 2004 .

[9]  Daniel Wagner,et al.  Augmented reality kanji learning , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[10]  Hannes Kaufmann,et al.  General Training of Spatial Abilities by Geometry Education in Augmented Reality , 2006 .

[11]  M. Bessa,et al.  MOW: Augmented Reality game to learn words in different languages: Case study: Learning English names of animals in elementary school , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[12]  Brett E. Shelton,et al.  Using coordination classes to interpret conceptual change in astronomical thinking , 2004 .

[13]  Matthew Turk,et al.  TranslatAR: A mobile augmented reality translator , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[14]  Chin-Hsing Chen,et al.  Investigating students' perceived satisfaction, behavioral intention, and effectiveness of English learning using augmented reality , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[15]  Mark Billinghurst,et al.  Augmented Reality in the Classroom , 2012, Computer.

[16]  Maria del Carmen Juan Lizandra,et al.  Learning Words Using Augmented Reality , 2010, 2010 10th IEEE International Conference on Advanced Learning Technologies.

[17]  Arash Habibi Lashkari,et al.  Ubiquitous Mobile Real Time Visual Translator Using Augmented Reality for Bahasa Language , 2013 .