The Usability of the Microsoft HoloLens for an Augmented Reality Game to Teach Elementary School Children

Our objective in this research is to compare the usability of three distinct head gaze-based selection methods in an Augmented Reality (AR) hidden object game for children: voice recognition, gesture, and physical button (clicker). Prior work on AR applications in STEM education has focused on how it compares with non-AR methods rather than how children respond to different interaction modalities. We investigated the differences between voice, gesture, and clicker based interaction methods based on the metrics of input errors produced and elapsed time to complete the tutorial and game. We found significant differences in input errors between the voice and gesture conditions, and in elapsed tutorial time between the voice and clicker conditions. We hope to apply the results of our study to improve the interface for AR educational games aimed at children, which could pave the way for greater adoption of AR games in schools.

[1]  Tony Belpaeme,et al.  Child Speech Recognition in Human-Robot Interaction: Evaluations and Recommendations , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[2]  Yvonne Kao,et al.  Discovering educational augmented reality math applications by prototyping with elementary-school teachers , 2016, 2016 IEEE Virtual Reality (VR).

[3]  Cate LaPlante,et al.  PlayScope: augmented microscopy as a tool to increase STEM engagement , 2017, FDG.

[4]  Emiel Krahmer,et al.  Child-Robot Interactions for Second Language Tutoring to Preschool Children , 2017, Front. Hum. Neurosci..

[5]  Johanna Beyer,et al.  The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? , 2018, IEEE Transactions on Visualization and Computer Graphics.

[6]  Shamus P. Smith,et al.  Asking ethical questions in research using immersive virtual and augmented reality technologies with children and youth , 2017, 2017 IEEE Virtual Reality (VR).

[7]  Veronica Teichrieb,et al.  Towards the development of guidelines for educational evaluation of augmented reality tools , 2016, 2016 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR).

[8]  Susan A. Yoon,et al.  How Augmented Reality Enables Conceptual Understanding of Challenging Science Content , 2017, J. Educ. Technol. Soc..

[9]  Anup Basu,et al.  Multimodal interaction in augmented reality , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).