Prototyping Virtual Learning Environment with HMD and Touchless Interface for Hearing Impaired Learners

The purpose of the study was to identify key design features of virtual reality with HMD and touchless interface for the deaf and hard-of-hearing learners. To improve spatial reasoning ability of hearing impaired learners in machine operating learning, we developed immersive virtual environment prototype with head mounted display (Oculus Rift) and touchless natural user interface (Leap Motion). To figure out key design features of virtual reality for the deaf and hard-of-hearing learners, two times usability tests of the prototype were conducted. After the usability tests of hearing impaired students’ exploring the 3D virtual space, interviews were conducted. Two consecutive usability tests’ results revealed several features in the system that are in need of revision as well as the potential to help hearing impaired learners by providing realistic and immersive learning experiences. Further revision of the system is needed by considering both learners’ physical and cognitive characteristics.