Using HMD for Immersive Training of Voice-Based Operation of Small Unmanned Ground Vehicles

Voice recognition systems provide a method of hands-free control of robotic systems that may be helpful in law enforcement or military domains. However, the constraints of the operational environment limit the capabilities of the on-board voice recognition system to a keyword-based command system. To effectively use the system, the users must learn the available commands and practice pronunciation to ensure accurate recognition. Virtual reality simulation provides users the opportunity to train with the voice recognition system and the robot platform in realistic interactive scenarios. Training using virtual reality with a head-mounted display may increase immersion and sense of presence compared to using a keyboard and monitor. A small pilot study compared user experience in the desktop mode and the virtual reality mode of our voice recognition system training tool. Participants controlled a simulated unmanned ground vehicle in two different modes across four different environments. The results revealed no significant differences in simulator sickness, sense of presence, or perceived usability. However, when asked to choose between the desktop mode and the head-mounted display mode, results indicate users’ overall preference for the head-mounted display. However, the users also perceive the head-mounted display to be more complex, less consistent, and more difficult to learn to use. The desktop mode was perceived as easier to use and users reported being more confident when using it.

[1]  Emilie Loup-Escande,et al.  Effects of Travel Modes on Performances and User Comfort: A Comparison between ArmSwinger and Teleporting , 2018, Int. J. Hum. Comput. Interact..

[2]  Rajiv V. Dubey,et al.  Point & Teleport Locomotion Technique for Virtual Reality , 2016, CHI PLAY.

[3]  Kouta Minamizawa,et al.  FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs , 2017, MobileHCI.

[4]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[5]  Sarah Sharples,et al.  Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems , 2008, Displays.

[6]  Samuel S. Silva,et al.  Head-mounted display versus desktop for 3D navigation in virtual reality: a user study , 2008, Multimedia Tools and Applications.

[7]  Cathy O Neil.  DAWN OF THE NEW EVERYTHING Encounters with Reality and Virtual Reality By Jaron Lanier; EXPERIENCE ON DEMAND What Virtual Reality Is, How It Works, and What It Can Do By Jeremy Bailenson , 2018 .

[8]  Richard H. Y. So,et al.  Effects of Navigation Speed on Motion Sickness Caused by an Immersive Virtual Environment , 2001, Hum. Factors.

[9]  Ke Chen,et al.  Study on Thermal Comfort of Virtual Reality Headsets , 2018, Advances in Human Factors in Wearable Technologies and Game Design.

[10]  Gerd Bruder,et al.  Assessing vignetting as a means to reduce VR sickness during amplified head rotations , 2018, SAP.

[11]  John L. Salmon,et al.  Exploration and evaluation of CAD modeling in virtual reality , 2017 .

[12]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[13]  Bernd Fröhlich,et al.  Spatial Updating and Simulator Sickness During Steering and Jumping in Immersive Virtual Environments , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[14]  Michael E. McCauley,et al.  Cybersickness: Perception of Self-Motion in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[15]  Markus Funk,et al.  Comparing Learning in Virtual Reality with Learning on a 2D Screen Using Electrostatics Activities , 2018, J. Univers. Comput. Sci..

[16]  Laure Leroy,et al.  Eyestrain impacts on learning job interview with a serious game in virtual reality: a randomized double-blinded study , 2018, VRST.

[17]  Shu-Hsuan Chang,et al.  Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments , 2018, Virtual Reality.

[18]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[19]  Flemming Konradsen,et al.  A review of the use of virtual reality head-mounted displays in education and training , 2017, Education and Information Technologies.

[20]  Jozef Juhar,et al.  Implementation of a Speech Enabled Virtual Reality Training Tool for Human-Robot Interaction , 2018, 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA).

[21]  Jozef Juhar,et al.  A training tool for speech driven human-robot interaction applications , 2017, 2017 15th International Conference on Emerging eLearning Technologies and Applications (ICETA).

[22]  Robert W. Lindeman,et al.  The Effect of Immersive Displays on Situation Awareness in Virtual Environments for Aerial Firefighting Air Attack Supervisor Training , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[23]  Jozef Juhar,et al.  Implementing English speech interface to Jaguar robot for SWAT training , 2017, 2017 IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[24]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[25]  Azra Habibovic,et al.  A Head-Mounted Display to Support Teleoperations of Shared Automated Vehicles , 2017, International Conference on Automotive User Interfaces and Interactive Vehicular Applications.

[26]  J. Edward Swan,et al.  A New Traversal Method for Virtual Reality: - Overcoming the Drawbacks of Commonly Accepted Methods , 2019, HCI.

[27]  Mourtzis Dimitris,et al.  A Virtual Reality Application to Attract Young Talents to Manufacturing , 2016 .

[28]  Sharif Razzaque,et al.  Comparing VE locomotion interfaces , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[29]  Robert J. Teather,et al.  Viewpoint Snapping to Reduce Cybersickness in Virtual Reality , 2018, Graphics Interface.