Hand Gesture-Based Virtual Reality Training Simulator for Collaboration Rescue of a Railway Accident

Training simulator is an efficient and innovative tool to help users learn professional skills due to its convenience and safety. However, complex human-computer interaction is one of the main disadvantages that limits its effectiveness in safety training, especially for the rescue of a railway accident which requires collaborations. Through designing a set of task-specific hand gestures, we developed a training simulator for the recovery of a railway accident which helps the rescuers learn and practise rescue skills in a life-like environment and gain the firsthand experience. To test the validity of our training simulator, a user experiment is designed to compare it with the controller-based simulator in a between-groups study with 51 participants, focusing on different aspects of effectiveness. The results demonstrate that the hand gesture-based controller can be more efficient and usable to deal with complex interactions than the traditional hand-held controller.

[1]  Taku Komura,et al.  A Virtual Reality Dance Training System Using Motion Capture Technology , 2011, IEEE Transactions on Learning Technologies.

[2]  Zhipeng Tan,et al.  Virtual Reality Based Immersive Telepresence System for Remote Conversation and Collaboration , 2017, AniNex.

[3]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[4]  Jochen Teizer,et al.  A multi-user virtual 3d training environment to advance collaboration among crane operator and ground personnel in blind lifts , 2014 .

[5]  Xiangyu Wang,et al.  Using affective human-machine interface to increase the operation performance in virtual construction crane training system: A novel approach , 2011 .

[6]  Woodrow Barfield,et al.  A Review of Presence and Performance in Virtual Environments , 2000, Int. J. Hum. Comput. Interact..

[7]  Shih-Chung Jessy Kang,et al.  SimCrane 3D+: A crane simulator with kinesthetic and stereoscopic vision , 2013, Adv. Eng. Informatics.

[8]  Delfina Malandrino,et al.  Virtual Reality Interfaces for Interacting with Three-Dimensional Graphs , 2019, Int. J. Hum. Comput. Interact..

[9]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[10]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[11]  Leena Arhippainen,et al.  Gaze tracking and non-touch gesture based interaction method for mobile 3D virtual spaces , 2012, OZCHI.

[12]  Julie A. Jacko,et al.  Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, 12th International Conference, HCI International 2007, Beijing, China, July 22-27, 2007, Proceedings, Part III , 2007, HCI.

[13]  S. Shabala,et al.  Antioxidant Activity in Salt‐Stressed Barley Leaves: Evaluating Time‐ and Age‐Dependence and Suitability for the Use as a Biochemical Marker in Breeding Programs , 2014 .

[14]  Jian J. Zhang,et al.  A VR-based the emergency rescue training system of railway accident , 2018, Entertain. Comput..

[15]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[16]  Gilsoo Jang,et al.  Development of a Virtual Reality Training System for Live-Line Workers , 2006, Int. J. Hum. Comput. Interact..

[17]  Houxiang Zhang,et al.  Virtual reality using gesture recognition for deck operation training , 2017, OCEANS 2017 - Aberdeen.

[18]  Xie Tao,et al.  Design of human computer interaction system of virtual crops based on Leap Motion , 2016 .

[19]  Yong Sang,et al.  Study on an Interactive Truck Crane Simulation Platform Based on Virtual Reality Technology , 2016, Int. J. Distance Educ. Technol..