Head-mounted display-based intuitive virtual reality training system for the mining industry

Abstract Virtual reality (VR) training technology in the mining industry is a new field of research and utilization. The successful application of VR training system is critical to mine safety and production. Through the statistics of the current research and applications of VR training systems in mining industry, all the input/output devices are classified. Based on the classifications of the input/output devices that are used in the VR system, the current VR training systems for the mining industry could be divided into three types: screen-based general type, projector-based customized type, and head-mounted display (HMD)-based intuitive type. By employing a VR headset, a smartphone and a leap motion device, an HMD-based intuitive type VR training system prototype for drilling in underground mines has been developed. Ten trainees tried both the HMD-based intuitive system and the screen-based general control system to compare the experiences and training effects. The results show that the HMD-based system can give a much better user experience and is easy to use. Three of the five components of a VR training system, namely, the user, the tasks, and software and database should be given more attention in future research. With more available technologies of input and output devices, VR engines, and system software, the VR training system will eventually yield much better training results, and will play a more important role in as a training tool for mine safety.

[1]  Jason Lucas,et al.  Using virtual reality (VR) to improve conveyor belt safety in surface mining , 2007 .

[2]  Ulrike Cress,et al.  Virtual training: Making reality work? , 2022 .

[3]  P. Stothard,et al.  Taxonomy of interactive computer-based visualisation systems and content for the mining industry – part 2 , 2015 .

[4]  Mehmet S. Kizil,et al.  What can virtual reality do for safety , 2001 .

[5]  Robin Burgess-Limerick,et al.  A Review of Virtual Reality as a Medium for Safety Related Training in Mining , 2011 .

[6]  Tomasz P. Bednarz,et al.  Human-Computer Interaction Experiments Immersive Virtual Reality Applications for the Mining Industry , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[7]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[8]  Carlo H. Séquin,et al.  Interactive simulation of fire in virtual building environments , 1997, SIGGRAPH.

[9]  Domen Novak,et al.  Virtual Reality Technology and Applications , 2013 .

[10]  Jarosław Jankowski,et al.  Virtual Reality-based pilot training for underground coal miners , 2015 .

[11]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, ACM Trans. Graph..

[12]  Qinping Zhao,et al.  A survey on virtual reality , 2009, Science in China Series F: Information Sciences.

[13]  Shiva Pedram,et al.  A Systematic Approach to Evaluate the Role of Virtual Reality as a Safety Training Tool in the Context of the Mining Industry , 2016 .

[14]  A. Foster,et al.  Virtual reality in improving mining ergonomics , 2004 .

[15]  T. J. Orr,et al.  Enhanced fire escape training for mine workers using virtual reality simulation , 2009 .

[16]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[17]  Michael Bosse,et al.  Efficient Large‐scale Three‐dimensional Mobile Mapping for Underground Mines , 2014, J. Field Robotics.

[18]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[19]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[20]  Eric D. Ragan,et al.  The Effects of Higher Levels of Immersion on Procedure Memorization Performance and Implications for Educational Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[21]  Christine Zupanc,et al.  Effect of Age on Learning to Drive a Virtual Coal Mine Shuttle Car , 2011 .

[22]  Andrew Squelch,et al.  Virtual reality for mine safety training in South Africa , 2001 .

[23]  Tomasz Bednarz,et al.  Distributed Collaborative Immersive Virtual Reality Framework for the Mining Industry , 2015 .