Virtual Reality procedure training simulators in X3D

Virtual Reality procedure training simulators require that users perform actions in a specific order during the procedure. Recent advances in 3D Web technologies, such as Web3D, HTML5 and WebGL, have allowed complex 3D scenes to be rendered interactively, within a web browser. However, designing and implementing a complete VR procedure training application using these standards is complex and not straightforward. In this paper we present X3D nodes that overcome these limitations and allow procedure training scenarios to be described within X3D. Moreover, using X3DOM to implement these nodes allows training scenarios to run within any standard web browser, without the need to install additional plugins. In particular, we propose three new nodes. These nodes define additional layers that allow relationships and dependencies between geometric entities to be created. They provide the necessary means to develop VR procedure training simulators using X3D. Finally, we have developed a training application targeted at maintenance of hydro-electrical power plants using Petri-nets to validate our proposal.

[1]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[2]  Michiel van de Panne,et al.  Sensor-actuator networks , 1993, SIGGRAPH.

[3]  Yiannis E. Papelis,et al.  HCSM: a framework for behavior and scenario control in virtual environments , 1995, TOMC.

[4]  Tamer M. Wasfy,et al.  Intelligent virtual environment for process training , 2004 .

[5]  Samuil Angelov,et al.  Petri Net Technology for Communication-Based Systems , 2003, Lecture Notes in Computer Science.

[6]  Bruno Arnaldi,et al.  STORM: a Generic Interaction and Behavioral Model for 3D Objects and Humanoids in a Virtual Environment , 2007, EGVE.

[7]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[8]  Ulrich Bockholt,et al.  Using X3D for medical training simulations , 2008, Web3D '08.

[9]  Felix G. Hamza-Lup,et al.  Extending the Web3D: design of conventional GUI libraries in X3D , 2010, Web3D '10.

[10]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[11]  Demis Corvaglia,et al.  Virtual Training for Manufacturing and Maintenance based on Web 3 D Technologies , 2004 .

[12]  Bruno Arnaldi,et al.  GVT: a platform to create virtual environments for procedural training , 2008, 2008 IEEE Virtual Reality Conference.

[13]  Vincent G. Duffy,et al.  Developing virtual environments for industrial training , 2002, Inf. Sci..

[14]  Michael Zöllner,et al.  X3DOM: a DOM-based HTML5/X3D integration model , 2009, Web3D '09.

[15]  Ekkart Kindler,et al.  The Petri Net Markup Language , 2003, Petri Net Technology for Communication-Based Systems.

[16]  George Papagiannakis,et al.  Immersive VR decision training: telling interactive stories featuring advanced virtual human simulation technologies , 2003 .

[17]  Parvati Dev,et al.  Virtual worlds and team training. , 2007, Anesthesiology clinics.