Petri net-based VR model interactive behaviour specification and control for maintaining training

Virtual reality (VR)-based maintenance training allows the trainee to practice disassembly operations for a maintenance task in a three-dimensional (3D), interactive digital world. To support virtual training, the user interactive behaviour that describes how the trainee interacts with objects in the virtual training environment must be programmed into the VR model. Interactive behaviour programming, however, is usually extensive and complicated, especially when accidental or unexpected events are to be incorporated. In this paper a Petri net (PN)-based approach is proposed to support VR model behaviour programming. The interactive behaviours for the trainee to disassemble a part in the virtual environment are represented by a PN, in which place nodes are used to represent different disassembly states and transition nodes define rules to move a token between places. The PN controls the VR simulation by requiring part disassembly status from the VR model to fire transitions and sending control data to the VR model to modify its behaviour nodes. Several case studies are presented to illustrate how the intuitive, graph-based process description and control language offered by this PN approach to facilitate interactive behaviour programming for VR-based maintenance training.

[1]  Vincent G. Duffy,et al.  Developing virtual environments for industrial training , 2002, Inf. Sci..

[2]  MengChu Zhou,et al.  Modeling, Simulation, and Control of Flexible Manufacturing Systems - A Petri Net Approach , 1999, Series in Intelligent Control and Intelligent Automation.

[3]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.

[4]  Anand K. Gramopadhye,et al.  Using Multimodal Technologies to Enhance Aviation Maintenance Inspection Training , 2007, HCI.

[5]  Jing-Rong Li,et al.  Desktop virtual reality for maintenance training: an object oriented prototype system (V-REALISM) , 2003, Comput. Ind..

[6]  MengChu Zhou,et al.  Intelligent decision making in disassembly process based on fuzzy reasoning Petri nets , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  MengChu Zhou,et al.  An application of Petri nets to supervisory control for human-computer interactive systems , 2005, IEEE Transactions on Industrial Electronics.

[8]  E. Bluemel,et al.  Virtual environments for the training of maintenance and service tasks , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[9]  Hidekazu Yoshikawa,et al.  A new integration method of constructing an interactive virtual environment for the collaboration between virtual agent and real human , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[10]  T. Tezuka,et al.  Development of machine-maintenance training system in virtual environment , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[11]  Christian M. Adriano,et al.  Coordination components for collaborative virtual environments , 2001, Comput. Graph..

[12]  Hidekazu Yoshikawa,et al.  A study on design support system for constructing machine-maintenance training environment based on virtual reality technology , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[13]  MengChu Zhou,et al.  Fuzzy-Petri-net-based disassembly planning considering human factors , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Seong Youb Chung,et al.  An augmented Petri net for modelling and control of assembly tasks with uncertainties , 2005, Int. J. Comput. Integr. Manuf..

[15]  Orides Morandin,et al.  Virtual Petri nets as a modular modeling method for planning and control tasks of FMS , 2005, Int. J. Comput. Integr. Manuf..

[16]  Robert Stone,et al.  Virtual reality for interactive training: an industrial practitioner's viewpoint , 2001, Int. J. Hum. Comput. Stud..

[17]  MengChu Zhou,et al.  Fuzzy-Petri-net-based disassembly planning considering human factors , 2006, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Gerald Seet,et al.  A Unified Pilot Training and Control System for Underwater Robotic Vehicles (URV) , 2001, J. Intell. Robotic Syst..

[19]  C. Laymon.  A. study , 2018, Predication and Ontology.

[20]  Dong Wang,et al.  Study on Virtual Intelligent Assembly System for Machine Tools Based on Multi-Agent and Petri-Net , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[21]  Orides Morandin,et al.  Virtual Petri nets as a modular modeling method for planning and control tasks of FMS , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[22]  David R. Nadeau.  Tutorial: Building Virtual Worlds with VRML , 1999, IEEE Computer Graphics and Applications.