Immersive Mixed Reality for Manufacturing Training

In the complex manufacturing sector a considerable amount of resources is focused on training workers and developing new skills. Increasing the effectiveness of those processes and reducing the investment required is an outstanding issue. In this paper, we present an experiment (n=20) that shows how modern metaphors such as collaborative Mixed Reality can be used to transmit procedural knowledge and could eventually replace other forms of face-to-face training. We implemented a Mixed Reality setup with see-through cameras attached to a Head Mounted Display. The setup allowed for real-time collaborative interactions and could simulate conventional forms of training. We tested the system implementing a manufacturing procedure of an aircraft maintenance door. The obtained results indicate that performance levels in the Immersive Mixed Reality training were not significantly different than in the conventional face-to-face training condition. These results and their implications for future training and the use of Virtual Reality, Mixed Reality and Augmented Reality paradigms in this context are discussed in this paper.

[1]  Rajashekar Patil,et al.  Virtual Manufacturing: A Review , 2018 .

[2]  Tabitha C. Peck,et al.  A threat to a virtual hand elicits motor cortex activation , 2014, Experimental Brain Research.

[3]  Mel Slater,et al.  How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality , 2014, Front. Robot. AI.

[4]  Pablo Bermell-Garcia,et al.  Assessing 3D Scan Quality Through Paired-comparisons Psychophysics , 2016, ACM Multimedia.

[5]  Robert Stone,et al.  Virtual reality for interactive training: an industrial practitioner's viewpoint , 2001, Int. J. Hum. Comput. Stud..

[6]  Mel Slater,et al.  A method for generating an illusion of backwards time travel using immersive virtual reality—an exploratory study , 2014, Front. Psychol..

[7]  Maria V. Sanchez-Vives,et al.  Inducing Illusory Ownership of a Virtual Body , 2009, Front. Neurosci..

[8]  Julian H. Kang,et al.  Merit of Computer Game in Tacit Knowledge Acquisition and Retention , 2011 .

[9]  Mar González-Franco,et al.  The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment , 2010, 2010 IEEE Virtual Reality Conference (VR).

[10]  Roberto Canas,et al.  Game-based trench safety education: development and lessons learned , 2011, J. Inf. Technol. Constr..

[11]  Maria V. Sanchez-Vives,et al.  A Virtual Reprise of the Stanley Milgram Obedience Experiments , 2006, PloS one.

[12]  Peter A. Hancock,et al.  Transfer of training from virtual reality , 1993 .

[13]  Sharon Farra,et al.  Improved Training for Disasters Using 3-D Virtual Reality Simulation , 2013, Western journal of nursing research.

[14]  Mel Slater,et al.  The impact of eye gaze on communication using humanoid avatars , 2001, CHI.

[15]  Antoni Rodríguez-Fornells,et al.  Violating body movement semantics: Neural signatures of self-generated and external-generated errors , 2016, NeuroImage.

[16]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[17]  David B. Kaber,et al.  The need for worker training in advanced manufacturing technology (AMT) environments: A white paper , 1999 .

[18]  Jauvane Cavalcante de Oliveira,et al.  A collaborative virtual environment for industrial training , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[19]  Mel Slater,et al.  Comparison of SSVEP BCI and Eye Tracking for Controlling a Humanoid Robot in a Social Environment , 2014, PRESENCE: Teleoperators and Virtual Environments.

[20]  Xiaojun Shen,et al.  Collaborative Virtual Environments for Industrial Training and e-Commerce , 2002 .

[21]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[22]  Patrice Torguet,et al.  Experimental Feedback on Prog&Play: A Serious Game for Programming Practice , 2011, Comput. Graph. Forum.

[23]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[24]  Simon J. Julier,et al.  Presence and discernability in conventional and non-photorealistic immersive augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[25]  Vincent G. Duffy,et al.  Developing virtual environments for industrial training , 2002, Inf. Sci..

[26]  Mert Bal.  Virtual Manufacturing Laboratory Experiences for Distance Learning Courses in Engineering Technology , 2012 .

[27]  Elizabeth F. Churchill,et al.  Collaborative virtual environments: An introductory review of issues and systems , 1998, Virtual Reality.

[28]  Patrice Torguet,et al.  Experimental Feedback on Prog and Play, a Serious Game for Programming Practice , 2010, Eurographics.

[29]  Mar González-Franco,et al.  Empowering patients to perform physical therapy at home , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Andrew Y. C. Nee,et al.  Augmented reality for assembly guidance using a virtual interactive tool , 2008 .

[31]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[33]  Pablo Bermell-Garcia,et al.  Framework for remote collaborative interaction in virtual environments based on proximity , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[34]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Gavin McArdle,et al.  Virtual reality for collaborative e-learning , 2008, Comput. Educ..

[36]  Lorenzo Seidenari,et al.  Emergency medicine training with gesture driven interactive 3D simulations , 2012, UXeLATE '12.

[37]  Mel Slater,et al.  Persuading people in a remote destination to sing by beaming there , 2013, VRST '13.

[38]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[39]  Lasse Lipponen,et al.  Exploring foundations for computer-supported collaborative learning , 2002, CSCL.

[40]  B. Kapralos,et al.  Using Serious Games and Virtual Simulation for Training in the Fire Service: A Review , 2015 .

[41]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[42]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[43]  Shu-Huang Sun,et al.  Development of virtual training platform of injection molding machine based on VR technology , 2012 .

[44]  Rachel Rosenthal,et al.  Access to a Simulator is Not Enough: The Benefits of Virtual Reality Training Based on Peer-Group-Derived Benchmarks—A Randomized Controlled Trial , 2013, World Journal of Surgery.

[45]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).