Immersive Augmented Reality Training for Complex Manufacturing Scenarios

In the complex manufacturing sector a considerable amount of resources are focused on developing new skills and training workers. In that context, increasing the effectiveness of those processes and reducing the investment required is an outstanding issue. In this paper we present an experiment that shows how modern Human Computer Interaction (HCI) metaphors such as collaborative mixed-reality can be used to transmit procedural knowledge and could eventually replace other forms of face-to-face training. We implement a real-time Immersive Augmented Reality (IAR) setup with see-through cameras that allows for collaborative interactions that can simulate conventional forms of training. The obtained results indicate that people who took the IAR training achieved the same performance than people in the conventional face-to-face training condition. These results, their implications for future training and the use of HCI paradigms in this context are discussed in this paper.

[1]  Mar González-Franco,et al.  Empowering patients to perform physical therapy at home , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Maria V. Sanchez-Vives,et al.  A Virtual Reprise of the Stanley Milgram Obedience Experiments , 2006, PloS one.

[3]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[4]  Sharon Farra,et al.  Improved Training for Disasters Using 3-D Virtual Reality Simulation , 2013, Western journal of nursing research.

[5]  Antoni Rodríguez-Fornells,et al.  Violating body movement semantics: Neural signatures of self-generated and external-generated errors , 2016, NeuroImage.

[6]  Julian H. Kang,et al.  Merit of Computer Game in Tacit Knowledge Acquisition and Retention , 2011 .

[7]  M. Slater,et al.  Bystander Responses to a Violent Incident in an Immersive Virtual Environment , 2013, PloS one.

[8]  Gavin McArdle,et al.  Virtual reality for collaborative e-learning , 2008, Comput. Educ..

[9]  Tabitha C. Peck,et al.  A threat to a virtual hand elicits motor cortex activation , 2014, Experimental Brain Research.

[10]  Pablo Bermell-Garcia,et al.  Assessing 3D Scan Quality Through Paired-comparisons Psychophysics , 2016, ACM Multimedia.

[11]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[12]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[13]  Shu-Huang Sun,et al.  Development of virtual training platform of injection molding machine based on VR technology , 2012 .

[14]  Patrice Torguet,et al.  Experimental Feedback on Prog&Play: A Serious Game for Programming Practice , 2011, Comput. Graph. Forum.

[15]  Simon J. Julier,et al.  Presence and discernability in conventional and non-photorealistic immersive augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[16]  Lorenzo Seidenari,et al.  Emergency medicine training with gesture driven interactive 3D simulations , 2012, UXeLATE '12.

[17]  Mel Slater,et al.  Persuading people in a remote destination to sing by beaming there , 2013, VRST '13.

[18]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[19]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[20]  Lasse Lipponen,et al.  Exploring foundations for computer-supported collaborative learning , 2002, CSCL.

[21]  B. Kapralos,et al.  Using Serious Games and Virtual Simulation for Training in the Fire Service: A Review , 2015 .

[22]  Mel Slater,et al.  How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality , 2014, Front. Robot. AI.

[23]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[24]  David B. Kaber,et al.  The need for worker training in advanced manufacturing technology (AMT) environments: A white paper , 1999 .

[25]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[26]  Pablo Bermell-Garcia,et al.  Framework for remote collaborative interaction in virtual environments based on proximity , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[27]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Mel Slater,et al.  A method for generating an illusion of backwards time travel using immersive virtual reality—an exploratory study , 2014, Front. Psychol..

[29]  Maria V. Sanchez-Vives,et al.  Inducing Illusory Ownership of a Virtual Body , 2009, Front. Neurosci..

[30]  Mar González-Franco,et al.  The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment , 2010, 2010 IEEE Virtual Reality Conference (VR).

[31]  Roberto Canas,et al.  Game-based trench safety education: development and lessons learned , 2011, J. Inf. Technol. Constr..

[32]  Rachel Rosenthal,et al.  Access to a Simulator is Not Enough: The Benefits of Virtual Reality Training Based on Peer-Group-Derived Benchmarks—A Randomized Controlled Trial , 2013, World Journal of Surgery.

[33]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Mert Bal.  Virtual Manufacturing Laboratory Experiences for Distance Learning Courses in Engineering Technology , 2012 .

[35]  Elizabeth F. Churchill,et al.  Collaborative virtual environments: An introductory review of issues and systems , 1998, Virtual Reality.