Effects of Level of Immersion on Virtual Training Transfer of Bimanual Assembly Tasks

The availability of consumer-facing virtual reality (VR) headsets makes virtual training an attractive alternative to expensive traditional training. Recent works showed that virtually trained workers perform bimanual assembly tasks equally well as ones trained with traditional methods. This paper presents a study that investigated how levels of immersion affect learning transfer between virtual and physical bimanual gearbox assembly tasks. The study used a with-in subject design and examined three different virtual training systems i.e., VR training with direct 3D inputs (HTC VIVE Pro), VR training without 3D inputs (Google Cardboard), and passive video-based training. 23 participants were recruited. The training effectiveness was measured by participant’s performance of assembling 3D-printed copies of the gearboxes in two different timings: immediately after and 2 weeks after the training. The result showed that participants preferred immersive VR training. Surprisingly, despite being less favourable, the subjects’ performance of video-based training were similar to training on HTC VIVE Pro. However, video training led to a significant performance decrease in the retention test session 2 weeks after the training.

[1]  Anthony Steed,et al.  A Comparison of Virtual and Physical Training Transfer of Bimanual Assembly Tasks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[2]  J. Bailenson,et al.  The Effect of Interactivity on Learning Physical Actions in Virtual Reality , 2008 .

[3]  Doug A. Bowman,et al.  Quantifying the benefits of immersion for procedural training , 2008, IPT/EDT '08.

[4]  Iker Aguinaga,et al.  Training of Procedural Tasks Through the Use of Virtual Reality and Direct Aids , 2012 .

[5]  Doug A. Bowman,et al.  Validation of the MR Simulation Approach for Evaluating the Effects of Immersion on Visual Analysis of Volume Data , 2012, IEEE Transactions on Visualization and Computer Graphics.

[6]  Nikiforos M. Papachristos,et al.  A Comparison between Oculus Rift and a Low-Cost Smartphone VR Headset: Immersive User Experience and Learning , 2017, 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT).

[7]  Judy M. Vance,et al.  Virtual Training: Learning Transfer of Assembly Tasks , 2015, IEEE Transactions on Visualization and Computer Graphics.

[8]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[9]  Amela Sadagic,et al.  The Effects of Stereopsis and Immersion on Bimanual Assembly Tasks in a Virtual Reality System , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[10]  Catherine Plaisant,et al.  Virtual memory palaces: immersion aids recall , 2018, Virtual Reality.

[11]  Karen J. Reynolds,et al.  Virtual reality for medical training: the state-of-the-art , 2015, J. Simulation.

[12]  Mohamed Khamis,et al.  Introduction and establishment of virtual training in the factory of the future , 2017, Int. J. Comput. Integr. Manuf..

[13]  Judy M. Vance,et al.  Industry use of virtual reality in product design and manufacturing: a survey , 2017, Virtual Reality.

[14]  Bobby Bodenheimer,et al.  A comparison of two cost-differentiated virtual reality systems for perception and action tasks , 2014, SAP.

[15]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[16]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[17]  Johannes Cottyn,et al.  The evaluation of an elementary virtual training system for manual assembly , 2017, Int. J. Prod. Res..

[18]  Ashutosh Tiwari,et al.  Immersive Mixed Reality for Manufacturing Training , 2017, Front. Robot. AI.

[19]  Doug A. Bowman,et al.  The benefits of immersion for spatial understanding of complex underground cave systems , 2007, VRST '07.

[20]  Alain Bernard,et al.  CAD model based virtual assembly simulation, planning and training , 2013 .

[21]  Bertrand Schneider,et al.  What Can We Learn from Augmented Reality (AR)?: Benefits and Drawbacks of AR for Inquiry-based Learning of Physics , 2019, CHI.

[22]  Wolfgang Stuerzlinger,et al.  A 3D desktop puzzle assembly system , 2011, 3DUI.

[23]  Blake Hannaford,et al.  Virtual Training for a Manual Assembly Task , 2001 .

[24]  Chun-Yen Chang,et al.  A cost-effective interactive 3D virtual reality system applied to military live firing training , 2016, Virtual Reality.

[25]  Bruno Arnaldi,et al.  STORM: a Generic Interaction and Behavioral Model for 3D Objects and Humanoids in a Virtual Environment , 2007, EGVE.

[26]  Judy M. Vance,et al.  Puzzle assembly training: Real world vs. virtual environment , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[27]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[28]  Craig R. Hall,et al.  Virtual Reality for Training: Evaluating Retention of Procedural Knowledge , 2001 .

[29]  Bruno Arnaldi,et al.  GVT: a platform to create virtual environments for procedural training , 2008, 2008 IEEE Virtual Reality Conference.

[30]  Markus Funk,et al.  Working with Augmented Reality?: A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace , 2017, PETRA.

[31]  Bruno Arnaldi,et al.  Storytelling in Virtual Reality for Training , 2006, Edutainment.

[32]  S. J. Steiner,et al.  Virtual reality and augmented reality as a training tool for assembly tasks , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).

[33]  Barney Dalgarno,et al.  What are the learning affordances of 3-D virtual environments? , 2010, Br. J. Educ. Technol..

[34]  Bernhard Preim,et al.  Virtual 3D Puzzles: A New Method for Exploring Geometric Models in VR , 2001, IEEE Computer Graphics and Applications.

[35]  Mangqin Jiang Virtual Reality Boosting Automotive Development , 2011 .

[36]  Arava Y. Kallai,et al.  Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks , 2011, Int. J. Hum. Comput. Stud..