The Influence of Interaction Technology on the Learning of Assembly Tasks Using Virtual Reality

Rhaptic, and two configurations of the Markerless Motion Capture (Mmocap) system (with 2D or 3D tracking of hands). The fifth group was trained with a video tutorial. A post-training test carried out the day after evaluated performance in the real task. The experiment studies the efficiency and effectiveness of each interaction technology for learning the task, taking in consideration both quantitative measures (such as training time, real task performance, evolution from the virtual task to real one), and qualitative data (user feedback from a questionnaire). Results show that there were no significant differences in the final performance among the five groups. However, users trained under mouse and 2D-tracking Mmocap systems took significantly less training time than the rest of the virtual modalities. This brings out two main outcomes: (1) the perception of collisions using haptics does not increase the learning transfer of procedural tasks demanding low motor skills and (2) Mmocap-based interactions can be valid for training this kind of tasks. [DOI: 10.1115/1.4028588]

[1]  Satyandra K. Gupta,et al.  Towards the development of a virtual environment-based training system for mechanical assembly operations , 2007, Virtual Reality.

[2]  Luis Unzueta Irurtia Markerless full-body human motion capture and combined motor action recognition for human-computer interaction , 2009 .

[3]  Norman I. Badler,et al.  A taxonomy and comparison of haptic actions for disassembly tasks , 2003, IEEE Virtual Reality, 2003. Proceedings..

[4]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[5]  António M. Lopes,et al.  A new type haptics-based virtual environment system for assembly training of complex products , 2011, The International Journal of Advanced Manufacturing Technology.

[6]  Simo-Pekka Leino,et al.  A High-Level Haptic Interface for Enhanced Interaction within VirtoolsTM , 2009, HCI.

[7]  Judy M. Vance,et al.  Assessment of haptics-based interaction for assembly tasks in virtual reality , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[8]  Judy M. Vance,et al.  A DESKTOP NETWORKED HAPTIC VR INTERFACE FOR MECHANICAL ASSEMBLY , 2005 .

[9]  Simo-Pekka Leino,et al.  Enhanced Industrial Maintenance Work Task Planning by Using Virtual Engineering Tools and Haptic User Interfaces , 2009, HCI.

[10]  Teresa Gutiérrez,et al.  IMA-VR: A multimodal virtual training system for skills transfer in Industrial Maintenance and Assembly tasks , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[11]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  Saeid Nahavandi,et al.  Haptically enable interactive virtual assembly training system development and evaluation , 2009 .

[13]  Andrea F. Abate,et al.  A haptic-based approach to virtual training for aerospace industry , 2009, J. Vis. Lang. Comput..

[14]  Judy M. Vance,et al.  Development of a Dual-Handed Haptic Assembly System: SHARP , 2008, J. Comput. Inf. Sci. Eng..

[15]  Blake Hannaford,et al.  Virtual Training for a Manual Assembly Task , 2001 .

[16]  S. K. Gupta,et al.  Virtual Mentor: a step towards proactive user monitoring and assistance during virtual environment-based training , 2007 .

[17]  Atul Thakur,et al.  A Survey of the Virtual Environments-based Assembly Training Applications , 2009 .

[18]  Franco Tecchia,et al.  Design Guidelines for the Development of Virtual Reality and Augmented Reality Training Systems for Maintenance and Assembly Tasks , 2011 .

[19]  Yue Qi,et al.  Constraint-Based Virtual Assembly Training System for Aircraft Engine , 2012 .

[20]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[21]  Nirit Yuviler-Gavish,et al.  Task Analysis for Developing Maintenance and Assembly VR Training Simulators , 2013 .

[22]  Judy M. Vance,et al.  Puzzle assembly training: Real world vs. virtual environment , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[23]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..