Exploring Magic Interactions for Collaboration in Virtual Reality Learning Factory

A hands-on curriculum that blends theory and practical skills is essential to teach manufacturing. An integral part of such a curriculum is a learning factory, which allows engineering students to experience the entire manufacturing cycle of a product in a realistic factory environment. In addition to learning the required technical skills, students can practice their collaborative skills and communication via teamwork in a learning factory. With virtual reality (VR), environments can be made using game engines that simulate their real-world equivalents, providing realistic experiences. Compared to traditional remote learning, VR-based learning together with online remote learning is experiential, allows for natural interaction, and is only limited by the capabilities of the hardware running the virtual environments. The cost of VR devices has dramatically reduced with standalone VR devices such as Meta Quest 2, making these devices a compelling option for specialized educational simulations. A VR Learning Factory should support synchronous collaboration of multiple learners in the same environment. This is a critical advantage of using VR, since collaboration is an essential skill for engineers. To maximize this benefit, it is imperative to develop an appropriate VR interaction mode, because it can greatly influence the effectiveness of collaborations. In this research, we explore multi-user interaction within the context of the VR Learning Factory and compare two modes of virtual user interaction that we call natural and magic. Magic interactions include three additional tools: object container, holographic representation, and multi-object selection. We conduct an analysis of the two modes of VR interaction in a craft production task and show increased performance of using magic interactions.

[1]  Lili Wang,et al.  VR Collaborative Object Manipulation Based on Viewpoint Quality , 2021, 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  Joachim Metternich,et al.  User-oriented Design of Virtual Reality Supported Learning Factory Trainings: Methodology for the Generation of Suitable Design Elements , 2021, SSRN Electronic Journal.

[3]  Apostolos Pesyridis,et al.  The Application of Virtual Reality in Engineering Education , 2021, Applied Sciences.

[4]  G. Borghini,et al.  The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence , 2021, Scientific Reports.

[5]  Tilman Dingler,et al.  Fully-Occluded Target Selection in Virtual Reality , 2020, IEEE Transactions on Visualization and Computer Graphics.

[6]  María-Blanca Ibáñez-Espiga,et al.  Learning analytics for student modeling in virtual reality training systems: Lineworkers case , 2020, Comput. Educ..

[7]  Shane Erickson,et al.  ‘I was quite surprised it worked so well’: Student and facilitator perspectives of synchronous online Problem Based Learning , 2020 .

[8]  Jaziar Radianti,et al.  A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda , 2020, Comput. Educ..

[9]  Claire R. Williams,et al.  Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math , 2020, Proceedings of the National Academy of Sciences.

[10]  Giovanni Lugaresi,et al.  Active Learning Experience in Simulation Class Using A Lego®-Based Manufacturing System , 2019, 2019 Winter Simulation Conference (WSC).

[11]  Joshua Suttor,et al.  Implement AI Service into VR Training , 2019, SPML '19.

[12]  Ruben Morales-Menendez,et al.  Active learning in engineering education. A review of fundamentals, best practices and experiences , 2019, International Journal on Interactive Design and Manufacturing (IJIDeM).

[13]  Richard Zhao,et al.  Developing a virtual reality game for manufacturing education , 2019, FDG.

[14]  Ken Perlin,et al.  Spacetime: Enabling Fluid Individual and Collaborative Editing in Virtual Reality , 2018, UIST.

[15]  Ayoung Suh,et al.  Enhancing User Engagement through Gamification , 2018, J. Comput. Inf. Syst..

[16]  A. Rao.  An oscillatory neural network model that demonstrates the benefits of multisensory learning , 2018, Cognitive Neurodynamics.

[17]  Jeffrey W. Bertrand,et al.  Use of Virtual Reality Tools in an Undergraduate Mechanical Engineering Manufacturing Course , 2017 .

[18]  Ryan P. McMahan,et al.  Interaction Fidelity: The Uncanny Valley of Virtual Reality Interactions , 2016, HCI.

[19]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[20]  Thierry Duval,et al.  When the giant meets the ant an asymmetric approach for collaborative and concurrent object manipulation in a multi-scale environment , 2016, 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE).

[21]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[22]  Eberhard Abele,et al.  Study on Action-Oriented Learning with a Learning Factory Approach , 2012 .

[23]  Eric D. Ragan,et al.  Questioning naturalism in 3D user interfaces , 2012, CACM.

[24]  Ferran Argelaguet,et al.  Improving co-located collaboration with show-through techniques , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[25]  Gene Liao,et al.  Closing the competency gap in manufacturing processes as it applies to new engineering graduates , 2010 .

[26]  Aaron R. Seitz,et al.  Benefits of multisensory learning , 2008, Trends in Cognitive Sciences.

[27]  Vukica Jovanovic,et al.  A Competency Gap In The Comprehensive Design Education , 2008 .

[28]  Carla Maria Dal Sasso Freitas,et al.  Cooperative Object Manipulation in Immersive Virtual Environments , 2003 .

[29]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[30]  John S. Lamancusa,et al.  The Learning Factory—A New Approach to Integrating Design and Manufacturing into the Engineering Curriculum , 1997 .

[31]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[32]  Meredith Bricken,et al.  Virtual reality learning environments: potentials and challenges , 1991, COMG.

[33]  M. Mennenga,et al.  Creating a Hybrid Multi-User Learning Experience by Enhancing Learning Factories Using Interactive 3d-Environments , 2022, SSRN Electronic Journal.

[34]  Krzysztof Pietroszek,et al.  Raycasting in Virtual Reality , 2019, Encyclopedia of Computer Graphics and Games.

[35]  Joachim Metternich,et al.  Potentials and Limits of Learning Factories in Research, Innovation Transfer, Education, and Training , 2017 .