Conceptualising immersive multimodal environments for psychomotor skills training

The coordination of psychomotor skills requires deliberate practice and techniques, all of which are typically taught in a physical setting, where instructions and timely feedback are given by the teachers. However, doing so remotely is commonly inefficient and ineffective, therefore, hindering the learner's progress. Sensors and immersive technologies enable the collection of multimodal data and the creation of immersion, respectively. These technologies have been widely used to further improve the learning outcome, especially in the psychomotor domain. In this paper, we present our research on designing an immersive training environment for remote psychomotor skill training and investigating how such an environment can be used for training skills in different psychomotor domains.

[1]  Peter van Rosmalen,et al.  Augmenting the Senses: A Review on Sensor-Based Learning Support , 2015, Sensors.

[2]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[3]  Thomas C. Reeves,et al.  Immersive learning technologies: Realism and online authentic learning , 2007, J. Comput. High. Educ..

[4]  Shaheena Noor,et al.  Virtual reality as a physical training assistant , 2017, 2017 International Conference on Information and Communication Technologies (ICICT).

[5]  Marcus Specht,et al.  Can You Ink While You Blink? Assessing Mental Effort in a Sensor-Based Calligraphy Trainer , 2019, Sensors.

[6]  R W Barnes,et al.  Surgical handicraft: teaching and learning surgical skills. , 1987, American journal of surgery.

[7]  Ruth de Villiers,et al.  Design-based research - the educational technology variant of design research: illustrated by the design of an m-learning environment , 2013, SAICSIT '13.

[8]  Marcelo Worsley,et al.  Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks , 2016, J. Learn. Anal..

[9]  Thomas C. Reeves,et al.  Design-Based Research and Educational Technology: Rethinking Technology and the Research Agenda , 2008, J. Educ. Technol. Soc..

[10]  Kalina Yacef,et al.  Let's Dance: How to Build a User Model for Dance Students Using Wearable Technology , 2017, UMAP.

[11]  David F. Treagust,et al.  Why Models are Advantageous to Learning Science , 2009 .

[12]  Peng Song,et al.  An Immersive VR System for Sports Education , 2012, IEICE Trans. Inf. Syst..

[13]  Peter van Rosmalen,et al.  Can You Help Me with My Pitch? Studying a Tool for Real-Time Automated Feedback , 2016, IEEE Transactions on Learning Technologies.

[14]  Roland Klemke,et al.  Table Tennis Tutor: Forehand Strokes Classification Based on Multimodal Data and Neural Networks , 2021, Sensors.

[15]  Karen Bradshaw,et al.  Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference , 2013 .

[16]  Ipke Wachsmuth,et al.  Embodied Communication in Humans and Machines , 2008, AI Mag..

[17]  Hendrik Drachsler,et al.  Real-Time Multimodal Feedback with the CPR Tutor , 2020, AIED.