Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

[1]  Zane Stromberga,et al.  Virtualisation devices for student learning: Comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education , 2017 .

[2]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[3]  Matt Bower,et al.  How is the use of technology in education evaluated? A systematic review , 2019, Comput. Educ..

[4]  Prathibha Varkey,et al.  The effectiveness of self‐directed learning in health professions education: a systematic review , 2010, Medical education.

[5]  Arindam Dey,et al.  A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014 , 2018, Front. Robot. AI.

[6]  Norbert Pachler,et al.  Reconceptualizing design research in the age of mobile learning , 2016, Interact. Learn. Environ..

[7]  Sevda Küçük,et al.  Learning anatomy via mobile augmented reality: Effects on achievement and cognitive load , 2016, Anatomical sciences education.

[8]  James Birt,et al.  Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams , 2018 .

[9]  S. Bennett,et al.  Digital Natives: Exploring the Diversity of Young People’s Experience with Technology , 2013 .

[10]  Jose Luis Saorin,et al.  Virtual Learning Environments to Enhance Spatial Orientation , 2017 .

[11]  John B. Black,et al.  Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment , 2017, Comput. Educ..

[12]  Thomas Cochrane,et al.  Exploring mobile mixed reality in healthcare higher education: A systematic review , 2018, Research in Learning Technology.

[13]  Barney Dalgarno,et al.  What are the learning affordances of 3-D virtual environments? , 2010, Br. J. Educ. Technol..

[14]  Hendrik Drachsler,et al.  From signals to knowledge: A conceptual model for multimodal learning analytics , 2018, J. Comput. Assist. Learn..

[15]  Christopher R. Jones,et al.  Net generation or Digital Natives: Is there a distinct new generation entering university? , 2010, Comput. Educ..

[16]  James Birt,et al.  Improving paramedic distance education through mobile mixed reality simulation , 2017 .

[17]  James Birt,et al.  Mobile Mixed Reality for Experiential Learning and Simulation in Medical and Health Sciences Education , 2018, Inf..

[18]  Andrew E. Fluck,et al.  An international review of eExam technologies and impact , 2019, Comput. Educ..

[19]  James Birt,et al.  Assessing mobile mixed reality affordances as a comparative visualisation pedagogy for design communication , 2018, Research in Learning Technology.

[20]  T. Anderson,et al.  Design-Based Research , 2012 .

[21]  Thomas C. Reeves,et al.  Design research from a technology perspective , 2006 .

[22]  R. T. Hutchings,et al.  Color atlas of human anatomy , 1977 .

[23]  Murat Akcay,et al.  Advantages and challenges associated with augmented reality for education : A systematic review of the literature , 2017 .