Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams

This paper presents an approach to using mixed reality (MR) technologies in supervised summative electronic exams. The student learning experience is increasingly replete with a rich range of digital tools, but we rarely see these same e-tools deployed for higher stakes supervised assessment, despite the increasing maturity of technologies that afford authentic learning experiences. MR, including augmented and virtual reality, enables educators to provide rich, immersive learner centred experiences that have unique affordances for collecting a range of learning analytics on student performance. This is especially so in disciplines such as health, engineering, and physical education requiring a spatial dimension. Yet, in many institutions, paper-based exams still dominate, in some measure due to concerns over security, integrity and scalability. This is despite a key concern for educators and institutions in producing employment ready 21st century graduates being the authenticity of assessments used for high stakes judgements. We therefore present a proposal for how MR pedagogies can be deployed for use in supervised examination contexts in a manner that is secure, reliable, and scalable.

[1]  T. N. Miller,et al.  Educational Leadership in an Online World: Connecting Students to Technology Responsibly, Safely, and Ethically. , 2013 .

[2]  Gerald D. Bailey,et al.  Digital Citizenship: Addressing Appropriate Technology Behavior. , 2004 .

[3]  Allison Littlejohn,et al.  Learning at the digital frontier: a review of digital literacies in theory and practice , 2012, J. Comput. Assist. Learn..

[4]  Mathew Hillier,et al.  Towards authentic e-Exams at scale: robust networked Moodle , 2018 .

[5]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[6]  David Jones,et al.  Three paths for learning analytics and beyond , 2014, ASCILITE Publications.

[7]  Andrew Fluck,et al.  Arguing again for e-exams in high stakes examinations , 2013 .

[8]  Miguel Ángel Conde González,et al.  Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning , 2014, Comput. Hum. Behav..

[9]  James Birt,et al.  Toward future 'mixed reality' learning spaces for STEAM education , 2017 .

[10]  James Birt,et al.  Mixed reality in higher education: Pedagogy before technology , 2016 .

[11]  Rebecca Ferguson,et al.  Research Evidence on the Use of Learning Analytics: Implications for Education Policy , 2016 .

[12]  J. Sweller Implications of Cognitive Load Theory for Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[13]  Richard F. Schmid,et al.  A meta-analysis of blended learning and technology use in higher education: from the general to the applied , 2014, Journal of Computing in Higher Education.

[14]  Shun Xu,et al.  Social media competence and digital citizenship among college students , 2019 .

[15]  M. Cummins,et al.  2016 NMC Technology Outlook: Australian Tertiary Education , 2016 .

[16]  M. Malbrán The Cambridge Handbook of Multimedia Learning , 2007 .

[17]  S. Ainsworth The Cambridge Handbook of Multimedia Learning: The Multiple Representation Principle in Multimedia Learning , 2014 .

[18]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[19]  Hugh C. Davis,et al.  Significance of Learning Analytics in Enhancing the Mobile and Pervasive Learning Environments , 2012, 2012 Sixth International Conference on Next Generation Mobile Applications, Services and Technologies.

[20]  Wu-Yuin Hwang,et al.  Analysis of peer learning behaviors using multiple representations in virtual reality and their impacts on geometry problem solving , 2013, Comput. Educ..

[21]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[22]  R. Mayer,et al.  Interactive Multimodal Learning Environments , 2007 .

[23]  T. Höffler Spatial Ability: Its Influence on Learning with Visualizations—a Meta-Analytic Review , 2010 .

[24]  Irshad Hussain,et al.  Social Media as a Learning Technology for University Students. , 2018 .

[25]  James Birt,et al.  Improving paramedic distance education through mobile mixed reality simulation , 2017 .

[26]  Alejandra J. Magana Learning strategies and multimedia techniques for scaffolding size and scale cognition , 2014, Comput. Educ..

[27]  Jorge Martín Gutiérrez,et al.  Virtual Technologies to Develop Visual-Spatial Ability in Engineering Students , 2017 .