Physical learning analytics: a multimodal perspective

The increasing progress in ubiquitous technology makes it easier and cheaper to track students' physical actions unobtrusively, making it possible to consider such data for supporting research, educator interventions, and provision of feedback to students. In this paper, we reflect on the underexplored, yet important area of learning analytics applied to physical/motor learning tasks and to the physicality aspects of `traditional' intellectual tasks that often occur in physical learning spaces. Based on Distributed Cognition theory, the concept of Internet of Things and multimodal learning analytics, this paper introduces a theoretical perspective for bringing learning analytics into physical spaces. We present three prototypes that serve to illustrate the potential of physical analytics for teaching and learning. These studies illustrate advances in proximity, motion and location analytics in collaborative learning, dance education and healthcare training.

[1]  Ido Roll,et al.  Evolution and Revolution in Artificial Intelligence in Education , 2016, International Journal of Artificial Intelligence in Education.

[2]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[3]  Martin Svensson,et al.  Exploring How Pervasive Computing Can Support Situated Learning , 2007 .

[4]  Marcelo Worsley,et al.  Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks , 2016, J. Learn. Anal..

[5]  Mutlu Cukurova,et al.  Tracing physical movement during practice-based learning through multimodal learning analytics , 2017, LAK.

[6]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[7]  Judy Kay,et al.  MTFeedback: Providing Notifications to Enhance Teacher Awareness of Small Group Work in the Classroom , 2015, IEEE Transactions on Learning Technologies.

[8]  Max Mühlhäuser,et al.  Potential Use of Inertial Measurement Sensors for Piano Teaching Systems: Motion Analysis of Piano Playing Patterns. , 2008 .

[9]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[10]  Maria Ebling,et al.  Pervasive Computing and the Internet of Things , 2016, IEEE Pervasive Comput..

[11]  Marcelo Milrad,et al.  Exploring How Pervasive Technologies Can Support Situated Learning , 2007 .