A Scalable Architecture for the Dynamic Deployment of Multimodal Learning Analytics Applications in Smart Classrooms

The smart classrooms of the future will use different software, devices and wearables as an integral part of the learning process. These educational applications generate a large amount of data from different sources. The area of Multimodal Learning Analytics (MMLA) explores the affordances of processing these heterogeneous data to understand and improve both learning and the context where it occurs. However, a review of different MMLA studies highlighted that ad-hoc and rigid architectures cannot be scaled up to real contexts. In this work, we propose a novel MMLA architecture that builds on software-defined networks and network function virtualization principles. We exemplify how this architecture can solve some of the detected challenges to deploy, dismantle and reconfigure the MMLA applications in a scalable way. Additionally, through some experiments, we demonstrate the feasibility and performance of our architecture when different classroom devices are reconfigured with diverse learning tools. These findings and the proposed architecture can be useful for other researchers in the area of MMLA and educational technologies envisioning the future of smart classrooms. Future work should aim to deploy this architecture in real educational scenarios with MMLA applications.

[1]  Kai Puolamäki,et al.  Biosignals reflect pair-dynamics in collaborative work: EDA and ECG study of pair-programming in a classroom environment , 2018, Scientific Reports.

[2]  Sanjeev Singh,et al.  A Survey on Software Defined Networking: Architecture for Next Generation Network , 2016, Journal of Network and Systems Management.

[3]  Teresa S. Foulger,et al.  Special Article Personal Wearable Technologies in Education: Value or Villain? , 2015 .

[4]  Judy Kay,et al.  An Interactive Teacher's Dashboard for Monitoring Groups in a Multi-tabletop Learning Environment , 2012, ITS.

[5]  Eduardo Gómez-Sánchez,et al.  Towards the Enactment of Learning Situations Connecting Formal and Non-Formal Learning in SLEs , 2019 .

[6]  Denis Gillet,et al.  Enabling the Automatic Generation of User Interfaces for Remote Laboratories , 2017, REV.

[7]  A. Wiggins,et al.  Project-based learning: A review of the literature , 2016 .

[8]  Nergiz Ercil Cagiltay,et al.  Improving programming skills in engineering education through problem-based game projects with Scratch , 2018, Comput. Educ..

[9]  James D. Slotta,et al.  Supporting classroom orchestration with real-time feedback: A role for teacher dashboards and real-time agents , 2019, International Journal of Computer-Supported Collaborative Learning.

[10]  Maren Scheffel,et al.  Multimodal Analytics for Real-Time Feedback in Co-located Collaboration , 2018, EC-TEL.

[11]  Hendrik Drachsler,et al.  The Big Five: Addressing Recurrent Multimodal Learning Data Challenges , 2018, CrossMMLA@LAK.

[12]  Marjan Laal,et al.  21st Century Learning; Learning in Collaboration , 2012 .

[13]  Paul Prinsloo,et al.  An elephant in the learning analytics room: the obligation to act , 2017, LAK.

[14]  Roberto Martinez,et al.  Making Spatial Pedagogy Visible Using Positioning Sensors , 2019 .

[15]  Jui-Yuan Su,et al.  A Context Aware Smart Classroom Architecture for Smart Campuses , 2019, Applied Sciences.

[16]  Yuanchun Shi,et al.  CAMPS: A Middleware for Providing Context-Aware Services for Smart Space , 2006, GPC.

[17]  María Jesús Rodríguez-Triana,et al.  A Review of Multimodal Learning Analytics Architectures , 2018, 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT).

[18]  Peter Mork,et al.  From Data to Decisions: A Value Chain for Big Data , 2013, IT Professional.

[19]  Mohsen Guizani,et al.  Softwarization of Internet of Things Infrastructure for Secure and Smart Healthcare , 2017, Computer.

[20]  Sen Zhang,et al.  A Framework for Learning Analytics Using Commodity Wearable Devices , 2017, Sensors.

[21]  Robson R. Lemos,et al.  Using Depth Cameras to Detect Patterns in Oral Presentations: A Case Study Comparing Two Generations of Computer Engineering Students , 2019, Sensors.

[22]  Guangyou Xu,et al.  Smart Classroom - An Intelligent Environment for Tele-education , 2001, IEEE Pacific Rim Conference on Multimedia.

[23]  Mutlu Cukurova,et al.  Using Multimodal Learning Analytics to Identify Aspects of Collaboration in Project-Based Learning , 2017, CSCL.

[24]  Bertrand Schneider,et al.  Preparing for Future Learning with a Tangible User Interface: The Case of Neuroscience , 2013, IEEE Transactions on Learning Technologies.

[25]  Vincent Aleven,et al.  The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers , 2018, LAK.

[26]  Suhardi,et al.  Smart campus features, technologies, and applications: A systematic literature review , 2017, 2017 International Conference on Information Technology Systems and Innovation (ICITSI).

[27]  Antonio Skarmeta,et al.  Security Management Architecture for NFV/SDN-Aware IoT Systems , 2019, IEEE Internet of Things Journal.

[28]  Xu Li,et al.  Dynamic Flow Migration for Embedded Services in SDN/NFV-Enabled 5G Core Networks , 2020, IEEE Transactions on Communications.

[29]  Jorge Martín-Gutiérrez,et al.  Virtual Technologies Trends in Education , 2017 .

[30]  Denis Gillet,et al.  Smart device paradigm, Standardization for online labs , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[31]  Marjaana Kangas,et al.  A qualitative literature review of educational games in the classroom: the teacher’s pedagogical activities , 2016 .

[32]  Anna Brunstrom,et al.  SDN/NFV-Based Mobile Packet Core Network Architectures: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[33]  Rong Zhou,et al.  5G NFV-Based Tactile Internet for Mission-Critical IoT Services , 2020, IEEE Internet of Things Journal.

[34]  Michael J. Timms Letting Artificial Intelligence in Education Out of the Box: Educational Cobots and Smart Classrooms , 2016, International Journal of Artificial Intelligence in Education.

[35]  Vincent Aleven,et al.  Intelligent tutors as teachers' aides: exploring teacher needs for real-time analytics in blended classrooms , 2017, LAK.

[36]  Xavier Ochoa,et al.  Editorial: Augmenting Learning Analytics with Multimodal Sensory Data​ , 2016, J. Learn. Anal..

[37]  Marcelo Worsley,et al.  Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks , 2016, J. Learn. Anal..

[38]  Denis Gillet,et al.  Self-Organized Laboratories for Smart Campus , 2020, IEEE Transactions on Learning Technologies.

[39]  María Jesús Rodríguez-Triana,et al.  Multimodal Data Value Chain (M-DVC): A Conceptual Tool to Support the Development of Multimodal Learning Analytics Solutions , 2020, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[40]  Vincent Aleven,et al.  Educational Game and Intelligent Tutoring System , 2017, ACM Trans. Comput. Hum. Interact..

[41]  Félix J. García Clemente,et al.  Sustainable securing of Medical Cyber-Physical Systems for the healthcare of the future , 2018, Sustain. Comput. Informatics Syst..

[42]  Federico Borges,et al.  Smart Classrooms: Innovation in formal learning spaces to transform learning experiences , 2016 .

[43]  Pablo Moreno-Ger,et al.  Work-In-Progress: Improving Online Higher Education with Virtual and Remote Labs , 2019, 2019 IEEE Global Engineering Education Conference (EDUCON).

[44]  Hendrik Drachsler,et al.  Dancing Salsa with Machines—Filling the Gap of Dancing Learning Solutions , 2019, Sensors.

[45]  Roberto Martinez-Maldonado,et al.  "I Spent More Time with that Team": Making Spatial Pedagogy Visible Using Positioning Sensors , 2019, Proceedings of the 9th International Conference on Learning Analytics & Knowledge.

[46]  Toru Ishida,et al.  Open Smart Classroom: Extensible and Scalable Learning System in Smart Space Using Web Service Technology , 2009, IEEE Transactions on Knowledge and Data Engineering.

[47]  Yvonne Rogers,et al.  Actions speak loudly with words: unpacking collaboration around the table , 2009, ITS '09.

[48]  Francisco J. Gutierrez,et al.  Enhancing the Student Learning Experience in Software Engineering Project Courses , 2018, IEEE Transactions on Education.

[49]  Félix J. García Clemente,et al.  Automatic monitoring management for 5G mobile networks , 2017, FNC/MobiSPC.

[50]  Judy Kay,et al.  Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data , 2019, Hum. Comput. Interact..

[51]  J. Mark Pullen,et al.  Network EducationWare: an open-source web-based system for synchronous distance education , 2005, IEEE Transactions on Education.

[52]  Rob Miller,et al.  Collabode: collaborative coding in the browser , 2011, CHASE '11.

[53]  Miguel Ángel Conde González,et al.  Dealing with complexity: educational data and tools for learning analytics , 2014, TEEM '14.

[54]  Raul Muñoz,et al.  The ADRENALINE testbed: An SDN/NFV packet/optical transport network and edge/core cloud platform for end-to-end 5G and IoT services , 2017, 2017 European Conference on Networks and Communications (EuCNC).

[55]  Ignacio Angulo,et al.  Remote Laboratory in Education: WebLab-Deusto Practice , 2012 .

[56]  Gwo-Jen Hwang,et al.  Definition, framework and research issues of smart learning environments - a context-aware ubiquitous learning perspective , 2014, Smart Learning Environments.

[57]  Sten Govaerts,et al.  The Smart Device specification for remote labs , 2015, Proceedings of 2015 12th International Conference on Remote Engineering and Virtual Instrumentation (REV).

[58]  Paulo Blikstein,et al.  Using learning analytics to assess students' behavior in open-ended programming tasks , 2011, LAK.

[59]  Lambertus Hesselink,et al.  Automatic Generation and Easy Deployment of Digitized Laboratories , 2020, IEEE Transactions on Industrial Informatics.

[60]  María Jesús Rodríguez-Triana,et al.  Monitoring for Awareness and Reflection in Ubiquitous Learning Environments , 2018, Int. J. Hum. Comput. Interact..