Analyzing Multimodal Multichannel Data about Self-Regulated Learning with Advanced Learning Technologies: Issues and Challenges

Abstract Analyzing multimodal multichannel data about self-regulated learning (SRL) obtained during the use of advanced learning technologies such as intelligent tutoring systems, serious games, hypermedia, and immersive virtual learning environments is key to understanding the interplay among cognitive, affective, metacognitive, and social processes and their impact on learning, problem solving, reasoning, and conceptual understanding in learners of all ages and contexts. In this special issue of Computers in Human Behavior, we report six studies conducted by interdisciplinary teams’ use of various trace methodologies such as eye tracking, log-files, physiological data, facial expressions of emotions, screen recordings, concurrent think-alouds, and linguistic analyses of discourse. The research studies focus on how these data were analyzed using a combination of traditional statistical techniques as well as educational data-mining procedures to detect, measure, and infer cognitive, metacognitive, and social processes related to regulating the self and others across several tasks, domains, ages, and contexts. The results of these studies point to future work necessitating interdisciplinary researchers’ collaboration to use theoretically based and empirically derived approaches to collecting, measuring, and modeling multimodal multichannel SRL data to extend our current models, frameworks, and theories by making them more predictive by elucidating the nature, complexity, and temporality of underlying processes. Lastly, analyses of multimodal multichannel SRL process data can significantly augment advanced learning technologies by providing real-time, intelligent, adaptive, individualized scaffolding and feedback to address learners’ self-regulatory needs.

[1]  Eliane Segers,et al.  Temporal variation in children's self-regulated hypermedia learning , 2019, Comput. Hum. Behav..

[2]  Sidney K. D'Mello,et al.  Emotional Learning Analytics , 2017 .

[3]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[4]  Dragan Gasevic,et al.  Handbook of Learning Analytics , 2017 .

[5]  Sanna Järvelä,et al.  Going beyond what is visible: What multichannel data can reveal about interaction in the context of collaborative learning? , 2019, Comput. Hum. Behav..

[6]  Bennett L. Schwartz,et al.  Motivation and Affect in Self-Regulated Learning : Does Metacognition Play a Role? , 2017 .

[7]  Philip H. Winne,et al.  Paradigmatic Dimensions of Instrumentation and Analytic Methods in Research on Self-Regulated Learning , 2019, Comput. Hum. Behav..

[8]  Jason M. Harley,et al.  A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system , 2014, Comput. Hum. Behav..

[9]  Michelle Taub,et al.  Integrating metacognitive judgments and eye movements using sequential pattern mining to understand processes underlying multimedia learning , 2019, Comput. Hum. Behav..

[10]  Arthur C. Graesser,et al.  Linguistic characteristics of reflective states in video annotations under different instructional conditions , 2019, Comput. Hum. Behav..

[11]  R. Azevedo Defining and Measuring Engagement and Learning in Science: Conceptual, Theoretical, Methodological, and Analytical Issues , 2015 .

[12]  Luc Paquette,et al.  Data Mining Methods for Assessing Self-Regulated Learning , 2017 .

[13]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[14]  Michelle Taub,et al.  Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island , 2017, Computers in Human Behavior.

[15]  Philip H. Winne,et al.  Cognition and Metacognition within Self-Regulated Learning , 2017 .

[16]  Reinhard Pekrun,et al.  Emotions and Emotion Regulation in Academic Settings , 2015 .

[17]  B. Zimmerman,et al.  Handbook of Self-Regulation of Learning and Performance , 2011 .

[18]  Alyssa Friend Wise,et al.  Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions , 2019, Comput. Hum. Behav..

[19]  Maria Bannert,et al.  Using Process Mining to examine the sustainability of instructional support: How stable are the effects of metacognitive prompting on self-regulatory behavior? , 2019, Comput. Hum. Behav..

[20]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .