Using Trace Data to Examine the Complex Roles of Cognitive, Metacognitive, and Emotional Self-Regulatory Processes During Learning with Multi-agent Systems

This chapter emphasizes the importance of using multi-channel trace data to examine the complex roles of cognitive, affective, and metacognitive (CAM) self-regulatory processes deployed by students during learning with multi-agent systems. We argue that tracing these processes as they unfold in real-time is key to understanding how they contribute both individually and together to learning and problem solving. In this chapter we describe MetaTutor (a multi-agent, intelligent hypermedia system) and how it can be used to facilitate learning of complex biological topics and as a research tool to examine the role of CAM processes used by learners. Following a description of the theoretical perspective and underlying assumptions of self-regulated learning (SRL) as an event, we provide empirical evidence from five different trace data, including concurrent think-alouds, eye-tracking, note taking and drawing, log-files, and facial recognition, to exemplify how these diverse sources of data help understand the complexity of CAM processes and their relation to learning. Lastly, we provide implications for future research of advanced leaning technologies (ALTs) that focus on examining the role of CAM processes during SRL with these powerful, yet challenging, technological environments.

[1]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[2]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[3]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[4]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[5]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[6]  B. Weiner.  An attributional theory of achievement motivation and emotion. , 1985, Psychological review.

[7]  Michael J. Beatty.  Situational and Predispositional correlates of public speaking anxiety , 1988 .

[8]  Carole A. Ames,et al.  Achievement Goals in the Classroom: Students' Learning Strategies and Motivation Processes , 1988 .

[9]  B. Zimmerman,et al.  Self-regulated learning and academic achievement: Theory, research, and practice. , 1989 .

[10]  B. Zimmerman.  Models of Self-Regulated Learning and Academic Achievement , 1989 .

[11]  Carole A. Ames.  Classrooms: Goals, structures, and student motivation. , 1992 .

[12]  P. Ekman.  An argument for basic emotions , 1992 .

[13]  Jason E. Albrecht,et al.  Updating a mental model: maintaining both local and global coherence , 1993 .

[14]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[15]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[16]  E. J. O'Brien,et al.  Sources of coherence in reading , 1995 .

[17]  J Hyönä.  An eye movement analysis of topic-shift effect during repeated reading. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[18]  Padraic Monaghan,et al.  Proceedings of the 23rd annual conference of the cognitive science society , 2001 .

[19]  M. Chi.  Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[20]  Robert F. Lorch,et al.  Understanding Reading Comprehension: Current and Future Contributions of Cognitive Science , 1997 .

[21]  Douglas J. Hacker,et al.  Metacognition in educational theory and practice. , 1998 .

[22]  Edward J. O'Brien,et al.  What is readily available during reading? A memory‐based view of text processing , 1998 .

[23]  Jan van der Meij,et al.  Learning with Multiple Representations , 1998 .

[24]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[25]  Marlene Schommer.  The influence of age and education on epistemological beliefs , 1998 .

[26]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[27]  P. Pintrich.  The role of goal orientation in self-regulated learning. , 2000 .

[28]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[29]  B. Zimmerman.  Attaining self-regulation: A social cognitive perspective. , 2000 .

[30]  B. Zimmerman,et al.  Self-regulated learning and academic achievement : theoretical perspectives , 2001 .

[31]  Philip H. Winne,et al.  Self-regulated learning viewed from models of information processing. , 2001 .

[32]  A. Graesser,et al.  Handbook of discourse processes , 2003 .

[33]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[34]  Elizabeth R. Peterson,et al.  Conceptions of Learning and Knowledge in Higher Education: Relationships with Study Behaviour and Influences of Learning Environments. , 2004 .

[35]  Marco Wiering,et al.  A Model Based Method for Automatic Facial Expression Recognition , 2005, ECML.

[36]  T. Dahl,et al.  Are students' beliefs about knowledge and learning associated with their reported use of learning strategies? , 2005, The British journal of educational psychology.

[37]  Roger Azevedo,et al.  Adaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia , 2005 .

[38]  Philip H. Winne,et al.  Key Issues in Modeling and Applying Research on Self‐Regulated Learning , 2005 .

[39]  R. Pekrun.  The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice , 2006 .

[40]  Cristina Conati,et al.  Eye-tracking for user modeling in exploratory learning environments: An empirical evaluation , 2007, Knowl. Based Syst..

[41]  J. Dunlosky,et al.  Metacomprehension A Brief History and How to Improve Its Accuracy , 2007 .

[42]  Krista R. Muis.  The Role of Epistemic Beliefs in Self-Regulated Learning , 2007 .

[43]  R. Azevedo,et al.  A Theoretical Review of Winne and Hadwin’s Model of Self-Regulated Learning: New Perspectives and Directions , 2007 .

[44]  Roger Azevedo,et al.  Understanding the complex nature of self-regulatory processes in learning with computer-based learning environments: an introduction , 2007 .

[45]  Daniel C. Moos,et al.  Self-regulated learning with hypermedia : The role of prior domain knowledge , 2008 .

[46]  Arthur C. Graesser,et al.  Emote aloud during learning with AutoTutor: Applying the Facial Action Coding System to cognitive–affective states during learning , 2008 .

[47]  Daniel C. Moos,et al.  Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? , 2008 .

[48]  Philip H. Winne,et al.  The weave of motivation and self-regulated learning. , 2008 .

[49]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[50]  B. Zimmerman,et al.  Motivation and Self-Regulated Learning: Theory, Research, and Applications , 2009 .

[51]  Katharina Scheiter,et al.  Using eye tracking in applied research to study and stimulate the processing of information from multi-representational sources , 2009 .

[52]  R. Azevedo.  Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion , 2009 .

[53]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[54]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[55]  Arthur C. Graesser,et al.  Multimethod assessment of affective experience and expression during deep learning , 2009, Int. J. Learn. Technol..

[56]  Johanna D. Moore,et al.  Using Natural Language Processing to Analyze Tutorial Dialogue Corpora Across Domains Modalities , 2009, AIED.

[57]  John C. Nesbit,et al.  Supporting Self-Regulated Learning with Cognitive Tools , 2009 .

[58]  Amy M. Witherspoon,et al.  Self-Regulated Learning with Hypermedia , 2009 .

[59]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[60]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Krista R. Muis,et al.  Epistemic beliefs: Setting the standards for self-regulated learning , 2009 .

[62]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[63]  Roger Azevedo,et al.  A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system☆☆☆ , 2009 .

[64]  R. Azevedo,et al.  The Measurement of Learners’ Self-Regulated Cognitive and Metacognitive Processes While Using Computer-Based Learning Environments , 2010 .

[65]  Rainer Bromme,et al.  Epistemological beliefs are standards for adaptive learning: a functional theory about epistemological beliefs and metacognition , 2010 .

[66]  Candice Burkett,et al.  Self-regulated Learning with MetaTutor: Advancing the Science of Learning with MetaCognitive Tools , 2010 .

[67]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[68]  K. Koedinger,et al.  Automated, Unobtrusive, Action-by-Action Assessment of Self-Regulation During Learning With an Intelligent Tutoring System , 2010 .

[69]  Daniel C. Moos,et al.  Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and Challenges , 2010 .

[70]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[71]  Chris S. Hulleman,et al.  A meta-analytic review of achievement goal measures: different labels for the same constructs or different constructs with similar labels? , 2010, Psychological bulletin.

[72]  Sanna Järvelä,et al.  Tracing elementary school students' study tactic use in gStudy by examining a strategic and self-regulated learning , 2010, Comput. Hum. Behav..

[73]  James C. Lester,et al.  Affective Transitions in Narrative-Centered Learning Environments , 2008, J. Educ. Technol. Soc..

[74]  Anastasios A. Economides,et al.  Measuring instant emotions during a self-assessment test: the use of FaceReader , 2010, MB '10.

[75]  Roger Azevedo,et al.  Dysregulated Learning with Advanced Learning Technologies , 2010, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[76]  Arthur C. Graesser,et al.  Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features , 2010, User Modeling and User-Adapted Interaction.

[77]  Roger Azevedo,et al.  Proceedings of the Annual Meeting of the Cognitive Science Society , 2022 .

[78]  M. Boekaerts,et al.  Emotions, Emotion Regulation, and Self-Regulation of Learning , 2011 .

[79]  B. Zimmerman,et al.  Handbook of Self-Regulation of Learning and Performance , 2011 .

[80]  Jason M. Harley,et al.  Examining Learners' Emotional Responses to Virtual Pedagogical Agents' Tutoring Strategies , 2011, IVA.

[81]  Heather L. Urry,et al.  Cognition and Emotion Lecture at the 2010 SPSP Emotion Preconference , 2011, Cognition & emotion.

[82]  Roger Azevedo,et al.  The Temporal and Dynamic Nature of Self-Regulatory Processes During Independent and Externally Assisted Hypermedia Learning , 2011 .

[83]  Roger Azevedo,et al.  Adaptive Content and Process Scaffolding: A key to facilitating students' self-regulated learning with hypermedia , 2011 .

[84]  R. Calvo,et al.  New Perspectives on Affect and Learning Technologies , 2011 .

[85]  Arthur C. Graesser,et al.  Use of Hypermedia to Assess and Convey Self-Regulated Learning , 2011 .

[86]  Anne C. Frenzel,et al.  Measuring emotions in students learning and performance: The Achievement Emotions Questionnaire (AE , 2011 .

[87]  A. Efklides.  Interactions of Metacognition With Motivation and Affect in Self-Regulated Learning: The MASRL Model , 2011 .

[88]  Dale H. Schunk,et al.  Assessing Self-Efficacy for Self-Regulated Learning , 2011 .

[89]  Daniel C. Moos,et al.  Self-Regulation of Learning with Computer-Based Learning Environments , 2011 .

[90]  Roger Azevedo,et al.  Integrating Cognitive, Metacognitive, and Affective Regulatory Processes with MetaTutor , 2011 .

[91]  Maria Bannert,et al.  Exploring regulatory processes during a computer-supported collaborative learning task using process mining , 2012, Comput. Hum. Behav..

[92]  Gahangir Hossain,et al.  The Effectiveness of Pedagogical Agents' Prompting and Feedback in Facilitating Co-adapted Learning with MetaTutor , 2012, ITS.

[93]  Dale H. Schunk.  Attributions as Motivators of Self-Regulated Learning , 2012 .

[94]  Jason M. Harley,et al.  Measuring Learners' Co-Occurring Emotional Responses during Their Interaction with a Pedagogical Agent in MetaTutor , 2012, ITS.

[95]  Susan M. Land,et al.  Metacognition and Self-Regulated Learning in Student-Centered Learning Environments , 2012 .

[96]  Gautam Biswas,et al.  Identifying Students' Characteristic Learning Behaviors in an Intelligent Tutoring System Fostering Self-Regulated Learning , 2012, EDM.

[97]  Jason M. Harley,et al.  Clustering and Profiling Students According to their Interactions with an Intelligent Tutoring System Fostering Self-Regulated Learning , 2013, EDM 2013.