Unpacking the intertemporal impact of self-regulation in a blended mathematics environment

With the arrival of fine-grained log-data and the emergence of learning analytics, there may be new avenues to explore how Self-Regulated Learning (SRL) can provide a lens to how students learn in blended and online environments. In particular, recent research has found that the notion of time may be an essential but complex concept through which students make (un)conscious and self-regulated decisions as to when, what, and how to study. This study explored distinct clusters of behavioural engagement in an online e-tutorial called Sowiso at different time points (before tutorials, before quizzes, before exams), and their associations with self-regulated learning strategies, epistemic learning emotions, activity learning emotions, and academic performance. Using a cluster analysis on trace data of 1035 students practicing 429 online exercises in Sowiso, we identified four distinct cluster of students (e.g. early mastery, strategic, exam-driven, and inactive). Further analyses revealed significant differences between these four clusters in their academic performance, step-wise cognitive processing strategies, external self-regulation strategies, epistemic learning emotions and activity learning emotions. Our findings took a step forward towards personalised and actionable feedback in learning analytics by recognizing the complexity of how and when students engage in learning activities over time, and supporting educators to design early and theoretically informed interventions based on learning dispositions.

[1]  TempelaarDirk,et al.  Student profiling in a dispositional learning analytics application using formative assessment , 2018 .

[2]  Rebecca Ferguson,et al.  Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates , 2017, Comput. Hum. Behav..

[3]  Katherine E. Masyn,et al.  Latent Class Analysis and Finite Mixture Modeling , 2013 .

[4]  S. Järvelä,et al.  Self-Regulated, Co-Regulated, and Socially Shared Regulation of Learning , 2011 .

[5]  B. Zimmerman.  Attaining self-regulation: A social cognitive perspective. , 2000 .

[6]  Bodong Chen,et al.  Critical issues in designing and implementing temporal analytics , 2018, J. Learn. Anal..

[7]  Matt C. Howard,et al.  Variable-Centered, Person-Centered, and Person-Specific Approaches , 2018 .

[8]  Omid Noroozi,et al.  Relations between students' perceived levels of self-regulation and their corresponding learning behavior and outcomes in a virtual experiment environment , 2019, Comput. Hum. Behav..

[9]  John McCormick,et al.  Motivational and Self-Regulated Learning Components of Musical Practice , 1999 .

[10]  Hanna Järvenoja,et al.  How Students Describe the Sources of Their Emotional and Motivational Experiences during the Learning Process: A Qualitative Approach , 2005 .

[11]  Philip C. Abrami,et al.  Media and Pedagogy in Undergraduate Distance Education: A Theory-Based Meta-Analysis of Empirical Literature , 2006 .

[12]  Marylène Gagné,et al.  Person-Centered Methodologies in the Organizational Sciences , 2018 .

[13]  J. Vermunt.  Metacognitive, cognitive and affective aspects of learning styles and strategies: A phenomenographic analysis , 1996 .

[14]  Bart Rienties,et al.  Linking students' timing of engagement to learning design and academic performance , 2018, LAK.

[15]  Kyung Ryung Kim,et al.  The relationship between procrastination and academic performance: A meta-analysis , 2015 .

[16]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[17]  Susan Bull,et al.  A Novel Web-Based Approach for Visualization and Inspection of Reading Difficulties on University Students , 2017, IEEE Transactions on Learning Technologies.

[18]  Bernhard Schmitz,et al.  Self-monitoring of self-regulation during math homework behaviour using standardized diaries , 2011 .

[19]  S. Järvelä,et al.  Third wave of measurement in the self-regulated learning field: when measurement and intervention come hand in hand , 2016 .

[20]  Roger Azevedo,et al.  A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system☆☆☆ , 2009 .

[21]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[22]  Philip H. Winne,et al.  Inherent details in self-regulated learning , 1995 .

[23]  Anne C. Frenzel,et al.  Measuring emotions in students learning and performance: The Achievement Emotions Questionnaire (AE , 2011 .

[24]  C. Wolters,et al.  Examining the relations of time management and procrastination within a model of self-regulated learning , 2017 .

[25]  Alexander Renkl,et al.  The Cambridge Handbook of Multimedia Learning: The Worked-Out Examples Principle in Multimedia Learning , 2005 .

[26]  Jutta Heckhausen,et al.  Motivational psychology of human development : developing motivation and motivating development , 2000 .

[27]  Vincent Donche,et al.  A Learning Patterns Perspective on Student Learning in Higher Education: State of the Art and Moving Forward , 2017, Educational Psychology Review.

[28]  Reinhard Pekrun,et al.  A Social-Cognitive, Control-Value Theory of Achievement Emotions , 2000 .

[29]  George Siemens,et al.  Understand students' self-reflections through learning analytics , 2018, LAK.

[30]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[31]  Erika Hoff,et al.  Person-Centered and Variable-Centered Approaches to Longitudinal Data , 2006 .

[32]  Angela L. Duckworth,et al.  Advanced, Analytic, Automated (AAA) Measurement of Engagement During Learning , 2017, Educational psychologist.

[33]  Dragan Gasevic,et al.  Learning analytics to unveil learning strategies in a flipped classroom , 2017, Internet High. Educ..

[34]  Jonna Malmberg,et al.  Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning , 2017 .

[35]  Niels Martin,et al.  Affordances and limitations of learning analytics for computer-assisted language learning: a case study of the VITAL project , 2018 .

[36]  Ulrich Trautwein,et al.  Please Scroll down for Article Structural Equation Modeling: a Multidisciplinary Journal Classical Latent Profile Analysis of Academic Self-concept Dimensions: Synergy of Person-and Variable-centered Approaches to Theoretical Models of Self-concept , 2022 .

[37]  Roger Azevedo,et al.  Monitoring, planning, and self-efficacy during learning with hypermedia: The impact of conceptual scaffolds , 2008, Comput. Hum. Behav..

[38]  Marek Hatala,et al.  Penetrating the black box of time-on-task estimation , 2015, LAK.

[39]  Ernesto Panadero,et al.  A Review of Self-regulated Learning: Six Models and Four Directions for Research , 2017, Front. Psychol..

[40]  Abelardo Pardo,et al.  From Study Tactics to Learning Strategies: An Analytical Method for Extracting Interpretable Representations , 2019, IEEE Transactions on Learning Technologies.

[41]  R. Roe,et al.  A review of the time management literature , 2007 .

[42]  Judy Kay,et al.  Open learner models and learning analytics dashboards: a systematic review , 2018, LAK.

[43]  Lindsey E. Malcom-Piqueux.  Application of Person‐Centered Approaches to Critical Quantitative Research: Exploring Inequities in College Financing Strategies , 2015 .

[44]  Jason M. Harley,et al.  Using Trace Data to Examine the Complex Roles of Cognitive, Metacognitive, and Emotional Self-Regulatory Processes During Learning with Multi-agent Systems , 2013 .

[45]  J. Broadbent,et al.  Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review , 2015, Internet High. Educ..

[46]  Allison Littlejohn,et al.  Learning in MOOCs: Motivations and self-regulated learning in MOOCs , 2016, Internet High. Educ..

[47]  Bodong Chen,et al.  Time for Change: Why Learning Analytics Needs Temporal Analysis , 2017, J. Learn. Anal..

[48]  R. Azevedo,et al.  Self-Regulated Learning Processes Vary as a Function of Epistemic Beliefs and Contexts: Mixed Method Evidence from Eye Tracking and Concurrent and Retrospective Reports , 2016 .

[49]  J. C. Núñez,et al.  Procrastinating Behavior in Computer-Based Learning Environments to Predict Performance: A Case Study in Moodle , 2017, Front. Psychol..

[50]  M. Boekaerts.  SELF-REGULATED LEARNING: A NEW CONCEPT EMBRACED BY RESEARCHERS, POLICY MAKERS, EDUCATORS, TEACHERS, AND STUDENTS , 1997 .

[51]  S. Järvelä,et al.  New Frontiers: Regulating Learning in CSCL , 2013 .

[52]  Dirk T. Tempelaar,et al.  Towards Actionable Learning Analytics Using Dispositions , 2017, IEEE Transactions on Learning Technologies.

[53]  Traci Sitzmann,et al.  A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go. , 2011, Psychological bulletin.

[54]  Charlotte Dignath,et al.  Components of fostering self-regulated learning among students. A meta-analysis on intervention studies at primary and secondary school level , 2008 .