Process mining techniques for analysing patterns and strategies in students’ self-regulated learning

Referring to current research on self-regulated learning, we analyse individual regulation in terms of a set of specific sequences of regulatory activities. Successful students perform regulatory activities such as analysing, planning, monitoring and evaluating cognitive and motivational aspects during learning not only with a higher frequency than less successful learners, but also in a different order—or so we hypothesize. Whereas most research has concentrated on frequency analysis, so far, little is known about how students’ regulatory activities unfold over time. Thus, the aim of our approach is to also analyse the temporal order of spontaneous individual regulation activities. In this paper, we demonstrate how various methods developed in process mining research can be applied to identify process patterns in self-regulated learning events as captured in verbal protocols. We also show how theoretical SRL process models can be tested with process mining methods. Thinking aloud data from a study with 38 participants learning in a self-regulated manner from a hypermedia are used to illustrate the methodological points.

[1]  B. Bloom Taxonomy of educational objectives , 1956 .

[2]  Arthur Gill,et al.  Introduction to the theory of finite-state machines , 1962 .

[3]  F. Marton,et al.  ON QUALITATIVE DIFFERENCES IN LEARNING: I—OUTCOME AND PROCESS* , 1976 .

[4]  Lawrence B. Mohr,et al.  Explaining organizational behavior , 1982 .

[5]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[6]  Wolfgang Reisig,et al.  Petri Nets , 1985, EATCS Monographs on Theoretical Computer Science.

[7]  Roger Bakeman,et al.  Observing Interaction: An Introduction to Sequential Analysis , 1986 .

[8]  R. Schmeck,et al.  Learning strategies and learning styles , 1988 .

[9]  John Biggs,et al.  Approaches to learning and to essay writing. , 1988 .

[10]  A. Abbott,et al.  Measuring Resemblance in Sequence Data: An Optimal Matching Analysis of Musicians' Careers , 1990, American Journal of Sociology.

[11]  Penelope M. Sanderson,et al.  Exploratory sequential data analysis: foundations , 1994 .

[12]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[13]  Philip H. Winne,et al.  A METACOGNITIVE VIEW OF INDIVIDUAL DIFFERENCES IN SELF-REGULATED LEARNING , 1996 .

[14]  John G. Borkowski,et al.  Metacognition: Theory or chapter heading? , 1996 .

[15]  Padhraic Smyth,et al.  Statistical inference and data mining , 1996, CACM.

[16]  M. Chi Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[17]  M. Boekaerts SELF-REGULATED LEARNING: A NEW CONCEPT EMBRACED BY RESEARCHERS, POLICY MAKERS, EDUCATORS, TEACHERS, AND STUDENTS , 1997 .

[18]  Lars Michael Kristensen,et al.  The practitioner’s guide to coloured Petri nets , 1998, International Journal on Software Tools for Technology Transfer.

[19]  A. Langley Strategies for Theorizing from Process Data , 1999 .

[20]  Philip H. Winne,et al.  Measuring Self-Regulated Learning , 2000 .

[21]  P. Pintrich The role of goal orientation in self-regulated learning. , 2000 .

[22]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[23]  R. Azevedo,et al.  The Role of Self-Regulated Learning in Fostering Students' Conceptual Understanding of Complex Systems with Hypermedia , 2004 .

[24]  L. A. Coward,et al.  On levels of cognitive modeling , 2005 .

[25]  Kristopher J Preacher,et al.  Use of the extreme groups approach: a critical reexamination and new recommendations. , 2005, Psychological methods.

[26]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[27]  Wil M. P. van der Aalst,et al.  Decision Mining in ProM , 2006, Business Process Management.

[28]  F. Fischer,et al.  Collaboration Scripts – A Conceptual Analysis , 2006 .

[29]  Manu Kapur,et al.  Sensitivities to early exchange in synchronous computer-supported collaborative learning (CSCL) groups , 2007, Comput. Educ..

[30]  Wil M. P. van der Aalst,et al.  Fuzzy Mining - Adaptive Process Simplification Based on Multi-perspective Metrics , 2007, BPM.

[31]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[32]  T. Jong,et al.  Software scaffolds to promote regulation during scientific inquiry learning , 2007 .

[33]  A. Efklides Metacognition Defining : Its Facets and Levels of Functioning in Relation to Self-Regulation and Co-regulation , 2008 .

[34]  Wil M. P. van der Aalst,et al.  Conformance checking of processes based on monitoring real behavior , 2008, Inf. Syst..

[35]  Philip H. Winne,et al.  The weave of motivation and self-regulated learning. , 2008 .

[36]  B. Zimmerman,et al.  Motivation and Self-Regulated Learning: Theory, Research, and Applications , 2009 .

[37]  M. Bannert Promoting Self-Regulated Learning Through Prompts , 2009 .

[38]  R. Azevedo Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion , 2009 .

[39]  Roger Azevedo,et al.  Self-efficacy and prior domain knowledge: to what extent does monitoring mediate their relationship with hypermedia learning? , 2009 .

[40]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[41]  Peter Reimann,et al.  Time is precious: Variable- and event-centred approaches to process analysis in CSCL research , 2009, Int. J. Comput. Support. Collab. Learn..

[42]  John C. Nesbit,et al.  Supporting Self-Regulated Learning with Cognitive Tools , 2009 .

[43]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[44]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[45]  Wilhelmiina Hämäläinen,et al.  Classiers for Educational Data Mining , 2010 .

[46]  Daniel C. Moos,et al.  Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and Challenges , 2010 .

[47]  Stephanie Pieschl,et al.  The Role of Epistemic Beliefs in Students’ Self-Regulated Learning With Computer-Based Learning Environments: Conceptual and Methodological Issues , 2010 .

[48]  John C. Nesbit,et al.  Sequential Pattern Analysis of Learning Logs: Methodology and Applications , 2010 .

[49]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[50]  Philip H. Winne,et al.  Improving Measurements of Self-Regulated Learning , 2010 .

[51]  Manu Kapur,et al.  Temporality matters: Advancing a method for analyzing problem-solving processes in a computer-supported collaborative environment , 2011, Int. J. Comput. Support. Collab. Learn..

[52]  Maria Bannert,et al.  Exploring regulatory processes during a computer-supported collaborative learning task using process mining , 2012, Comput. Hum. Behav..

[53]  Maria Bannert,et al.  Supporting self-regulated hypermedia learning through prompts , 2011, Instructional Science.

[54]  Susanne P. Lajoie,et al.  Supporting collaboration with technology: does shared cognition lead to co-regulation in medicine? , 2011, Metacognition and Learning.

[55]  V. Aleven,et al.  International Handbook of Metacognition and Learning Technologies , 2013 .

[56]  M. Bannert,et al.  Scaffolding Hypermedia Learning Through Metacognitive Prompts , 2013 .

[57]  Peter Reimann,et al.  Using Process Mining for Understanding Learning , 2013 .

[58]  Barbara L. Grabowski,et al.  Handbook of Design in Educational Technology , 2013 .