A Learning Analytics Approach to Correlate the Academic Achievements of Students with Interaction Data from an Educational Simulator

This paper presents a Learning Analytics approach for understanding the learning behavior of students while interacting with Technology Enhanced Learning tools. In this work we show that it is possible to gain insight into the learning processes of students from their interaction data. We base our study on data collected through six laboratory sessions where first-year students of Computer Engineering at the University of Genoa were using a digital electronics simulator. We exploit Process Mining methods to investigate and compare the learning processes of students. For this purpose, we measure the understandability of their process models through a complexity metric. Then we compare the various clusters of students based on their academic achievements. The results show that the measured complexity has positive correlation with the final grades of students and negative correlation with the difficulty of the laboratory sessions. Consequently, complexity of process models can be used as an indicator of variations of student learning paths.

[1]  Gwm Matthias Rauterberg.  How to measure cognitive complexity in human-computer interaction , 1996 .

[2]  Virginia S. Lee,et al.  The Power of Inquiry as a Way of Learning , 2011 .

[3]  Sebastián Ventura,et al.  Educational data mining: A survey from 1995 to 2005 , 2007, Expert Syst. Appl..

[4]  Gwm Matthias Rauterberg,et al.  A method of a quantitative measurement of cognitive complexity , 1992 .

[5]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[6]  Oscar Díaz,et al.  Tool Support , 1999, Active Rules in Database Systems.

[7]  P. Reimann,et al.  Process mining techniques for analysing patterns and strategies in students’ self-regulated learning , 2013, Metacognition and Learning.

[8]  George Siemens,et al.  Learning analytics: envisioning a research discipline and a domain of practice , 2012, LAK.

[9]  John T. Richards,et al.  Achieving Psychological Simplicity : Measures and Methods to Reduce Cognitive Complexity , 2012 .

[10]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[11]  Noraini Mohamed,et al.  The Use of Cyclomatic Complexity Metrics in Programming Performance's Assessment☆ , 2013 .

[12]  Wil M.P. van der Aalst,et al.  Fuzzy Mining - Adaptive Process Simplification Based on Multi-perspective Metrics , 2007, BPM.

[13]  Ioannis Stamelos,et al.  Evaluating children performance with graphical and tangible robot programming tools , 2014, Personal and Ubiquitous Computing.

[14]  Davide Anguita,et al.  A Learning Analytics Methodology to Profile Students Behavior and Explore Interactions with a Digital Electronics Simulator , 2014, EC-TEL.

[15]  Domenico Ponta,et al.  A Simulation Environment for e-Learning in Digital Design , 2007, IEEE Transactions on Industrial Electronics.

[16]  Volker Gruhn,et al.  Adopting the Cognitive Complexity Measure for Business Process Models , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[17]  Davide Anguita,et al.  Human Algorithmic Stability and Human Rademacher Complexity , 2015, ESANN.

[18]  Wil M. P. van der Aalst,et al.  Complexity metrics for Workflow nets , 2009, Inf. Softw. Technol..

[19]  Ralf Laue,et al.  Cognitive Complexity in Business Process Modeling , 2011, CAiSE.

[20]  Dong-Han Ham,et al.  A Framework-Based Approach to Identifying and Organizing the Complexity Factors of Human-System Interaction , 2011, IEEE Systems Journal.

[21]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[22]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[23]  Martina Ziefle,et al.  On Complexity Reduction of User Interfaces for Safety-Critical Systems , 2012, CD-ARES.

[24]  Iván Martínez-Ortiz,et al.  E-Learning standards and learning analytics. Can data collection be improved by using standard data models? , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[25]  Mykola Pechenizkiy,et al.  Process Mining Online Assessment Data , 2009, EDM.

[26]  Denis Gillet,et al.  Innovations in STEM education: the Go-Lab federation of online labs , 2014, Smart Learning Environments.

[27]  Domenico Ponta,et al.  Ten years of activity on Computer-Aided Learning for electronics: needs, experiences, fields evaluation , 1970 .

[28]  Wil M. P. van der Aalst,et al.  Workflow mining: discovering process models from event logs , 2004, IEEE Transactions on Knowledge and Data Engineering.

[29]  Marlene Scardamalia,et al.  Smart technology for self-organizing processes , 2014, Smart Learning Environments.

[30]  Davide Anguita,et al.  Advances in learning analytics and educational data mining , 2015, ESANN.

[31]  Vytautas Štuikys,et al.  Complexity Evaluation of Feature Models and Meta-Programs , 2013 .

[32]  Mykola Pechenizkiy,et al.  From Local Patterns to Global Models: Towards Domain Driven Educational Process Mining , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[33]  Michael J. Prince,et al.  Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases , 2006 .