What will you do next? A sequence analysis on the student transitions between online platforms in blended courses

Students' interactions with online tools can provide us with insights into their study and work habits. Prior research has shown that these habits, even as simple as the number of actions or the time spent on online platforms can distinguish between the higher performing students and low-performers. These habits are also often used to predict students' performance in classes. One key feature of these actions that is often overlooked is how and when the students transition between different online platforms. In this work, we study sequences of student transitions between online tools in blended courses and identify which habits make the most difference between the higher and lower performing groups. While our results showed that most of the time students focus on a single tool, we were able to find patterns in their transitions to differentiate high and low performing groups. These findings can help instructors to provide procedural guidance to the students, as well as to identify harmful habits and make timely interventions.

[1]  Ming Zhang,et al.  MOOC student dropout: pattern and prevention , 2017, ACM TUR-C '17.

[2]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[3]  John S. Kinnebrew,et al.  A Contextualized, Differential Sequence Mining Method to Derive Students' Learning Behavior Patterns , 2013, EDM 2013.

[4]  ChengXiang Zhai,et al.  Modeling MOOC Student Behavior With Two-Layer Hidden Markov Models , 2017, EDM.

[5]  Gautam Biswas,et al.  Mining Student Behavior Models in Learning-by-Teaching Environments , 2008, EDM.

[6]  Suma Bhat,et al.  Predicting Attrition Along the Way: The UIUC Model , 2014, EMNLP 2014.

[7]  Ting Wang,et al.  Exploring N-gram Features in Clickstream Data for MOOC Learning Achievement Prediction , 2017, DASFAA Workshops.

[8]  van der Wmp Wil Aalst,et al.  Exploring students’ learning behaviour in MOOCs using process mining techniques , 2015 .

[9]  Nirmal Patel,et al.  Mining Frequent Learning Pathways from a Large Educational Dataset , 2017, ArXiv.

[10]  Kenneth R. Koedinger,et al.  Unsupervised Discovery of Student Strategies , 2010, EDM.

[11]  Fei Mi.  Temporal Models for Predicting Student Dropout in Massive Open Online Courses , 2015 .

[12]  Alex Paramythis,et al.  Activity sequence modelling and dynamic clustering for personalized e-learning , 2011, User Modeling and User-Adapted Interaction.

[13]  Carolyn Penstein Rosé,et al.  Social factors that contribute to attrition in MOOCs , 2014, L@S.

[14]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[15]  Carolyn Penstein Rosé,et al.  Identifying Latent Study Habits by Mining Learner Behavior Patterns in Massive Open Online Courses , 2014, CIKM.

[16]  Markus H. Gross,et al.  Temporally Coherent Clustering of Student Data , 2016, EDM.

[17]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[18]  Marek Hatala,et al.  Penetrating the black box of time-on-task estimation , 2015, LAK.

[19]  Shaghayegh Sahebi,et al.  The Problem Solving Genome: Analyzing Sequential Patterns of Student Work with Parameterized Exercises , 2014, EDM.

[20]  Gautam Biswas,et al.  Identifying Learning Behaviors by Contextualizing Differential Sequence Mining with Action Features and Performance Evolution , 2012, EDM.

[21]  Pierre Dillenbourg,et al.  Semi-Markov model for simulating MOOC students , 2016, EDM.

[22]  Michel C. Desmarais,et al.  Clustering and Visualizing Study State Sequences , 2013, EDM.

[23]  Patrick Jermann,et al.  Capturing "attrition intensifying" structural traits from didactic interaction sequences of MOOC learners , 2014, EMNLP 2014.

[24]  Judy Kay,et al.  Analysing Frequent Sequential Patterns of Collaborative Learning Activity Around an Interactive Tabletop. Nominee for Best Paper Award , 2010, EDM.

[25]  Mina Shirvani Boroujeni,et al.  Discovery and temporal analysis of latent study patterns in MOOC interaction sequences , 2018, LAK.

[26]  Carolyn Penstein Rosé,et al.  Exploring the Effect of Student Confusion in Massive Open Online Courses , 2016, EDM.

[27]  George Siemens,et al.  Studying MOOC completion at scale using the MOOC replication framework , 2018, EDM.

[28]  Gi Woong Choi,et al.  Understanding MOOC students: motivations and behaviours indicative of MOOC completion , 2016, J. Comput. Assist. Learn..

[29]  Sarah Smith Heckman,et al.  Predicting Student Performance Based on Online Study Habits: A Study of Blended Courses , 2018, EDM.

[30]  Carolyn Penstein Rosé,et al.  “ Turn on , Tune in , Drop out ” : Anticipating student dropouts in Massive Open Online Courses , 2013 .

[31]  Sherif A. Halawa,et al.  Dropout Prediction in MOOCs using Learner Activity Features , 2014 .

[32]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[33]  Stephanie D. Teasley,et al.  A time series interaction analysis method for building predictive models of learners using log data , 2015, LAK.