Modelling End-of-Session Actions in Educational Systems

In this paper we consider the problem of modelling when students end their session in an online mathematics educational system. Being able to model this accurately will help us optimize the way content is presented and consumed. This is done by modelling the probability of an action being the last in a session, which we denote as the End-of-Session probability. We use log data from a system where students can learn mathematics through various kinds of learning materials, as well as multiple types of exercises, such that a student session can consist of many different activities. We model the End-of-Session probability by a deep recurrent neural network in order to utilize the long term temporal aspect, which we experimentally show is central for this task. Using a large scale dataset of more than 70 million student actions, we obtain an AUC of 0.81 on an unseen collection of students. Through a detailed error analysis, we observe that our model is robust across different session structures and across varying session lengths.

[1]  Marlon Dumas,et al.  Predictive Business Process Monitoring with LSTM Neural Networks , 2016, CAiSE.

[2]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[3]  Lubos Popelínský,et al.  Predicting drop-out from social behaviour of students , 2012, EDM.

[4]  Mária Bieliková,et al.  Student behavior in a web-based educational system: Exit intent prediction , 2016, Eng. Appl. Artif. Intell..

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Xin Chen,et al.  Temporal predication of dropouts in MOOCs: Reaching the low hanging fruit through stacking generalization , 2016, Comput. Hum. Behav..

[7]  Stephen Alstrup,et al.  Temporal Context for Authorship Attribution - A Study of Danish Secondary Schools , 2014, IRFC.

[8]  Neil T. Heffernan,et al.  Incorporating Rich Features into Deep Knowledge Tracing , 2017, L@S.

[9]  Christian Hansen,et al.  Modelling Sequential Music Track Skips using a Multi-RNN Approach , 2019, ArXiv.

[10]  Chao Li,et al.  Machine learning application in MOOCs: Dropout prediction , 2016, 2016 11th International Conference on Computer Science & Education (ICCSE).

[11]  Christian Hansen,et al.  Sequence Modelling For Analysing Student Interaction with Educational Systems , 2017, EDM.

[12]  Sherif A. Halawa,et al.  Dropout Prediction in MOOCs using Learner Activity Features , 2014 .

[13]  Theodore Vasiloudis,et al.  Predicting Session Length in Media Streaming , 2017, SIGIR.

[14]  Neural Speed Reading with Structural-Jump-LSTM , 2019, ICLR.

[15]  Min Chi,et al.  Clustering Student Sequential Trajectories Using Dynamic Time Wrapping , 2017, EDM.

[16]  Markus H. Gross,et al.  Temporally Coherent Clustering of Student Data , 2016, EDM.