Deep Attentive Study Session Dropout Prediction in Mobile Learning Environment

Student dropout prediction provides an opportunity to improve student engagement, which maximizes the overall effectiveness of learning experiences. However, researches on student dropout were mainly conducted on school dropout or course dropout, and study session dropout in a mobile learning environment has not been considered thoroughly. In this paper, we investigate the study session dropout prediction problem in a mobile learning environment. First, we define the concept of the study session, study session dropout and study session dropout prediction task in a mobile learning environment. Based on the definitions, we propose a novel Transformer based model for predicting study session dropout, DAS: Deep Attentive Study Session Dropout Prediction in Mobile Learning Environment. DAS has an encoder-decoder structure which is composed of stacked multi-head attention and point-wise feed-forward networks. The deep attentive computations in DAS are capable of capturing complex relations among dynamic student interactions. To the best of our knowledge, this is the first attempt to investigate study session dropout in a mobile learning environment. Empirical evaluations on a large-scale dataset show that DAS achieves the best performance with a significant improvement in area under the receiver operating characteristic curve compared to baseline models.

[1]  Yang Song,et al.  Real-time automatic tag recommendation , 2008, SIGIR '08.

[2]  Vassilis Loumos,et al.  Dropout prediction in e-learning courses through the combination of machine learning techniques , 2009, Comput. Educ..

[3]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[4]  Isabelle Archambault,et al.  Student engagement and its relationship with early high school dropout. , 2009, Journal of adolescence.

[5]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[6]  Toru Sato,et al.  Cell phone use and grade point average among undergraduate university students. , 2011 .

[7]  Scott M. Pappada,et al.  Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. , 2011, Diabetes technology & therapeutics.

[8]  Reynol Junco,et al.  Too much face and not enough books: The relationship between multiple indices of Facebook use and academic performance , 2012, Comput. Hum. Behav..

[9]  M. Tahar Kechadi,et al.  Customer churn prediction in telecommunications , 2012, Expert Syst. Appl..

[10]  Sherif A. Halawa,et al.  Dropout Prediction in MOOCs using Learner Activity Features , 2014 .

[11]  Aaron Halfaker,et al.  User Session Identification Based on Strong Regularities in Inter-activity Time , 2014, WWW.

[12]  András A. Benczúr,et al.  Machine Learning Based Session Drop Prediction in LTE Networks and Its SON Aspects , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Stephen Alstrup,et al.  High-School Dropout Prediction Using Machine Learning: A Danish Large-scale Study. , 2015 .

[15]  Chao Li,et al.  Machine learning application in MOOCs: Dropout prediction , 2016, 2016 11th International Conference on Computer Science & Education (ICCSE).

[16]  Quan Chen,et al.  Does multitasking with mobile phones affect learning? A review , 2016, Comput. Hum. Behav..

[17]  Jian Yang,et al.  Big Data Application in Education: Dropout Prediction in Edx MOOCs , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[18]  Habib Fardoun,et al.  Early dropout prediction using data mining: a case study with high school students , 2016, Expert Syst. J. Knowl. Eng..

[19]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[20]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[21]  Jacob Whitehill,et al.  Delving Deeper into MOOC Student Dropout Prediction , 2017, ArXiv.

[22]  Anca D. Dragan,et al.  Accelerating Human Learning with Deep Reinforcement Learning , 2017 .

[23]  Wu Zhang,et al.  Using machine learning to predict student difficulties from learning session data , 2018, Artificial Intelligence Review.

[24]  Shou-De Lin,et al.  WSDM Cup 2018: Music Recommendation and Churn Prediction , 2018, WSDM.

[25]  Yong Tang,et al.  Personalized learning full-path recommendation model based on LSTM neural networks , 2018, Inf. Sci..

[26]  George Karypis,et al.  A Self Attentive model for Knowledge Tracing , 2019, EDM.

[27]  Jie Tang,et al.  Understanding Dropouts in MOOCs , 2019, AAAI.

[28]  Enhong Chen,et al.  Exploiting Cognitive Structure for Adaptive Learning , 2019, KDD.

[29]  Ferenc Béres Sequential skip prediction using deep learning and ensembles , 2019 .

[30]  Dragomir R. Radev,et al.  Creating A Neural Pedagogical Agent by Jointly Learning to Review and Assess , 2019, ArXiv.

[31]  Hongzhi Wang,et al.  Predicting learning status in MOOCs using LSTM , 2018, ACM TUR-C.

[32]  Christian Hansen,et al.  Modelling Sequential Music Track Skips using a Multi-RNN Approach , 2019, ArXiv.

[33]  Justin Reich,et al.  The MOOC pivot , 2019, Science.

[34]  Dongmin Shin,et al.  EdNet: A Large-Scale Hierarchical Dataset in Education , 2019, AIED.