Muti-behavior features based knowledge tracking using decision tree improved DKVMN

Knowledge tracing is a significant research topic in student modeling. It is a task to model students' mastery level of knowledge points by mining their historical exercise performance. Literature has shown that Dynamic Key-Value Memory Networks (DKVMN) which has been proposed to handle the knowledge tracing task generally outperform traditional methods. However, through our experimentation, we have noticed a problem in the DKVMN model that it ignored behavior features collected by intelligence tutoring system (ITS) but only regard the exercise and the correctness as input. Behavior features, such as the response time, the hint request and the number of attempt, can be used to capture the student's learning behavior information and are very helpful in modeling the student's knowledge status. Therefore, the performance of the model can be improved. This work aims to improve the performance of the DKVMN model by incorporating more features to the input. More specifically, we apply decision tree classifier to preprocess the behavior features, which is an effective way to capture how the student deviates from others in the exercise. The predicted response concatenated with the exercise tag to train a DKVMN model, which can output the probability that a student will answer the exercise correctly. The experiment results show that our adapted DKVMN model, incorporating more combinations of behavior features can effectively improve accuracy. On the ASSISTments 2009 education dataset, the AUC value of our experiment is eight percent higher than the original DKVMN model.

[1]  Huzefa Rangwala,et al.  Next-term student grade prediction , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[2]  Aditya Johri,et al.  Next-Term Student Performance Prediction: A Recommender Systems Approach , 2016, EDM.

[3]  Kenneth R. Koedinger,et al.  Individualized Bayesian Knowledge Tracing Models , 2013, AIED.

[4]  Richard G. Baraniuk,et al.  Time-varying learning and content analytics via sparse factor analysis , 2013, KDD.

[5]  Neil T. Heffernan,et al.  Addressing the assessment challenge with an online system that tutors as it assesses , 2009, User Modeling and User-Adapted Interaction.

[6]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[7]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[8]  Neil T. Heffernan,et al.  Incorporating Rich Features into Deep Knowledge Tracing , 2017, L@S.

[9]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[10]  Dit-Yan Yeung,et al.  Dynamic Key-Value Memory Networks for Knowledge Tracing , 2016, WWW.

[11]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[12]  Haiqin Yang,et al.  Heterogeneous Features Integration in Deep Knowledge Tracing , 2017, ICONIP.

[13]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[14]  Joseph E. Beck,et al.  Going Deeper with Deep Knowledge Tracing , 2016, EDM.

[15]  Jim Reye,et al.  Student Modelling Based on Belief Networks , 2004, Int. J. Artif. Intell. Educ..

[16]  Rakesh Agrawal,et al.  Data-Driven Education: Some opportunities and Challenges , 2016, EDM.