Knowledge Tracing: A Survey

Humans’ ability to transfer knowledge through teaching is one of the essential aspects for human intelligence. A human teacher can track the knowledge of students to customize the teaching on students’ needs. With the rise of online education platforms, there is a similar need for machines to track the knowledge of students and tailor their learning experience. This is known as the Knowledge Tracing (KT) problem in the literature. Effectively solving the KT problem would unlock the potential of computer-aided education applications such as intelligent tutoring systems, curriculum learning, and learning materials’ recommendation. Moreover, from a more general viewpoint, a student may represent any kind of intelligent agents including both human and artificial agents. Thus, the potential of KT can be extended to any machine teaching application scenarios which seek for customizing the learning experience for a student agent (i.e., a machine learning model). In this paper, we provide a comprehensive and systematic review for the KT literature. We cover a broad range of methods starting from the early attempts to the recent state-of-the-art methods using deep learning, while highlighting the theoretical aspects of models and the characteristics of benchmark datasets. Besides these, we shed light on key modelling differences between closely related methods and summarize them in an easy-to-understand format. Finally, we discuss current research gaps in the KT literature and possible future research and application directions.

[1]  Michael Villano,et al.  Probabilistic Student Models: Bayesian Belief Networks and Knowledge Space Theory , 1992, Intelligent Tutoring Systems.

[2]  Fu Chen,et al.  Analyzing Student Process Data in Game-Based Assessments with Bayesian Knowledge Tracing and Dynamic Bayesian Networks. , 2019 .

[3]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[4]  Jichen Zhu,et al.  Tracing Player Knowledge in a Parallel Programming Educational Game , 2018, AIIDE.

[5]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[6]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[7]  Lars Schmidt-Thieme,et al.  Using factorization machines for student modeling , 2012, UMAP Workshops.

[8]  Enhong Chen,et al.  Exploiting Cognitive Structure for Adaptive Learning , 2019, KDD.

[9]  Jaideep Srivastava,et al.  RKT: Relation-Aware Self-Attention for Knowledge Tracing , 2020, CIKM.

[10]  T. Szabados An elementary introduction to the Wiener process and stochastic integrals , 2010, 1008.1510.

[11]  Dit-Yan Yeung,et al.  Dynamic Key-Value Memory Networks for Knowledge Tracing , 2016, WWW.

[12]  Moshe Y. Vardi Will MOOCs destroy academia? , 2012, CACM.

[13]  Robert Babuska,et al.  A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Alexey Ignatiev,et al.  Towards Trustable Explainable AI , 2020, IJCAI.

[15]  Emma Brunskill,et al.  The Impact on Individualizing Student Models on Necessary Practice Opportunities , 2012, EDM.

[16]  Chaitanya Ekanadham,et al.  Back to the basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation , 2016, EDM.

[17]  M. Zickar,et al.  Review of Item Response Theory Practices in Organizational Research , 2017 .

[18]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[19]  Anselm Haselhoff,et al.  Towards Black-Box Explainability with Gaussian Discriminant Knowledge Distillation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[20]  Stefan Kopp,et al.  Adaptive Robot Language Tutoring Based on Bayesian Knowledge Tracing and Predictive Decision-Making , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[21]  Yi Yu,et al.  Deep Knowledge Tracing and Dynamic Student Classification for Knowledge Tracing , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[22]  Christine E. DeMars,et al.  Item Response Theory , 2010, Assessing Measurement Invariance for Applied Research.

[23]  Peter Brusilovsky,et al.  General Features in Knowledge Tracing to Model Multiple Subskills, Temporal Item Response Theory, and Expert Knowledge , 2014, EDM.

[24]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[25]  F. Lord A THEORY OF TEST SCORES AND THEIR RELATION TO THE TRAIT MEASURED , 1951 .

[26]  Yong Yu,et al.  GIKT: A Graph-based Interaction Model for Knowledge Tracing , 2020, ECML/PKDD.

[27]  Radek Pelánek,et al.  Modeling Students' Memory for Application in Adaptive Educational Systems , 2015, EDM.

[28]  David Andrich Book Review : Probabilistic Models for Some Intelligence and Attainment Tests (expanded edition , 1981 .

[29]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kenneth R. Koedinger,et al.  Individualized Bayesian Knowledge Tracing Models , 2013, AIED.

[31]  Burr Settles,et al.  A Trainable Spaced Repetition Model for Language Learning , 2016, ACL.

[32]  Jaap M. J. Murre,et al.  Replication and Analysis of Ebbinghaus’ Forgetting Curve , 2015, PloS one.

[33]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[34]  Zachary A. Pardos,et al.  Adapting Bayesian Knowledge Tracing to a Massive Open Online Course in edX , 2013, EDM.

[35]  William Eberle,et al.  Towards Quantification of Explainability in Explainable Artificial Intelligence Methods , 2019, FLAIRS.

[36]  Vincent Aleven,et al.  Educational Game and Intelligent Tutoring System , 2017, ACM Trans. Comput. Hum. Interact..

[37]  George Karypis,et al.  A Self Attentive model for Knowledge Tracing , 2019, EDM.

[38]  John R. Anderson,et al.  Cognitive Modeling and Intelligent Tutoring , 1990, Artif. Intell..

[39]  Joseph E. Beck,et al.  Going Deeper with Deep Knowledge Tracing , 2016, EDM.

[40]  Dongmin Shin,et al.  SAINT+: Integrating Temporal Features for EdNet Correctness Prediction , 2020, LAK.

[41]  Alexander G. Schwing,et al.  Dynamic Bayesian Networks for Student Modeling , 2017, IEEE Transactions on Learning Technologies.

[42]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[44]  Michael C. Mozer,et al.  Integrating latent-factor and knowledge-tracing models to predict individual differences in learning , 2014, EDM.

[45]  J. Stenton,et al.  Learning how to teach. , 1973, Nursing mirror and midwives journal.

[46]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[47]  Yutaka Matsuo,et al.  Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network , 2019, 2019 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[48]  Yuan Zhang,et al.  Learning Path Recommendation Based on Knowledge Tracing Model and Reinforcement Learning , 2019, 2019 IEEE 5th International Conference on Computer and Communications (ICCC).

[49]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[50]  Zachary A. Pardos,et al.  Does Time Matter? Modeling the Effect of Time with Bayesian Knowledge Tracing , 2011, EDM.

[51]  Tomoko Ohkuma,et al.  Augmenting Knowledge Tracing by Considering Forgetting Behavior , 2019, WWW.

[52]  Aditya Johri,et al.  Next-Term Student Performance Prediction: A Recommender Systems Approach , 2016, EDM.

[53]  Enhong Chen,et al.  Structure-based Knowledge Tracing: An Influence Propagation View , 2020, 2020 IEEE International Conference on Data Mining (ICDM).

[54]  William J. Clancey,et al.  Cognitive Modeling and Intelligent Tutoring , 1990 .

[55]  Aritra Ghosh,et al.  Context-Aware Attentive Knowledge Tracing , 2020, KDD.

[56]  Alex Graves,et al.  Neural Turing Machines , 2014, ArXiv.

[57]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[58]  Enhong Chen,et al.  Exploring Multi-Objective Exercise Recommendations in Online Education Systems , 2019, CIKM.

[59]  Le Wu,et al.  Tracking Knowledge Proficiency of Students with Educational Priors , 2017, CIKM.

[60]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[61]  HGKT : Introducing Problem Schema with Hierarchical Exercise Graph for Knowledge Tracing , 2020, ArXiv.

[62]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[63]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[64]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[65]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[66]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[67]  Qi Liu,et al.  Learning or Forgetting? A Dynamic Approach for Tracking the Knowledge Proficiency of Students , 2020, ACM Trans. Inf. Syst..

[68]  Alexander Kolesnikov,et al.  S4L: Self-Supervised Semi-Supervised Learning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[69]  Kenneth R. Koedinger,et al.  Comparing Two IRT Models for Conjunctive Skills , 2008, Intelligent Tutoring Systems.

[70]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[71]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[72]  Albert T. Corbett,et al.  Cognitive Mastery Learning in the ACT Programming Tutor , 2000 .

[73]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[74]  Hui Xiong,et al.  EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction , 2019, IEEE Transactions on Knowledge and Data Engineering.

[75]  Allan Birnbaum STATISTICAL THEORY FOR LOGISTIC MENTAL TEST MODELS WITH A PRIOR DISTRIBUTION OF ABILITY , 1967 .

[76]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[77]  Ghodai M. Abdelrahman,et al.  Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing , 2021, IEEE Transactions on Knowledge and Data Engineering.

[78]  Frederic M. Lord,et al.  An Upper Asymptote for the Three-Parameter Logistic Item-Response Model. , 1981 .

[79]  Huaping Liu,et al.  Understanding the Behaviour of Contrastive Loss , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[80]  Dit-Yan Yeung,et al.  Addressing two problems in deep knowledge tracing via prediction-consistent regularization , 2018, L@S.

[81]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[82]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[83]  Byungsoo Kim,et al.  Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing , 2020, L@S.

[84]  Kuan-Ta Chen,et al.  Modeling Exercise Relationships in E-Learning: A Unified Approach , 2015, EDM.

[85]  Hisashi Kashima,et al.  Knowledge Tracing Machines: Factorization Machines for Knowledge Tracing , 2018, AAAI.

[86]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[87]  Mohammad Ahmad Alkhateeb,et al.  Effect of Mobile Gaming on Mathematical Achievement among 4th Graders , 2019, Int. J. Emerg. Technol. Learn..

[88]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[89]  Enhong Chen,et al.  A Survey of Knowledge Tracing , 2021, ArXiv.

[90]  Armand Joulin,et al.  Self-supervised Pretraining of Visual Features in the Wild , 2021, ArXiv.

[91]  R. Charles Murray,et al.  Revealing the Learning in Learning Curves , 2013, AIED.

[92]  Laurens van der Maaten,et al.  Self-Supervised Learning of Pretext-Invariant Representations , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[93]  John R. Anderson,et al.  Practice and Forgetting Effects on Vocabulary Memory: An Activation-Based Model of the Spacing Effect , 2005, Cogn. Sci..

[94]  Anja Hawlitschek,et al.  Increasing the effectiveness of digital educational games: The effects of a learning instruction on students' learning, motivation and cognitive load , 2017, Comput. Hum. Behav..

[95]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[96]  Lijun Wu,et al.  Learning to Teach with Dynamic Loss Functions , 2018, NeurIPS.

[97]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[98]  Jason Weston,et al.  Key-Value Memory Networks for Directly Reading Documents , 2016, EMNLP.

[99]  Yi Sun,et al.  Modeling learner’s dynamic knowledge construction procedure and cognitive item difficulty for knowledge tracing , 2020, Applied Intelligence.

[100]  Supreeth M. Gowda,et al.  Affective States and State Tests: Investigating How Affect and Engagement during the School Year Predict End-of-Year Learning Outcomes , 2014, J. Learn. Anal..

[101]  Qing Wang,et al.  Knowledge Tracing with Sequential Key-Value Memory Networks , 2019, SIGIR.

[102]  Byungsoo Kim,et al.  EdNet: A Large-Scale Hierarchical Dataset in Education , 2020, AIED.

[103]  Enhong Chen,et al.  Exercise-Enhanced Sequential Modeling for Student Performance Prediction , 2018, AAAI.

[104]  Yiqun Liu,et al.  Temporal Cross-Effects in Knowledge Tracing , 2021, WSDM.

[105]  B. Green,et al.  A general solution for the latent class model of latent structure analysis. , 1951, Psychometrika.

[106]  Ghodai M. Abdelrahman,et al.  Learning Data Teaching Strategies Via Knowledge Tracing , 2021, Knowl. Based Syst..

[107]  Xiaojin Zhu,et al.  Machine Teaching: An Inverse Problem to Machine Learning and an Approach Toward Optimal Education , 2015, AAAI.

[108]  Neil T. Heffernan,et al.  Addressing the assessment challenge with an online system that tutors as it assesses , 2009, User Modeling and User-Adapted Interaction.

[109]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[110]  Nour-Eddine El Faddouli,et al.  Predicting Learners Need for Recommendation Using Dynamic Graph-Based Knowledge Tracing , 2020, AIED.

[111]  Peter Brusilovsky,et al.  Integrating Knowledge Tracing and Item Response Theory: A Tale of Two Frameworks , 2014, UMAP Workshops.

[112]  Hedderik van Rijn,et al.  An Individual's Rate of Forgetting Is Stable Over Time but Differs Across Materials , 2016, Top. Cogn. Sci..

[113]  Enhong Chen,et al.  QuesNet: A Unified Representation for Heterogeneous Test Questions , 2019, KDD.

[114]  Marie Schmidt,et al.  Intelligent Tutoring Systems Lessons Learned , 2016 .