Peer-inspired Student Performance Prediction in Interactive Online Question Pools with Graph Neural Network

Student performance prediction is critical to online education. It can benefit many downstream tasks on online learning platforms, such as estimating dropout rates, facilitating strategic intervention, and enabling adaptive online learning. Interactive online question pools provide students with interesting interactive questions to practice their knowledge in online education. However, little research has been done on student performance prediction in interactive online question pools. Existing work on student performance prediction targets at online learning platforms with predefined course curriculum and accurate knowledge labels like MOOC platforms, but they are not able to fully model knowledge evolution of students in interactive online question pools. In this paper, we propose a novel approach using Graph Neural Networks (GNNs) to achieve better student performance prediction in interactive online question pools. Specifically, we model the relationship between students and questions using student interactions to construct the student-interaction-question network and further present a new GNN model, called R2GCN, which intrinsically works for the heterogeneous networks, to achieve generalizable student performance prediction in interactive online question pools. We evaluate the effectiveness of our approach on a real-world dataset consisting of 104,113 mouse trajectories generated in the problem-solving process of over 4,000 students on 1,631 questions. The experiment results show that our approach can achieve a much higher accuracy of student performance prediction than both traditional machine learning approaches and GNN models.

[1]  Miltiadis D. Lytras,et al.  Predicting Student Performance using Advanced Learning Analytics , 2017, WWW.

[2]  Piotr Sapiezynski,et al.  Academic performance and behavioral patterns , 2017, EPJ Data Science.

[3]  Mark Warschauer,et al.  Predicting MOOC performance with Week 1 Behavior , 2014, EDM.

[4]  Rose Yu,et al.  Understanding the Representation Power of Graph Neural Networks in Learning Graph Topology , 2019, NeurIPS.

[5]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[6]  Linda Corrin,et al.  Predicting success: how learners' prior knowledge, skills and activities predict MOOC performance , 2015, LAK.

[7]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[8]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[9]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[10]  Yong Wang,et al.  Predicting student performance in interactive online question pools using mouse interaction features , 2020, LAK.

[11]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[12]  Sune Lehmann,et al.  Class attendance, peer similarity, and academic performance in a large field study , 2017, PloS one.

[13]  Paulo Carvalho,et al.  Comprehension Factor Analysis: Modeling student's reading behaviour: Accounting for reading practice in predicting students' learning in MOOCs , 2019, LAK.

[14]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[15]  Aditya Johri,et al.  Predicting Performance on MOOC Assessments using Multi-Regression Models , 2016, EDM.

[16]  Lars Schmidt-Thieme,et al.  Recommender system for predicting student performance , 2010, RecSysTEL@RecSys.

[17]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[18]  Huzefa Rangwala,et al.  Academic Performance Estimation with Attention-based Graph Convolutional Networks , 2019, EDM.

[19]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[20]  Penghe Chen,et al.  Prerequisite-Driven Deep Knowledge Tracing , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[21]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[22]  Yutaka Matsuo,et al.  Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network , 2019, 2019 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[23]  Philip S. Yu,et al.  Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks , 2019, IJCAI.

[24]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.