A prediction model that uses the sequence of attempts and hints to better predict knowledge: "Better to attempt the problem first, rather than ask for a hint"

Intelligent Tutoring Systems (ITS) have been proven to be efficient in providing students assistance and assessing their performance when they do their homework. Many research projects have been done to analyze how students’ knowledge grows and to predict their performance from within intelligent tutoring system. Most of them focus on using correctness of the previous question or the number of hints and attempts students need to predict their future performance, but ignore how they ask for hints and make attempts. In this paper, we build a Sequence of Actions (SOA) model taking advantage of the sequence of hints and attempts a student needed for previous question to predict students’ performance. We used an ASSISTments dataset of 66 students answering a total of 34,973 problems generated from 5010 questions over the course of two years. The experimental results showed that the Sequence of Action model has reliable predictive accuracy than Knowledge Tracing.

[1]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[2]  Fengfeng Ke,et al.  Computer-game-based tutoring of mathematics , 2013, Comput. Educ..

[3]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[4]  Neil T. Heffernan,et al.  Extending the Assistance Model: Analyzing the Use of Assistance over Time , 2013, EDM.

[5]  Abdolhossein Sarrafzadeh,et al.  "How do you know that I don't understand?" A look at the future of intelligent tutoring systems , 2008, Comput. Hum. Behav..

[6]  Neil T. Heffernan,et al.  Addressing the assessment challenge with an online system that tutors as it assesses , 2009, User Modeling and User-Adapted Interaction.

[7]  Valerie J. Shute,et al.  Inference and discovery in an exploratory laboratory. , 1988 .

[8]  Zachary A. Pardos,et al.  Does Time Matter? Modeling the Effect of Time with Bayesian Knowledge Tracing , 2011, EDM.

[9]  Tom Routen,et al.  Intelligent Tutoring Systems , 1996, Lecture Notes in Computer Science.

[10]  Neil T. Heffernan,et al.  Representing Student Performance with Partial Credit , 2010, EDM.

[11]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[12]  Neil T. Heffernan,et al.  Comparing Knowledge Tracing and Performance Factor Analysis by Using Multiple Model Fitting Procedures , 2010, Intelligent Tutoring Systems.

[13]  Joseph E. Beck,et al.  Using Knowledge Tracing to Measure Student Reading Proficiencies , 2004, Intelligent Tutoring Systems.

[14]  Jussi Kasurinen,et al.  Estimating programming knowledge with Bayesian knowledge tracing , 2009, ITiCSE.

[15]  Randall W. Hill,et al.  Pedagogically Structured Game-Based Training: Development of the Elect BiLAT Simulation , 2006 .

[16]  J. S. Brown,et al.  Pedagogical, natural language, and knowledge engineering techniques in SOPHIE-I, II and III , 1982 .

[17]  William J. Clancey,et al.  Dialogue Management for Rule-Based Tutorials , 1979, IJCAI.

[18]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[19]  Neil T. Heffernan,et al.  Predicting State Test Scores Better with Intelligent Tutoring Systems: Developing Metrics to Measure Assistance Required , 2006, Intelligent Tutoring Systems.

[20]  Thomas F. Stahovich,et al.  Newton's Pen: a pen-based tutoring system for statics , 2007, SBIM '07.

[21]  Beverly Park Woolf,et al.  Web-Based Intelligent Multimedia Tutoring for High Stakes Achievement Tests , 2004, Intelligent Tutoring Systems.

[22]  Zachary A. Pardos,et al.  Navigating the parameter space of Bayesian Knowledge Tracing models: Visualizations of the convergence of the Expectation Maximization algorithm , 2010, EDM.

[23]  Vincent Aleven,et al.  Intelligent Tutoring Goes To School in the Big City , 1997 .

[24]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[25]  Neelu Jyothi Ahuja,et al.  A Critical Review of Development of Intelligent Tutoring Systems: Retrospect, Present and Prospect , 2013 .

[26]  Benjamin Shih,et al.  Discovery of Student Strategies using Hidden Markov Model Clustering , 2009 .

[27]  Neil T. Heffernan,et al.  Addressing the testing challenge with a web-based e-assessment system that tutors as it assesses , 2006, WWW '06.

[28]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[29]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[30]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[31]  Neil T. Heffernan,et al.  The "Assistance" Model: Leveraging How Many Hints and Attempts a Student Needs , 2011, FLAIRS Conference.

[32]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[33]  William J. Clancey,et al.  Dialogue management for rulebased tutorials , 1979, IJCAI 1979.

[34]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[35]  R. Charles Murray,et al.  Reducing the Knowledge Tracing Space , 2009, EDM.

[36]  Richard C. Atkinson,et al.  Ingredients for a theory of instruction. , 1972 .

[37]  Neil T. Heffernan,et al.  Automatic and Semi-Automatic Skill Coding With a View Towards Supporting On-Line Assessment , 2005, AIED.