A Machine Learning Approach for Automatic Student Model Discovery

Student modeling is one of the key factors that affects automated tutoring systems in making instructional decisions. A student model is a model to predict the probability of a student making errors on given problems. A good student model that matches with student behavior patterns often provides useful information on learning task difficulty and transfer of learning between related problems, and thus often yields better instruction. Manual construction of such models usually requires substantial human effort, and may still miss distinctions in content and learning that have important instructional implications. In this paper, we propose an approach that automatically discovers student models using a state-of-art machine learning agent, SimStudent. We show that the discovered model is of higher quality than human-generated models, and demonstrate how the discovered model can be used to improve a tutoring system’s instruction strategy.

[1]  Raymond J. Mooney,et al.  A Novel Application of Theory Refinement to Student Modeling , 1996, AAAI/IAAI, Vol. 1.

[2]  Michael Villano,et al.  Probabilistic Student Models: Bayesian Belief Networks and Knowledge Space Theory , 1992, Intelligent Tutoring Systems.

[3]  Kenneth R. Koedinger,et al.  Learning Factors Transfer Analysis: Using Learning Curve Analysis to Automatically Generate Domain Models , 2009, EDM.

[4]  Kenneth R. Koedinger,et al.  A Computational Model of How Learner Errors Arise from Weak Prior Knowledge , 2009 .

[5]  Mitchell J. Nathan,et al.  The Real Story Behind Story Problems: Effects of Representations on Quantitative Reasoning , 2004 .

[6]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[7]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[8]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[9]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[10]  P. Hietala,et al.  The Competence of Learning Companion Agents , 1997 .

[11]  K. VanLehn Mind Bugs: The Origins of Procedural Misconceptions , 1990 .

[12]  Tiffany Barnes,et al.  The Q-matrix Method: Mining Student Response Data for Knowledge , 2005 .

[13]  Kenneth R. Koedinger,et al.  Seeing language learning inside the math: Cognitive analysis yields transfer , 2010 .

[14]  K. Tatsuoka RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[15]  Subbarao Kambhampati,et al.  Learning Probabilistic Hierarchical Task Networks to Capture User Preferences , 2009, IJCAI.

[16]  Kenneth R. Koedinger,et al.  A Computational Model of Accelerated Future Learning through Feature Recognition , 2010, Intelligent Tutoring Systems.

[17]  Tessa A. Lau,et al.  Programming by demonstration: an inductive learning formulation , 1998, IUI '99.

[18]  Tak-Wai Chan,et al.  Exploring the Design of Computer Supports for Reciprocal Tutoring , 1997 .

[19]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[20]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[21]  Kurt VanLehn,et al.  Applications of simulated students: an exploration , 1994 .