Incorporating Scaffolding and Tutor Context into Bayesian Knowledge Tracing to Predict Inquiry Skill Acquisition

In this paper, we incorporate scaffolding and change of tutor context within the Bayesian Knowledge Tracing (BKT) framework to track students’ developing inquiry skills. These skills are demonstrated as students experiment within interactive simulations for two science topics. Our aim is twofold. First, we desire to improve the models’ predictive performance by adding these factors. Second, we aim to interpret these extended models to reveal if our scaffolding approach is effective, and if inquiry skills transfer across the topics. We found that incorporating scaffolding yielded better predictions of individual students’ performance over the classic BKT model. By interpreting our models, we found that scaffolding appears to be effective at helping students acquire these skills, and that the skills transfer across topics.

[1]  D. Klahr,et al.  All other things being equal: acquisition and transfer of the control of variables strategy. , 1999, Child development.

[2]  Janice D. Gobert,et al.  Leveraging Educational Data Mining for Real-time Performance Assessment of Scientific Inquiry Skills within Microworlds , 2012, EDM 2012.

[3]  Ryan Shaun Joazeiro de Baker,et al.  Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill , 2011, User Modeling and User-Adapted Interaction.

[4]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[5]  Daniel D. Suthers,et al.  Component-Based Construction of a Science Learning Space , 1998, Intelligent Tutoring Systems.

[6]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[7]  L. Schauble,et al.  Cross-Domain Development of Scientific Reasoning , 1992 .

[8]  Zachary A. Pardos,et al.  The sum is greater than the parts: ensembling models of student knowledge in educational software , 2012, SKDD.

[9]  Janice D. Gobert,et al.  Assessing the Learning and Transfer of Data Collection Inquiry Skills Using Educational Data Mining on Students ’ Log Files , 2012 .

[10]  Albert T. Corbett,et al.  Human Classification of Low-Fidelity Replays of Student Actions , 2006 .

[11]  Daniel L. Schwartz,et al.  Rethinking transfer: A simple proposal with multiple implica-tions , 1999 .

[12]  Ton de Jong,et al.  Issues in computer supported inquiry learning in science , 2007, J. Comput. Assist. Learn..

[13]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[14]  Kenneth R. Koedinger,et al.  Avoiding Problem Selection Thrashing with Conjunctive Knowledge Tracing , 2011, EDM.

[15]  Ryan Shaun Joazeiro de Baker,et al.  Contextual Slip and Prediction of Student Performance after Use of an Intelligent Tutor , 2010, UMAP.

[16]  Ryan Shaun Joazeiro de Baker,et al.  Improving construct validity yields better models of systematic inquiry, even with less information , 2012, UMAP.

[17]  E. Thorndike,et al.  The influence of improvement in one mental function upon the efficiency of other functions. (I). , 1901 .

[18]  Michael Yudelson,et al.  A multifactor approach to student model evaluation , 2008, User Modeling and User-Adapted Interaction.

[19]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[20]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[21]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[22]  Albert T. Corbett,et al.  Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology , 2008, Intelligent Tutoring Systems.

[23]  Joseph E. Beck,et al.  Identifiability: A Fundamental Problem of Student Modeling , 2007, User Modeling.

[24]  J. Shea.  National Science Education Standards , 1995 .

[25]  Leona Schauble,et al.  Scientific Reasoning Across Different Domains , 1992 .

[26]  Hasmik Mehranian,et al.  Evaluating the Feasibility of Learning Student Models from Data , 2005 .