Adapting to When Students Game an Intelligent Tutoring System

It has been found in recent years that many students who use intelligent tutoring systems game the system, attempting to succeed in the educational environment by exploiting properties of the system rather than by learning the material and trying to use that knowledge to answer correctly. In this paper, we introduce a system which gives a gaming student supplementary exercises focused on exactly the material the student bypassed by gaming, and which also expresses negative emotion to gaming students through an animated agent. Students using this system engage in less gaming, and students who receive many supplemental exercises have considerably better learning than is associated with gaming in the control condition or prior studies.

[1]  Richard C. Anderson,et al.  FEEDBACK PROCEDURES IN COMPUTER-ASSISTED ARITHMETIC INSTRUCTION , 1973 .

[2]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[3]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[4]  Mathieu Koppen,et al.  Introduction to knowledge spaces: How to build, test, and search them , 1990 .

[5]  A. diSessa.  Toward an Epistemology of Physics , 1993 .

[6]  E. Maris.  Psychometric latent response models , 1995 .

[7]  Kenneth R. Koedinger,et al.  An architecture for plug-in tutor agents , 1996 .

[8]  Mary A. Mark,et al.  An Interview Reflection on “Intelligent Tutoring Goes to School in the Big City” , 2015, International Journal of Artificial Intelligence in Education.

[9]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[10]  Tim Penelitian dan Pengembangan Wahana Komputer.  Microsoft office 97 , 2001 .

[11]  Jack Mostow,et al.  A La Recherche du Temps Perdu, or As Time Goes By: Where Does the Time Go in a Reading Tutor That Listens? , 2002, Intelligent Tutoring Systems.

[12]  Carol M. Lerch.  Control decisions and personal beliefs: their effect on solving mathematical problems , 2004 .

[13]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[14]  K. Squire,et al.  Design-Based Research: Putting a Stake in the Ground , 2004 .

[15]  Ronald H. Stevens,et al.  Modeling the Development of Problem Solving Skills in Chemistry with a Web-Based Tutor , 2004, Intelligent Tutoring Systems.

[16]  Jack Mostow,et al.  Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens , 2004 .

[17]  Vincent Aleven,et al.  Toward Tutoring Help Seeking: Applying Cognitive Modeling to Meta-cognitive Skills , 2004, Intelligent Tutoring Systems.

[18]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[19]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[20]  Beverly Park Woolf,et al.  Inferring learning and attitudes from a Bayesian Network of log file data , 2005, AIED.

[21]  Neil T. Heffernan,et al.  Informing Teachers Live about Student Learning: Reporting in Assistment System , 2005 .

[22]  Ryan Shaun Joazeiro de Baker,et al.  Do Performance Goals Lead Students to Game the System? , 2005, AIED.

[23]  Kurt VanLehn,et al.  Effects of Dissuading Unnecessary Help Requests While Providing Proactive Help , 2005, AIED.

[24]  Ryan Shaun Joazeiro de Baker,et al.  Detecting When Students Game the System, Across Tutor Subjects and Classroom Cohorts , 2005, User Modeling.

[25]  Julita Vassileva,et al.  Adaptive Reward Mechanism for Sustainable Online Learning Community , 2005, AIED.

[26]  Paul Brna,et al.  User Modeling 2005, 10th International Conference, UM 2005, Edinburgh, Scotland, UK, July 24-29, 2005, Proceedings , 2005, User Modeling.

[27]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[28]  Antonija Mitrovic,et al.  Constraint-based knowledge representation for individualized instruction , 2006, Comput. Sci. Inf. Syst..

[29]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[30]  Neil T. Heffernan,et al.  Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems , 2006, Intelligent Tutoring Systems.

[31]  Neil T. Heffernan,et al.  Addressing the testing challenge with a web-based e-assessment system that tutors as it assesses , 2006, WWW '06.

[32]  Beverly Park Woolf,et al.  Repairing Disengagement With Non-Invasive Interventions , 2007, AIED.

[33]  Philip I. Pavlik.  Optimizing Knowledge Component Learning Using a Dynamic Structural Model of Practice , 2007 .

[34]  Kurt VanLehn,et al.  Exploring Alternative Methods for Error Attribution in Learning Curves Analysis in Intelligent Tutoring Systems , 2007, AIED.

[35]  Kenneth R. Koedinger,et al.  Is Over Practice Necessary? - Improving Learning Efficiency with the Cognitive Tutor through Educational Data Mining , 2007, AIED.

[36]  Paul R. Cohen,et al.  Modeling learning patterns of students with a tutoring system using Hidden Markov Models , 2007, AIED.

[37]  K. VanLehn,et al.  Self-explaining in the Classroom: Learning Curve Evidence , 2007 .

[38]  Anna N. Rafferty,et al.  Applying Learning Factors Analysis to Build Stereotypic Student Models , 2007, AIED.

[39]  Kenneth R. Koedinger,et al.  Can a Polite Intelligent Tutoring System Lead to Improved Learning Outside of the Lab? , 2007, AIED.