Opening Up an Intelligent Tutoring System Development Environment for Extensible Student Modeling

ITS authoring tools make creating intelligent tutoring systems more cost effective, but few authoring tools make it easy to flexibly incorporate an open-ended range of student modeling methods and learning analytics tools. To support a cumulative science of student modeling and enhance the impact of real-world tutoring systems, it is critical to extend ITS authoring tools so they easily accommodate novel student modeling methods. We report on extensions to the CTAT/Tutorshop architecture to support a plug-in approach to extensible student modeling, which gives an author full control over the content of the student model. The extensions enhance the range of adaptive tutoring behaviors that can be authored and support building external, student- or teacher-facing real-time analytics tools. The contributions of this work are: (1) an open architecture to support the plugging in, sharing, re-mixing, and use of advanced student modeling techniques, ITSs, and dashboards; and (2) case studies illustrating diverse ways authors have used the architecture.

[1]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[2]  Neil T. Heffernan,et al.  The ASSISTment Builder: Supporting the Life Cycle of Tutoring System Content Creation , 2009, IEEE Transactions on Learning Technologies.

[3]  R. Calvo,et al.  New Perspectives on Affect and Learning Technologies , 2011 .

[4]  A. Graesser,et al.  A Motivationally Supportive Affect-Sensitive AutoTutor , 2011 .

[5]  Arthur C. Graesser,et al.  Special Issue on the Generalized Intelligent Framework for Tutoring (GIFT): Creating a Stable and Flexible Platform for Innovations in AIED Research , 2018, International Journal of Artificial Intelligence in Education.

[6]  Ryan Shaun Joazeiro de Baker,et al.  Sequences of Frustration and Confusion, and Learning , 2013, EDM.

[7]  Kurt VanLehn Regulative Loops, Step Loops and Task Loops , 2015, International Journal of Artificial Intelligence in Education.

[8]  Vincent Aleven,et al.  SPACLE: investigating learning across virtual and physical spaces using spatial replays , 2017, LAK.

[9]  Vincent Aleven,et al.  Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems , 2016, International Journal of Artificial Intelligence in Education.

[10]  Ravikiran Vatrapu,et al.  iKlassroom: Real-Time, Real-Place Teaching Analytics , 2013, IWTA@LAK.

[11]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[12]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[13]  Vincent Aleven,et al.  Robust Evaluation Matrix: Towards a More Principled Offline Exploration of Instructional Policies , 2017, L@S.

[14]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[15]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[16]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[17]  Neil T. Heffernan,et al.  Authoring Example-based Tutors for Procedural Tasks , 2015 .

[18]  Kenneth R. Koedinger,et al.  Individualized Bayesian Knowledge Tracing Models , 2013, AIED.

[19]  Neil T. Heffernan,et al.  Modeling Wheel-spinning and Productive Persistence in Skill Builders , 2017, EDM.

[20]  Manolis Mavrikis,et al.  Light-Bulb Moment?: Towards Adaptive Presentation of Feedback based on Students' Affective State , 2015, IUI.

[21]  Ryan Shaun Joazeiro de Baker,et al.  A System-General Model for the Detection of Gaming the System Behavior in CTAT and LearnSphere , 2018, AIED.

[22]  Stephen Fancsali,et al.  Causal Discovery with Models: Behavior, Affect, and Learning in Cognitive Tutor Algebra , 2014, EDM.

[23]  Vincent Aleven,et al.  Luna: A Dashboard for Teachers Using Intelligent Tutoring Systems , 2016, IWTA@EC-TEL.

[24]  Vincent Aleven,et al.  Instruction Based on Adaptive Learning Technologies , 2016 .

[25]  Vincent Aleven,et al.  Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms , 2018, AIED.

[26]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[27]  Kenneth R. Koedinger,et al.  Authoring Tutors with SimStudent: An Evaluation of Efficiency and Model Quality , 2014, Intelligent Tutoring Systems.

[28]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[29]  Vincent Aleven,et al.  Effects of a Teacher Dashboard for an Intelligent Tutoring System on Teacher Knowledge, Lesson Planning, Lessons and Student Learning , 2017, EC-TEL.

[30]  Vincent Aleven,et al.  Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers , 2016, International Journal of Artificial Intelligence in Education.

[31]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[32]  Vincent Aleven,et al.  Authoring Tools for Collaborative Intelligent Tutoring System Environments , 2014, Intelligent Tutoring Systems.

[33]  Vincent Aleven,et al.  Sequence Matters, But How Exactly? A Method for Evaluating Activity Sequences from Data , 2016, EDM.

[34]  Antonija Mitrovic,et al.  ASPIRE: An Authoring System and Deployment Environment for Constraint-Based Tutors , 2009, Int. J. Artif. Intell. Educ..

[35]  Vincent Aleven,et al.  The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers , 2018, LAK.

[36]  John C. Stamper,et al.  Toward "Hyper-Personalized" Cognitive Tutors: Non-Cognitive Personalization in the Generalized Intelligent Framework for Tutoring , 2013, AIED Workshops.

[37]  Brad A. Myers,et al.  Exploring exploratory programming , 2017, 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[38]  Vincent Aleven,et al.  Supporting Students' Self-Regulated Learning with an Open Learner Model in a Linear Equation Tutor , 2013, AIED.

[39]  Radek Pelánek,et al.  Experimental Analysis of Mastery Learning Criteria , 2017, UMAP.