Authoring Problem-Solving Tutors: A Comparison between ASTUS and CTAT

ASTUS is an Intelligent Tutoring System (ITS) framework for problem-solving domains. In this chapter we present a study we performed to evaluate the strengths and weaknesses of ASTUS compared to the well-known Cognitive Tutor Authoring Tools (CTAT) framework. To challenge their capacity to handle a comprehensive model of a well-defined task, we built a multi-column subtraction tutor (model and interface) with each framework. We incorporated into the model various pedagogically relevant procedural errors taken from the literature, to see how each framework deals with complex situations where remedial help may be needed. We successfully encoded the model with both frameworks and found situations in which we consider ASTUS to surpass CTAT. Examples of these include: ambiguous steps, errors with multiple (possibly correct) steps, composite errors, and off-path steps. Selected scenarios in the multi-column subtraction domain are presented to illustrate that ASTUS can show a more sophisticated behavior in these situations. ASTUS achieves this by relying on an examinable hierarchical knowledge representation system and a domain-independent MVC-based approach to build the tutors’ interface.

[1]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[2]  Antonija Mitrovic,et al.  Authoring Constraint-Based Tutors in ASPIRE , 2006, Intelligent Tutoring Systems.

[3]  Neil T. Heffernan,et al.  The AS SISTment Builder: Supporting the Life Cycle of ITS Content Creation , 2008 .

[4]  Claude Frasson,et al.  MIACE, a human cognitive architecture , 2001, SCOU.

[5]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[6]  Anthony E. Kelly,et al.  Studies of Diagnosis and Remediation with High School Algebra Students , 1989, Cogn. Sci..

[7]  Neil T. Heffernan,et al.  Expanding the Model-Tracing Architecture: A 3rd Generation Intelligent Tutor for Algebra Symbolization , 2008, Int. J. Artif. Intell. Educ..

[8]  Michael Orey Interface design for high bandwidth diagnosis: the case of POSIT , 1990 .

[9]  Sylvain Giroux,et al.  Design Challenges for Mobile Assistive Technologies Applied to People with Cognitive Impairments , 2009, ICOST.

[10]  Philippe Fournier-Viger,et al.  A Cognitive and Logic Based Model for Building Glass-Box Learning Objects , 2006 .

[11]  Kenneth R. Koedinger,et al.  Toward a Rapid Development Environment for Cognitive Tutors , 2003 .

[12]  Jean-François Lebeau,et al.  Generating Task-Specific Next-Step Hints Using Domain-Independent Structures , 2011, AIED.

[13]  Etienne Wenger,et al.  Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge , 1987 .

[14]  Neil T. Heffernan,et al.  The ASSISTment Builder: Supporting the Life Cycle of Tutoring System Content Creation , 2009, IEEE Transactions on Learning Technologies.

[15]  Jean-François Lebeau,et al.  A Standard Method of Developing User Interfaces for a Generic ITS Framework , 2008, Intelligent Tutoring Systems.

[16]  Jean-François Lebeau,et al.  Authoring Problem-Solving ITS with ASTUS , 2010, Intelligent Tutoring Systems.

[17]  Jean-François Lebeau,et al.  Integrating Sophisticated Domain-Independent Pedagogical Behaviors in an ITS Framework , 2010, Intelligent Tutoring Systems.

[18]  Philippe Fournier-Viger,et al.  From Black-Box Learning Objects to Glass-Box Learning Objects , 2006, Intelligent Tutoring Systems.

[19]  John R. Anderson,et al.  A Development System for Model-Tracing Tutors , 2008 .

[20]  Antonija Mitrovic,et al.  A Comparative Analysis of Cognitive Tutoring and Constraint-Based Modeling , 2003, User Modeling.

[21]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[22]  Peter Brusilovsky,et al.  User Modeling 2003 , 2003, Lecture Notes in Computer Science.

[23]  Vincent Aleven,et al.  A New Paradigm for Intelligent Tutoring Systems: Example-Tracing Tutors , 2009, Int. J. Artif. Intell. Educ..

[24]  Tom Murray,et al.  An Overview of Intelligent Tutoring System Authoring Tools: Updated Analysis of the State of the Art , 2003 .

[25]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[26]  Jean-François Lebeau,et al.  An Authoring Language as a Key to Usability in a Problem-Solving ITS Framework , 2010, Intelligent Tutoring Systems.

[27]  V. Aleven,et al.  Rapid Authoring of Intelligent Tutors for Real-World and Experimental Use , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[28]  Michael Orey,et al.  POSIT: process oriented subtraction-interface for tutoring , 1989 .

[29]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[30]  Andrea Valente,et al.  Exploring theoretical computer science using paper toys (for kids) , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[31]  Jean-François Lebeau,et al.  Automating Next-Step Hints Generation Using ASTUS , 2012, ITS.

[32]  Vincent Aleven,et al.  The Cognitive Tutor Authoring Tools (CTAT): Preliminary Evaluation of Efficiency Gains , 2006, Intelligent Tutoring Systems.

[33]  Lauren B. Resnick Syntax and Semantics in Learning to Subtract. , 1982 .

[34]  Kenneth R. Koedinger,et al.  Applying Programming by Demonstration in an Intelligent Authoring Tool for Cognitive Tutors , 2005 .

[35]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[36]  John Seely Brown,et al.  Towards a Generative Theory of “Bugs” , 2020, Addition and Subtraction.

[37]  Jean-François Lebeau,et al.  Automating the modeling of learners' erroneous behaviors in model-tracing tutors , 2012, UMAP.

[38]  K. VanLehn Mind Bugs: The Origins of Procedural Misconceptions , 1990 .

[39]  Jean-François Lebeau,et al.  From Cognitive to Pedagogical Knowledge Models in Problem-Solving ITS Frameworks , 2009, AIED.