Explicit Reflection in Prolog-Tutor

This paper describes a reflection-based approach for open learner modeling (OLM). Tutoring dialogues are used by learners to explicitly reveal their own knowledge state to themselves. Dewey's theory of reflective thinking is used to create tutorial strategies which govern these dialogues. Drake's specification of critical thinking, associated to a defined set of skills, is used to define tutoring tactics implementing these strategies. The main contribution of this approach to OLM is that it provides a set of principled and reusable tutorial strategies and tactics to promote reflection, as they are based on domain independent theories. Furthermore, an evaluation of such a principled approach to OLM is straightforward in certain cases, as it refers to theories which already provide evaluation criteria. The approach is integrated in Prolog-Tutor, an existing intelligent tutoring system for Logic Programming. This paper presents a qualitative study of the resulting system, based on think-aloud protocols. A result analysis reveals that explicitly fostering reflection supports reflection based OLM and provides landmarks to explain its manifestations. However, the results also suggest that this openness may be less helpful when used by learners who have already honed a high level of proficiency in logic programming.

[1]  Neil T. Heffernan,et al.  An Intelligent Tutoring System Incorporating a Model of an Experienced Human Tutor , 2002, Intelligent Tutoring Systems.

[2]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[3]  H. Pain,et al.  ' Did I say what I think I said , and do you agree with me ? ' : Inspecting and Questioning the Student Model , 1995 .

[4]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[5]  Julita Vassileva,et al.  Multi-Agent Multi-User Modeling in I-Help , 2003, User Modeling and User-Adapted Interaction.

[6]  Robert M. Gagné,et al.  The Conditions of Learning and Theory of Instruction , 1985 .

[7]  Tom Murray,et al.  Formative Qualitative Evaluation for "Exploratory" ITS Research. , 1993 .

[8]  Susan Bull,et al.  Learner Models to Promote Reflection in Combined Desktop PC / Mobile Intelligent Learning Environments , 2003 .

[9]  V. Dimitrova.  Maintaining Diagnostic Interactions that Promote Learners ' Reflection , 2003 .

[10]  Tom Murray,et al.  Authoring tools for advanced technology learning environments : toward cost-effective adaptive, interactive and intelligent educational software , 2003 .

[11]  Vania Dimitrova,et al.  STyLE-OLM: Interactive Open Learner Modelling , 2003, Int. J. Artif. Intell. Educ..

[12]  Arthur C. Graesser,et al.  Simulating Human Tutor Dialog Moves in AutoTutor , 2001 .

[13]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[14]  Kurt VanLehn,et al.  Interactive Conceptual Tutoring in Atlas-Andes , 2002 .

[15]  Norman J. Bauer.  Teaching Critical Thinking: Analyzing, Learning and Teaching Critical Thinking Skillsby James A. Drake. Danville, II.: The Interstate Printers and Publishers, Inc., 1976. 237 pp. $8.75 , 1977 .

[16]  Hazel Kyrk.  : Resolving Social Conflicts: Selected Papers on Group Dynamics , 1948 .

[17]  J. Dewey.  How we think : a restatement of the relation of reflective thinking to the educative process , 1934 .

[18]  Johanna D. Moore,et al.  Toward a Synthesis of Two Accounts of Discourse Structure , 1996, CL.

[19]  Lindsey Ford,et al.  Teaching strategies and tactics in intelligent computer aided instruction , 1987, Artificial Intelligence Review.

[20]  Claus Zinn,et al.  A 3-Tier Planning Architecture for Managing Tutorial Dialogue , 2002, Intelligent Tutoring Systems.

[21]  Stellan Ohlsson,et al.  Some principles of intelligent tutoring , 1986 .

[22]  Antonija Mitrovic,et al.  Evaluating the Effects of Open Student Models on Learning , 2002, AH.

[23]  Susan Bull,et al.  Helping Learners to Understand Themselves with a Learner Model Open to Students, Peers and Instructors , 2002 .

[24]  D. Schoen.  The Reflective Practitioner , 1983 .

[25]  Jim Reye,et al.  Student Modelling Based on Belief Networks , 2004, Int. J. Artif. Intell. Educ..

[26]  G. McCalla,et al.  Active Open Learner Modelling , 2003 .

[27]  Claude Frasson,et al.  CREAM-Tools: An Authoring Environment for Knowledge Engineering in Intelligent Tutoring Systems , 2003 .

[28]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[29]  Beverly Park Woolf,et al.  A General Platform for Inquiry Learning , 2002, Intelligent Tutoring Systems.

[30]  Judy Kay,et al.  Incremental student modelling and reflection by verified concept-mapping , 2003 .

[31]  Donald A. Schön.  The reflective practitioner : how professionals think in action , 1986 .

[32]  William C. Mann,et al.  Rhetorical Structure Theory: Toward a functional theory of text organization , 1988 .

[33]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[34]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[35]  Antonija Mitrovic,et al.  Optimising ITS Behaviour with Bayesian Networks and Decision Theory , 2001 .

[36]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[37]  S. Stein.  What's All the Fuss About? , 1996 .

[38]  Vincent Aleven,et al.  Towards Tutorial Dialog to Support Self- Explanation: Adding Natural Language Understanding to a Cognitive Tutor * , 2001 .

[39]  John Self.  Bypassing the intractable problem of student modelling , 1988 .

[40]  Roger Nkambou,et al.  Elaborating the Context of Interactions in a Tutorial Dialog , 2006, IEA/AIE.

[41]  Kevin D. Ashley,et al.  Teaching Case-Based Argumentation Concepts Using Dialectic Arguments vs. Didactic Explanations , 2002, Intelligent Tutoring Systems.

[42]  Jim E. Greer,et al.  Adaptive Assessment Using Granularity Hierarchies and Bayesian Nets , 1996, Intelligent Tutoring Systems.

[43]  Claudia Gama,et al.  Metacognition in Interactive Learning Environments: The Reflection Assistant Model , 2004, Intelligent Tutoring Systems.

[44]  J. Flavell.  Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[45]  G. Cumming,et al.  Learner Models in Collaborative Intelligent Educational Systems , 1991 .

[46]  J. Greer,et al.  Analysing Student Reflection in The Learning Game , 2003 .

[47]  Jacqueline Bourdeau,et al.  Using Ontological Engineering to Overcome Common AI-ED Problems , 2000 .

[48]  Matthew B. Miles,et al.  Analyse des données qualitatives , 2003 .