UsingWeighted Constraints to Diagnose Errors in Logic Programming - The Case of an Ill-defined Domain

In this paper, we introduce logic programming as a domain that exhibits some characteristics of being ill-defined. In order to diagnose student errors in such a domain, we need a means to hypothesise the student's intention, that is the strategy underlying her solution. This is achieved by weighting constraints, so that hypotheses about solution strategies, programming patterns and error diagnoses can be ranked and selected. Since diagnostic accuracy becomes an increasingly important issue, we present an evaluation methodology that measures diagnostic accuracy in terms of (1) the ability to identify the actual solution strategy, and (2) the reliability of error diagnoses. The evaluation results confirm that the system is able to analyse a major share of real student solutions, providing highly informative and precise feedback.

[1]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[2]  Herbert A. Simon,et al.  The Structure of Ill Structured Problems , 1973, Artif. Intell..

[3]  Antonija Mitrovic,et al.  A Critique of Kodaganallur, Weitz and Rosenthal, "A Comparison of Model-Tracing and Constraint-Based Intelligent Tutoring Paradigms" , 2006, Int. J. Artif. Intell. Educ..

[4]  David Rosenthal,et al.  An Assessment of Constraint-Based Tutors: A Response to Mitrovic and Ohlsson's Critique of "A Comparison of Model-Tracing and Constraint-Based Intelligent Tutoring Paradigms" , 2006, Int. J. Artif. Intell. Educ..

[5]  Wolfgang Menzel,et al.  Problem Solving Process Oriented Diagnosis in Logic Programming , 2006, ICCE.

[6]  Antonija Mitrovic,et al.  NORMIT: a Web-enabled tutor for database normalization , 2002, International Conference on Computers in Education, 2002. Proceedings..

[7]  Antonija Mitrovic,et al.  A Comparative Analysis of Cognitive Tutoring and Constraint-Based Modeling , 2003, User Modeling.

[8]  Wolfgang Menzel,et al.  The Coverage of Error Diagnosis in Logic Programming Using Weighted Constraints - The Case of an Ill-Defined Domain , 2008, FLAIRS Conference.

[9]  Jun Hong,et al.  Guided programming and automated error analysis in an intelligent Prolog tutor , 2004, Int. J. Hum. Comput. Stud..

[10]  Carl F. Berger,et al.  Students' programming behavior in a pascal course , 1987 .

[11]  John R. Anderson,et al.  The LISP tutor: it approaches the effectiveness of a human tutor , 1985 .

[12]  Stellan Ohlsson,et al.  Constraint-Based Student Modeling , 1994 .

[13]  Antonija Mitrovic,et al.  DB-Suite: Experiences with Three Intelligent, Web-Based Database Tutors. , 2004 .

[14]  N. Le.  Using Prolog Design Patterns to Support Constraint- Based Error Diagnosis in Logic Programming , 2006 .

[15]  Vincent Aleven,et al.  Defining "Ill-Defined Domains"; A literature survey. , 2006 .

[16]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[17]  Chee-Kit Looi.  Automatic debugging of Prolog programs in a Prolog Intelligent Tutoring System , 1991 .

[18]  Brent Martin.  Intelligent tutoring systems: The practical implementation of constraint-based modelling , 2002 .

[19]  Vincent Aleven,et al.  Toward Legal Argument Instruction with Graph Grammars and Collaborative Filtering Techniques , 2006, Intelligent Tutoring Systems.

[20]  W. Lewis Johnson,et al.  Understanding and Debugging Novice Programs , 1990, Artif. Intell..

[21]  Kevin D. Ashley,et al.  Introducing PETE: computer support for teaching ethics , 2001, ICAIL '01.

[22]  Bert Bredeweg,et al.  Student Modelling: The Key to Individualized Knowledge-Based Instruction , 2010, NATO ASI Series.

[23]  Vincent Aleven,et al.  Using background knowledge in case-based legal reasoning: A computational model and an intelligent learning environment , 2003, Artif. Intell..

[24]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[25]  Nancy Pennington,et al.  Comprehension strategies in programming , 1987 .