Constraint Inductive Logic Programming

This paper is concerned with learning from positive and negative examples expressed in rst-order logic with numerical constants. The presented approach is based on the cooperation of Inductive Logic Programming (ILP) and Constraint Logic Programming (CLP), and proceeds as follows: A discriminant induction problem is shown to be equivalent to a Constraint Satisfaction Problem (CSP): all constrained clauses covering positive examples and rejecting negative examples can be trivially derived from the solutions of this CSP. Solving this CSP then allows to build the G set of solutions in terms of Version Spaces; this resolution can be delegated to a constraint solver. This CSP provides a tractable computational characterization of G, which is suucient to classify further examples and ooers simple counting-based heuristics to resist noisy data. In this hybrid ILP-CLP approach, CLP performs most of the search involved in inductive learning; the advantage is to beneet from the number-handling capabilities of CLP, without requirement for additional background theory.

[1]  Pascal Van Hentenryck,et al.  The Constraint Logic Programming Language CHIP , 1988, FGCS.

[2]  Roland H. C. Yap,et al.  The CLP( R ) language and system , 1992, TOPL.

[3]  David Haussler,et al.  Quantifying Inductive Bias: AI Learning Algorithms and Valiant's Learning Framework , 1988, Artif. Intell..

[4]  Nicolas Beldiceanu,et al.  Constraint Logic Programming , 1997 .

[5]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[6]  Jean-Gabriel Ganascia,et al.  Selective Reformulation of Examples in Concept Learning , 1994, ICML.

[7]  Alan M. Frisch Generalization and Learnability: a Study of Constrained Atoms , 1992 .

[8]  L. D. Raedt Interactive theory revision: an inductive logic programming approach , 1992 .

[9]  Haym Hirsh Polynomial-Time Learning with Version Spaces , 1992, AAAI.

[10]  Mich Ele Sebag A Constraint-Based Induction Algorithm in FOL , 1994 .

[11]  Marco Botta,et al.  SMART+: A Multi-Strategy Learning Tool , 1993, IJCAI.

[12]  Mich Ele Sebag,et al.  Nd Order Understandability of Disjunctive Version Spaces , 1995 .

[13]  Alain Colmerauer,et al.  An introduction to Prolog III , 1989, CACM.

[14]  Michèle Sebag Using Constraints to Building Version Spaces , 1994, ECML.

[15]  Vijay A. Saraswat,et al.  Concurrent constraint programming , 1989, POPL '90.

[16]  Michael J. Maher,et al.  Constraint Logic Programming: A Survey , 1994, J. Log. Program..

[17]  Pascal Van Hentenryck,et al.  Operational Semantics of Constraint Logic Programming over Finite Domains , 1991, PLILP.

[18]  Luc De Raedt,et al.  Forgetting and Compacting data in Concept Learning , 1995, IJCAI.

[19]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.