Declarative bias for specific-to-general ILP systems

A comparative study is presented of language biases employed in specific-to-general learning systems within the Inductive Logic Programming (ILP) paradigm. More specifically, we focus on the biases employed in three well known systems: CLINT, GOLEM and ITOU, and evaluate both conceptually and empirically their strengths and weaknesses. The evaluation is carried out within the generic framework of the NINA system, in which bias is a parameter. Two different types of biases are considered: syntactic bias, which defines the set of well-formed clauses, and semantic bias, which imposes restrictions on the behaviour of hypotheses or clauses. NINA is also able to shift its bias (within a predefined series of biases), whenever its current bias is insufficient for finding complete and consistent concept definitions. Furthermore, a new formalism for specifying the syntactic bias of inductive logic programming systems is introduced.

[1]  Ehud Shapiro,et al.  Algorithmic Program Debugging , 1983 .

[2]  Krzysztof R. Apt,et al.  Logic Programming , 1990, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[3]  Paul E. Utgoff,et al.  Shift of bias for inductive concept learning , 1984 .

[4]  Richard A. Lewis,et al.  Drug design by machine learning: the use of inductive logic programming to model the structure-activity relationships of trimethoprim analogues binding to dihydrofolate reductase. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Stephen Muggleton,et al.  Protein secondary structure prediction using logic-based machine learning , 1992 .

[6]  J. R. Quinlan.  Learning Logical Definitions from Relations , 1990 .

[7]  Birgit Tausend,et al.  Representing Biases for Inductive Logic Programming , 1994, ECML.

[8]  R. Mike Cameron-Jones,et al.  Avoiding Pitfalls When Learning Recursive Theories , 1993, IJCAI.

[9]  Céline Rouveirol,et al.  Semantic Model for Induction of First Order Theories , 1991, IJCAI.

[10]  Tom M. Mitchell,et al.  Acquisition of Appropriate Bias for Inductive Concept Learning , 1982, AAAI.

[11]  Francesco Bergadano,et al.  An Interactive System to Learn Functional Logic Programs , 1993, IJCAI.

[12]  Stephen Muggleton,et al.  Efficient Induction of Logic Programs , 1990, ALT.

[13]  William W. Cohen.  Grammatically Biased Learning: Learning Logic Programs Using an Explicit Antecedent Description Language , 1994, Artif. Intell..

[14]  Cor Bioch,et al.  Simple improvements of a simple solution for inverting resolution , 1991 .

[15]  A. R. Brown,et al.  Program Debugging , 1973 .

[16]  J. Ross Quinlan,et al.  Knowledge acquisition from structured data: using determinate literals to assist search , 1991, IEEE Expert.

[17]  Shan-Hwei Nienhuys-Cheng,et al.  Subsumption and Refinement in Model Inference , 1993, ECML.

[18]  M. Pazzani,et al.  The Utility of Knowledge in Inductive Learning , 1992, Machine Learning.

[19]  L. D. Raedt.  Interactive theory revision: an inductive logic programming approach , 1992 .

[20]  Jorg-uwe Kietz,et al.  Controlling the Complexity of Learning in Logic through Syntactic and Task-Oriented Models , 1992 .

[21]  Luc De Raedt,et al.  A unifying framework for concept-learning algorithms , 1992, The Knowledge Engineering Review.

[22]  Maurice Bruynooghe,et al.  A comparative study of declarative and dynamically adjustable language bias in concept learning , 1992 .

[23]  Saso Dzeroski,et al.  Inductive Logic Programming: Techniques and Applications , 1993 .

[24]  Luc De Raedt,et al.  Multiple Predicate Learning , 1993, IJCAI.

[25]  Luc De Raedt,et al.  Belief Updating from Integrity Constraints and Queries , 1992, Artif. Intell..

[26]  Sturart J. Russell,et al.  The use of knowledge in analogy and induction , 1989 .

[27]  Saso Dzeroski,et al.  The utility of background knowledge in learning medical diagnostic rules , 1993, Appl. Artif. Intell..

[28]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[29]  Saso Dzeroski,et al.  PAC-learnability of determinate logic programs , 1992, COLT '92.

[30]  Claus-Rainer Rollinger,et al.  The Discovery of the Equator or Concept Driven Learning , 1983, IJCAI.

[31]  Bojan Dolsak,et al.  The Application of Inductive Logic Programming to Finite Element Mesh Design , 1992 .

[32]  Birgit Tausend,et al.  Biases and Their Effects in Inductive Logic Programming , 1994, ECML.

[33]  Luc De Raedt,et al.  Interactive concept-learning and constructive induction by analogy , 2004, Machine Learning.

[34]  Peter A. Flach.  Simply logical - intelligent reasoning by example , 1994, Wiley professional computing.

[35]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[36]  Wray L. Buntine,et al.  Induction of Horn Clauses: Methods and the Plausible Generalization Algorithm , 1987, Int. J. Man Mach. Stud..

[37]  Benjamin N. Grosof,et al.  A Sketch of Autonomous Learning using Declarative Bias , 1990 .

[38]  Irene Stahl,et al.  On the Utility of Predicate Invention in Inductive Logic Programming , 1994, ECML.