An Efficient Subsumption Algorithm for Inductive Logic Programming

In this paper we investigate the efficiency of θ-subsumption (⊢ θ ), the basic provability relation in ILP. As D ⊢ θ C is NP-complete even if we restrict ourselves to linked Horn clauses and fix C to contain only a small constant number of literals, we investigate in several restrictions of D. We first adapt the notion of determinate clauses used in ILP and show that θ-subsumption is decidable in polynomial time if D is determinate with respect to C. Secondly, we adapt the notion of k -local Horn clauses and show that θ-subsumption is efficiently computable for some reasonably small k. We then show how these results can be combined, to give an efficient reasoning procedure for determinate k -local Horn clauses, an ILP-problem recently suggested to be polynomial predictable by Cohen (1993) by a simple counting argument. We finally outline how the θ-reduction algorithm, an essential part of every lgg ILP-learning algorithm, can be improved by these ideas.

[1]  Georg Gottlob,et al.  Subsumption and Implication , 1987, Inf. Process. Lett..

[2]  Luc De Raedt,et al.  A Theory of Clausal Discovery , 1993, IJCAI.

[3]  Peter Idestam-Almquist,et al.  Generalization of clauses , 1993 .

[4]  Wray L. Buntine Generalized Subsumption and Its Applications to Induction and Redundancy , 1986, Artif. Intell..

[5]  L. D. Raedt Interactive theory revision: an inductive logic programming approach , 1992 .

[6]  Georg Gottlob,et al.  Removing Redundancy from a Clause , 1993, Artif. Intell..

[7]  Journal of the Association for Computing Machinery , 1961, Nature.

[8]  Shan-Hwei Nienhuys-Cheng,et al.  Subsumption and Refinement in Model Inference , 1993, ECML.

[9]  G. Plotkin Automatic Methods of Inductive Inference , 1972 .

[10]  ProgramsWilliam W. CohenAT Learnability of Restricted Logic Programs , 1993 .

[11]  Saso Dzeroski,et al.  Inductive Logic Programming: Techniques and Applications , 1993 .

[12]  Katharina Morik,et al.  Knowledge Acquisition and Machine Learning: Theory, Methods, and Applications , 1993 .

[13]  Bojan Dolsak,et al.  The Application of Inductive Logic Programming to Finite Element Mesh Design , 1992 .

[14]  Katharina Morik,et al.  What online machine learning can do for knowledge acquisition—a case study , 1994 .

[15]  Paliath Narendran,et al.  NP-Completeness of the Set Unification and Matching Problems , 1986, CADE.

[16]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[17]  Georg Gottlob,et al.  On the efficiency of subsumption algorithms , 1985, JACM.

[18]  Stephen Muggleton,et al.  Efficient Induction of Logic Programs , 1990, ALT.

[19]  Ehud Shapiro,et al.  Algorithmic Program Debugging , 1983 .

[20]  J. A. Robinson,et al.  A Machine-Oriented Logic Based on the Resolution Principle , 1965, JACM.

[21]  S. Muggleton Inverting Implication , 1992 .

[22]  J. Lloyd Foundations of Logic Programming , 1984, Symbolic Computation.