TopLog: ILP Using a Logic Program Declarative Bias

This paper introduces a new Inductive Logic Programming (ILP)framework called Top Directed Hypothesis Derivation (TDHD). In thisframework each hypothesised clause must be derivable from a givenlogic program called top theory (⊤). The top theory can beviewed as a declarative bias which defines the hypothesis space.This replaces the metalogical mode statements which are used inmany ILP systems. Firstly we present a theoretical framework forTDHD and show that standard SLD derivation can be used toefficiently derive hypotheses from ⊤. Secondly, we present aprototype implementation of TDHD within a new ILP system calledTopLog. Thirdly, we show that the accuracy and efficiency ofTopLog, on several benchmark datasets, is competitive with a stateof the art ILP system like Aleph.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  J. A. Robinson,et al.  A Machine-Oriented Logic Based on the Resolution Principle , 1965, JACM.

[3]  Ann M Richard,et al.  Distributed structure-searchable toxicity (DSSTox) public database network: a proposal. , 2002, Mutation research.

[4]  Gerald DeJong,et al.  Explanation-Based Learning: An Alternative View , 2005, Machine Learning.

[5]  Shan-Hwei Nienhuys-Cheng,et al.  Foundations of Inductive Logic Programming , 1997, Lecture Notes in Computer Science.

[6]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[7]  Smadar T. Kedar-Cabelli,et al.  Explanation-Based Generalization as Resolution Theorem Proving , 1987 .

[8]  William W. Cohen.  Grammatically Biased Learning: Learning Logic Programs Using an Explicit Antecedent Description Language , 1994, Artif. Intell..

[9]  Stephen Muggleton,et al.  QG/GA: a stochastic search for Progol , 2008, Machine Learning.

[10]  Carsten Lund,et al.  On the hardness of approximating minimization problems , 1994, JACM.

[11]  Janet M. Thornton,et al.  Protein fold recognition , 1993, J. Comput. Aided Mol. Des..

[12]  Saso Dzeroski,et al.  Discovering dynamics: From inductive logic programming to machine discovery , 1993, Journal of Intelligent Information Systems.

[13]  Ashwin Srinivasan,et al.  Relating chemical activity to structure: An examination of ILP successes , 1995, New Generation Computing.

[14]  S. Muggleton.  Stochastic Logic Programs , 1996 .

[15]  Ljupco Todorovski,et al.  Learning Declarative Bias , 2007, ILP.

[16]  Ashwin Srinivasan,et al.  Carcinogenesis Predictions Using ILP , 1997, ILP.

[17]  Anderson Faustino da Silva,et al.  Design, Implementation, and Evaluation of a Dynamic Compilation Framework for the YAP System , 2007, ICLP.

[18]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[19]  Stephen Muggleton,et al.  Inverse entailment and progol , 1995, New Generation Computing.

[20]  Robert A. Kowalski,et al.  Predicate Logic as Programming Language , 1974, IFIP Congress.

[21]  Stephen Muggleton,et al.  Support Vector Inductive Logic Programming , 2005, Discovery Science.

[22]  Ashwin Srinivasan,et al.  Pharmacophore Discovery Using the Inductive Logic Programming System PROGOL , 1998, Machine Learning.

[23]  Henrik Bostr,et al.  Specialization of Logic Programs by Pruning SLD-Trees , 2007 .

[24]  Konstantinos Sagonas,et al.  Demand-Driven Indexing of Prolog Clauses , 2007, ICLP.

[25]  M J Sternberg,et al.  Structure-activity relationships derived by machine learning: the use of atoms and their bond connectivities to predict mutagenicity by inductive logic programming. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Ashwin Srinivasan,et al.  Mutagenesis: ILP experiments in a non-determinate biological domain , 1994 .

[27]  Nuno A. Fonseca,et al.  ILP : - Just Trie It , 2007, ILP.

[28]  Ashwin Srinivasan,et al.  Query Transformations for Improving the Efficiency of ILP Systems , 2003, J. Mach. Learn. Res..

[29]  John Wylie Lloyd,et al.  Foundations of Logic Programming , 1987, Symbolic Computation.

[30]  Vítor Santos Costa,et al.  Revising First-Order Logic Theories from Examples Through Stochastic Local Search , 2007, ILP.