Learning logical definitions from relations

This paper describesfoil, a system that learns Horn clauses from data expressed as relations.foil is based on ideas that have proved effective in attribute-value learning systems, but extends them to a first-order formalism. This new system has been applied successfully to several tasks taken from the machine learning literature.

[1]  J. Rissanen A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[2]  Ronald L. Rivest,et al.  Inferring Decision Trees Using the Minimum Description Length Principle , 1989, Inf. Comput..

[3]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[4]  Ehud Y. Shapiro An Algorithm that Infers Theories from Facts , 1981, IJCAI.

[5]  Claude Sammut,et al.  LEARNING CONCEPTS BY ASKING QUESTIONS , 1998 .

[6]  J. R. Quilan Decision trees and multi-valued attributes , 1988 .

[7]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[8]  Thomas G. Dietterich,et al.  Learning to Predict Sequences , 1985 .

[9]  Frederick Hayes-Roth,et al.  Knowledge acquisition from structural descriptions , 1977, IJCAI 1977.

[10]  Patrick Henry Winston,et al.  Artificial intelligence (2nd ed.) , 1984 .

[11]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[12]  Steven A. Vere,et al.  Inductive learning of relational productions , 1977, SGAR.

[13]  Thomas G. Dietterich,et al.  Inductive Learning of Structural Descriptions: Evaluation Criteria and Comparative Review of Selected Methods , 1981, Artif. Intell..

[14]  John R. Anderson,et al.  A Learning System and Its Psychological Implications , 1979, IJCAI.

[15]  Stephen Muggleton,et al.  An Experimental Comparison of Human and Machine Learning Formalisms , 1989, ML.

[16]  Ehud Shapiro,et al.  Algorithmic Program Debugging , 1983 .

[17]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[18]  J. R. Quinlan Discovering rules by induction from large collections of examples Intro-ductory readings in expert s , 1979 .

[19]  J. Ross Quinlan,et al.  Simplifying decision trees , 1987, Int. J. Hum. Comput. Stud..

[20]  Ryszard S. Michalski,et al.  Pattern Recognition as Rule-Guided Inductive Inference , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ingo Br,et al.  Prolog programming for artificial intelligence , 1990 .

[22]  Pat Langley,et al.  Learning to Search: From Weak Methods to Domain-Specific Heuristics , 1985, Cogn. Sci..

[23]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[24]  Stephen Muggleton,et al.  Machine Invention of First Order Predicates by Inverting Resolution , 1988, ML.

[25]  Ronald L. Rivest,et al.  Learning decision lists , 2004, Machine Learning.

[26]  Michel Manago,et al.  Knowledge Intensive Induction , 1989, ML.

[27]  A. R. Brown,et al.  Program Debugging , 1973 .

[28]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[29]  Philip J. Stone,et al.  Experiments in induction , 1966 .

[30]  R. Mooney,et al.  Explanation-Based Learning: An Alternative View , 1986, Machine Learning.

[31]  Tom M. Mitchell,et al.  Explanation-Based Generalization: A Unifying View , 1986, Machine Learning.

[32]  Nada Lavrac,et al.  The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains , 1986, AAAI.

[33]  Donald Michie,et al.  Expert systems in the micro-electronic age , 1979 .

[34]  Peter Clark,et al.  Induction in Noisy Domains , 1987, EWSL.