The Utility of Knowledge in Inductive Learning

In this paper, we demonstrate how different forms of background knowledge can be integrated with an inductive method for generating function-free Horn clause rules. Furthermore, we evaluate, both theoretically and empirically, the effect that these forms of knowledge have on the cost and accuracy of learning. Lastly, we demonstrate that a hybrid explanation-based and inductive learning method can advantageously use an approximate domain theory, even when this theory is incorrect and incomplete.

[1]  Ryszard S. Michalski,et al.  Pattern Recognition as Rule-Guided Inductive Inference , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  E. KorfRichard.  Depth-first iterative-deepening: an optimal admissible tree search , 1985 .

[3]  Richard E. Korf,et al.  Depth-First Iterative-Deepening: An Optimal Admissible Tree Search , 1985, Artif. Intell..

[4]  Michael Lebowitz,et al.  Integrated Learning: Controlling Explanation , 1986, Cogn. Sci..

[5]  Francesco Bergadano,et al.  A Knowledge Intensive Approach to Concept Induction , 1988, ML Workshop.

[6]  Stephen Muggleton,et al.  Machine Invention of First Order Predicates by Inverting Resolution , 1988, ML.

[7]  Michael John Pazzani.  Learning causal relationships: an integration of empirical and explanation-based learning methods , 1988 .

[8]  Jude W. Shavlik,et al.  Combining Explanation-Based Learning and Artificial Neural Networks , 1989, ML.

[9]  Michael J. Pazzani,et al.  One-Sided Algorithms for Integrating Empirical and Explanation-Based Learning , 1989, ML.

[10]  Michael J. Pazzani,et al.  Explanation-Based Learning with Week Domain Theories , 1989, ML.

[11]  Andrea Pohoreckyj Danyluk,et al.  Finding New Rules for Incomplete Theories: Explicit Biases for Induction with Contextual Information , 1989, ML.

[12]  Raymond J. Mooney,et al.  Induction Over the Unexplained: Integrated Learning of Concepts with Both Explainable and Conventional Aspects , 1989, ML.

[13]  Bruce F. Katz,et al.  Integrating Learning in a Neural Network , 1989, ML.

[14]  Haym Hirsh.  Combining Empirical and Analytical Learning with Version Spaces , 1989, ML.

[15]  Francesco Bergadano,et al.  Deduction in Top-Down Inductive Learning , 1989, ML.

[16]  Stephen Muggleton,et al.  An Experimental Comparison of Human and Machine Learning Formalisms , 1989, ML.

[17]  Stephen Muggleton,et al.  Efficient Induction of Logic Programs , 1990, ALT.

[18]  Raymond J. Mooney,et al.  Changing the Rules: A Comprehensive Approach to Theory Refinement , 1990, AAAI.

[19]  Michael J. Pazzani,et al.  Creating a memory of causal relationships - an integration of empirical and explanation-based learning methods , 1990 .

[20]  Michael J. Pazzani,et al.  Detecting and correcting errors in rule-based expert systems: an integration of empirical and explanation-based learning , 1991 .

[21]  Michael J. Pazzani,et al.  An Investigation of Noise-Tolerant Relational Concept Learning Algorithms , 1991, ML.

[22]  Michael J. Pazzani,et al.  Relational Clichés: Constraining Induction During Relational Learning , 1991, ML.

[23]  Matthew L. Ginsberg,et al.  Iterative Broadening , 1990, Artif. Intell..

[24]  Creating a memory of causal relationships, by Michael Pazzani, Hillsdale, NJ: Lawrence Erlbaum, 1990 , 1993, Machine Learning.

[25]  Thomas G. Dietterich,et al.  A Study of Explanation-Based Methods for Inductive Learning , 1989, Machine Learning.

[26]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[27]  William W. Cohen.  Abductive Explanation-Based Learning: A Solution to the Multiple Inconsistent Explanation Problem , 1992, Machine Learning.

[28]  Gerald DeJong,et al.  Explanation-Based Learning: An Alternative View , 2005, Machine Learning.

[29]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[30]  D. Haussler,et al.  Boolean Feature Discovery in Empirical Learning , 1990, Machine Learning.

[31]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.