A Declarative Approach to Bias in Concept Learning

We give a declarative formulation of the biases used in inductive concept learning, particularly the Version-Space approach. We then show how the process of learning a concept from examples can be implemented as a first-order deduction from the bias and the facts describing the instances. This has the following advantages: 1) multiple sources and forms of knowledge can be incorporated into the learning process; 2) the learning system can be more fully integrated with the rest of the belieis and reasoning of a complete intelligent agent. Without a semantics for the bias, we cannot generally and practically build machines that generate inductive biases automatically and hence are able to learn independently. With this in mind, we show how one part of the bias for Meta-DENDRAL, its instance description language, can be represented using first-order axioms called determinations, and can be derived from basic background knowledge about chemistry. The second part of the paper shows how bias can be represented as defaults, allowing shift of bias to be accommodated in a nonmonotonic framework.

[1]  Tom M. Mitchell,et al.  MODEL-DIRECTED LEARNING OF PRODUCTION RULES1 , 1978 .

[2]  Tom Michael Mitchell Version spaces: an approach to concept learning. , 1979 .

[3]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[4]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[5]  Michael R. Genesereth,et al.  An Overview of Meta-Level Architecture , 1983, AAAI.

[6]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[7]  John McCarthy,et al.  Applications of Circumscription to Formalizing Common Sense Knowledge , 1987, NMR.

[8]  Paul E. Utgoff,et al.  Shift of bias for inductive concept learning , 1984 .

[9]  Stuart J. Russell,et al.  The compleat guide to MRS , 1985 .

[10]  Alan Bundy,et al.  An Analytical Comparison of Some Rule-Learning Programs , 1985, Artif. Intell..

[11]  Larry A. Rendell A General Framework for Induction and a Study of Selective Induction , 1986, Mach. Learn..

[12]  Stuart J. Russell Preliminary Steps Toward the Automation of Induction , 1986, AAAI.

[13]  Joan Feigenbaum,et al.  Factorization in Experiment Generation , 1986, AAAI.

[14]  Stuart J. Russell,et al.  A Logical Approach to Reasoning by Analogy , 1987, IJCAI.

[15]  Vladimir Lifschitz,et al.  Pointwise circumscription , 1987 .

[16]  Stuart J. Russell Analogical and inductive reasoning , 1987 .

[17]  Wray L. Buntine Generalized Subsumption and Its Applications to Induction and Redundancy , 1986, Artif. Intell..