Publisher Summary This chapter discusses two methods that adaptively enlarge the set of primitive attributes from which a test at a decision node can be selected, namely, FRINGE and GREEDY3. A commonly studied class of target concepts in empirical learning is the class of concepts that have a small disjunctive normal form representation. Concepts with a small DNF description do not always have a concise decision tree representation when the tests at the decision nodes are limited to the primitive attributes. The representational complexity arises because the tests to verify if an instance satisfies a term or not are replicated in the tree. To learn decision trees from examples, traditional methods choose the test to place at each decision node from a predefined set of variables. It is in this regard, where FRINGE and GREEDY3 gain important use. FRINGE builds a decision tree using the primitive attributes, and analyses this tree to define new useful attributes. GREEDY3 builds a restricted type of decision tree called a decision list, and each attribute at a decision node is defined by a greedy top-down sample refinement method. The performance of a learning algorithm may be measured by the classification accuracy on unseen instances of the target concept. Also, parity and majority concepts with a large number of inputs are hard for decision trees.
[1]
Leslie G. Valiant,et al.
On the learnability of Boolean formulae
,
1987,
STOC.
[2]
David Haussler,et al.
Learning decision trees from random examples
,
1988,
COLT '88.
[3]
J. Ross Quinlan,et al.
An Empirical Comparison of Genetic and Decision-Tree Classifiers
,
1988,
ML.
[4]
J. C. Schlimmer,et al.
Concept acquisition through representational adjustment
,
1987
.
[5]
Giulia Pagallo,et al.
Learning DNF by Decision Trees
,
1989,
IJCAI.
[6]
Paul E. Utgoff,et al.
Shift of bias for inductive concept learning
,
1984
.
[7]
Gerald Tesauro,et al.
Scaling and Generalization in Neural Networks: A Case Study
,
1988,
NIPS.
[8]
Stephen Muggleton,et al.
Duce, An Oracle-based Approach to Constructive Induction
,
1987,
IJCAI.
[9]
David Haussler,et al.
Quantifying Inductive Bias: AI Learning Algorithms and Valiant's Learning Framework
,
1988,
Artif. Intell..