The reduction algorithm is a technique for improving a decision tree in the abseence of aproecise cost criterion. The result of applying the algorithm is an irreducible tree that is no less efficient than the original, and may be more efficient. Irreducible trees arise in discrete decision theory as an algebraic form for decision trees. This form has significant computational properties. In fact, every irreducible is optimal with respect to some expected testing cost criterion and is strictly better than any given distinct tree with respect to some criterion.
Many irreducibles are decision equivalent to a given tree; onely some of these are reductions of the tree. The reduction algorithm is a particular way of finding one of these. It tends to preserve the overall structure of the tree by reducing the subtrees first.
A bound on the complexity of this algorithm with input tree t is O(hgt9t)2). usize(t) is the uniform size of the tree (the number of leaves less one) and hgt(t) is the height of the tree. This means that decision tree reduction has the same worst-case order of complexity as most heuristic methods for building suboptimal trees. While the purpose of using heuristics is often rather different, such comparisons are an indication of the efficiency of the reduction algorithms.
[1]
J. R Cockett.
Decision Expression Optimization
,
1985
.
[2]
Bernard M. E. Moret,et al.
The Activity of a Variable and Its Relation to Decision Trees
,
1980,
TOPL.
[3]
J. R Cockett.
The Theory of Discrete Decision Processes
,
1984
.
[4]
J R B Cockett,et al.
Prime rule-based methodologies give inadequate control
,
1986,
ISMIS '86.
[5]
Ronald L. Rivest,et al.
Constructing Optimal Binary Decision Trees is NP-Complete
,
1976,
Inf. Process. Lett..
[6]
J. R. B. Cockett.
Discrete Decision Theory: Manipulations
,
1987,
Theor. Comput. Sci..
[7]
Bernard M. E. Moret,et al.
Decision Trees and Diagrams
,
1982,
CSUR.
[8]
Avron Barr,et al.
The Handbook of Artificial Intelligence
,
1982
.
[9]
A. J. Bayes.
A Dynamic Programming Algorithm to Optimise Decision Table Code
,
1973,
Aust. Comput. J..
[10]
Journal of the Association for Computing Machinery
,
1961,
Nature.
[11]
Ryszard S. Michalski.
Designing Extended Entry Decision Tables and Optimal Decision Trees Using Decision Diagrams
,
1978
.