Evolving groups of basic decision trees

A decision tree is a good classifier with a transparent decision mechanism. Decision-tree building methods usually have problems in splitting the learning samples into more subsets, because of the nature of the tree. If the classification into such subsets is not possible, it is better to put the classification decision on to some other classifier. This leads to the introduction of a null classification, which simply means that no classification is possible in this step. This approach is sensible with evolutionary methods, as they can handle a number of trees simultaneously. In the process of construction, we have to address the problem of whether a classification is sensible. The performance of the proposed model has been tested on several data sets and the results presented on one such data set show its potential.

[1]  J. Ross Quinlan,et al.  Decision Trees and Instance-Based Classifiers , 1997, The Computer Science and Engineering Handbook.

[2]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[3]  Zbigniew Michalewicz,et al.  Adaptation in evolutionary computation: a survey , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[4]  Vili Podgorelec,et al.  Vector decision trees , 2000, Intell. Data Anal..

[5]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[6]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..