In this paper we present an application of intelligent systems using hybrid evolutionary built decision trees to extract new knowledge from a small 'Cross-country skiers' database. Evolutionary built decision trees approach is a combination of one well known machine learning approach - decision trees and recently very popular evolutionary algorithms. By combining both approaches we were aiming for a method, that would combine the advantages of both approaches and should find optimal solution sooner than classical decision tree method. Such method is very suitable for application in fields like medicine and health care, where we have to combine high accuracy of the classifier and transparent knowledge representation.
In the particular case of 'Cross-country skiers' database, our main goal was to develop a classifier, that would have as high prediction accuracy as possible for all three outcomes. On the other hand we were also interested in attributes that are the most important for the prediction of cross-country skier's competition potentials. The results of testing are relatively good. Overall accuracy of the classifier, which was tested on the test set ranged from 62.5% to 87.5%. In some cases we were also able to achieve relatively high average class accuracies, which was not a trivial task on database with three possible decisions and small unbalanced training set.
[1]
J. Ross Quinlan,et al.
C4.5: Programs for Machine Learning
,
1992
.
[2]
Matej Sprogar,et al.
Advanced Tool for Building Decision Trees MtDeciT 2.0
,
1999,
IC-AI.
[3]
Aiko M. Hormann,et al.
Programs for Machine Learning. Part I
,
1962,
Inf. Control..
[4]
David E. Goldberg,et al.
Genetic Algorithms in Search Optimization and Machine Learning
,
1988
.
[5]
Sebastian Thrun,et al.
Learning to Learn
,
1998,
Springer US.
[6]
D. E. Goldberg,et al.
Genetic Algorithms in Search
,
1989
.
[7]
José Carlos González,et al.
The Role of Hybrid Systems in Intelligent Data Management: The Case of Fuzzy/neural Hybrids
,
1996
.