Evolving Sets of Symbolic Classifiers into a Single Symbolic Classifier Using Genetic Algorithms

For a given data set, different learning algorithms typically provide different classifiers. Although it is possible to simply select the most successful classifier, the less successful classifiers could have potentially valuable information that may be wasted. This work proposes GAESC, an algorithm for evolving a set of classifiers into a single symbolic classifier using genetic algorithms. Individuals are formed by rules collected from symbolic classifiers and rules from association classification rules. Experimental results in three data sets from UCI show that GAESC outperforms the single symbolic classifiers in terms of classification error rate.

[1]  Christian Setzkorn,et al.  MERBIS - A Multi-Objective Evolutionary Rule Base Induction System , 2003 .

[2]  Wynne Hsu,et al.  Integrating Classification and Association Rule Mining , 1998, KDD.

[3]  Ronaldo C. Prati,et al.  Constructing ensembles of symbolic classifiers , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[4]  Peter A. Flach,et al.  Rule Evaluation Measures: A Unifying View , 1999, ILP.

[5]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[6]  Kenneth A. De Jong,et al.  Using genetic algorithms for concept learning , 1993, Machine Learning.

[7]  Dr. Alex A. Freitas Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  K. De Jong,et al.  Using Genetic Algorithms for Concept Learning , 2004, Machine Learning.

[10]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[11]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[13]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[14]  Gustavo E. A. P. A. Batista,et al.  A study of the behavior of several methods for balancing machine learning training data , 2004, SKDD.