Effects of Diversity Measures on the Design of Ensemble Classifiers by Multiobjective Genetic Fuzzy Rule Selection with a Multi-classifier Coding Scheme

We have already proposed multiobjective genetic fuzzy rule selection with a multi-classifier coding scheme for the design of ensemble classifiers. An entropy-based diversity measure was used as an objective to be maximized for increasing the diversity of base classifiers in an ensemble. In this paper, we examine the use of other diversity measures in the design of ensemble classifiers. Experimental results show that the choice of a diversity measure has a large effect on the performance of designed ensemble classifiers.

[1]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[2]  Hussein A. Abbass,et al.  Pareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[3]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[4]  Hisao Ishibuchi,et al.  Comparison of Heuristic Criteria for Fuzzy Rule Selection in Classification Problems , 2004, Fuzzy Optim. Decis. Mak..

[5]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[6]  Xin Yao,et al.  An analysis of diversity measures , 2006, Machine Learning.

[7]  Hisao Ishibuchi,et al.  Genetic rule selection with a multi-classifier coding scheme for ensemble classifier design , 2007, Int. J. Hybrid Intell. Syst..

[8]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  Gary B. Lamont,et al.  Applications Of Multi-Objective Evolutionary Algorithms , 2004 .

[11]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[12]  Richard M. Everson,et al.  Intelligent Data Engineering and Automated Learning – IDEAL 2004 , 2004, Lecture Notes in Computer Science.

[13]  Bernhard Sendhoff,et al.  EVOLUTIONARY MULTI-OBJECTIVE OPTIMIZATION APPROACH TO CONSTRUCTING NEURAL NETWORK ENSEMBLES FOR REGRESSION , 2004 .

[14]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[15]  Xin Yao,et al.  DIVACE: Diverse and Accurate Ensemble Learning Algorithm , 2004, IDEAL.

[16]  Hisao Ishibuchi,et al.  Designing Fuzzy Ensemble Classifiers by Evolutionary Multiobjective Optimization with an Entropy-Based Diversity Criterion , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[17]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.