Empirical comparison of Dynamic Classifier Selection methods based on diversity and accuracy for building ensembles

In the context of Ensembles or Multi-Classifier Systems, the choice of the ensemble members is a very complex task, in which, in some cases, it can lead to ensembles with no performance improvement. In order to avoid this situation, there is a great deal of research to find effective classifier member selection methods. In this paper, we propose a selection criterion based on both the accuracy and diversity of the classifiers in the initial pool. Also, instead of using a static selection method, we use a Dynamic Classifier Selection (DSC) procedure. In this case, the member classifiers to form the ensemble are chosen at the test (use) phase. That is, different testing patterns can be classified by different ensemble configurations.

[1]  Ludmila I. Kuncheva,et al.  Switching between selection and fusion in combining classifiers: an experiment , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Anne M. P. Canuto,et al.  Using Accuracy and Diversity to Select Classifiers to Build Ensembles , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[3]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[4]  Lawrence O. Hall,et al.  A New Ensemble Diversity Measure Applied to Thinning Ensembles , 2003, Multiple Classifier Systems.

[5]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[6]  Matti Aksela,et al.  Comparison of Classifier Selection Methods for Improving Committee Performance , 2003, Multiple Classifier Systems.

[7]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[8]  Giorgio Valentini,et al.  An experimental bias-variance analysis of SVM ensembles based on resampling techniques , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Xin Yao,et al.  An analysis of diversity measures , 2006, Machine Learning.

[10]  Fabio Roli,et al.  An approach to the automatic design of multiple classifier systems , 2001, Pattern Recognit. Lett..

[11]  Terry Windeatt,et al.  Diversity measures for multiple classifier system analysis and design , 2004, Inf. Fusion.

[12]  Zhengxin Chen,et al.  Recognition of exon/intron boundaries using dynamic ensembles , 2004, Proceedings. 2004 IEEE Computational Systems Bioinformatics Conference, 2004. CSB 2004..

[13]  Ian Witten,et al.  Data Mining , 2000 .

[14]  Mykola Pechenizkiy,et al.  Diversity in search strategies for ensemble feature selection , 2005, Inf. Fusion.

[15]  John Hallam,et al.  IEEE International Joint Conference on Neural Networks , 2005 .

[16]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[17]  Anne M. P. Canuto,et al.  A Dynamic Classifier Selection Method to Build Ensembles using Accuracy and Diversity , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).

[18]  Zoran Obradovic,et al.  Effective pruning of neural network classifier ensembles , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[19]  Thomas G. Dietterich,et al.  Pruning Adaptive Boosting , 1997, ICML.