Using Weighted Combination-Based Methods in Ensembles with Different Levels of Diversity

There are two main approaches to combine the output of classifiers within a multi-classifier system, which are: combination-based and selection-based methods. This paper presents an investigation of how the use of weights in some non-trainable simple combination-based methods applied to ensembles with different levels of diversity. It is aimed to analyse whether the use of weights can decrease the dependency of ensembles on the diversity of their members.

[1]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Fabio Roli,et al.  Dynamic classifier selection based on multiple classifier behaviour , 2001, Pattern Recognit..

[4]  Ludmila I. Kuncheva,et al.  Switching between selection and fusion in combining classifiers: an experiment , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[6]  Kevin W. Bowyer,et al.  Combination of Multiple Classifiers Using Local Accuracy Estimates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[8]  Ludmila I. Kuncheva,et al.  Relationships between combination methods and measures of diversity in combining classifiers , 2002, Inf. Fusion.

[9]  Anne M. P. Canuto,et al.  Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles , 2007, Pattern Recognit. Lett..

[10]  Anne M. P. Canuto,et al.  The use of confidence measures to enhance combination strategies in multi-network neuro-fuzzy systems , 2000, Connect. Sci..

[11]  Marc Parizeau,et al.  Flexible multi-classifier architecture for face recognition systems , 2003 .

[12]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[13]  Robi Polikar,et al.  Ensemble Confidence Estimates Posterior Probability , 2005, Multiple Classifier Systems.

[14]  Luc Vandendorpe,et al.  Decision Fusion for Face Authentication , 2004, ICBA.