A Supervised Learning Approach for the Fusion of Multiple Classifier Outputs

In this paper, we propose an alternative method for the fusion of multiple classifier outputs to obtain a potential improvement in the classification performance. Our method mainly operates on decisions of several classifiers, and the individual classifiers, which are trained on different data sets, share common classes and some of them also individually deal with classifying different class labels. For this reason, we first aim to define a common space to represent all the class labels and then propose a supervised learning approach to effectively recognize patterns of the tuples that are formed by concatenating classifiers outputs based on top-N rankings. To evaluate the performance of our method, we utilize Random Forest (RF) classifier for this multiclass classification problem and the results demonstrate that our method can achieve promising performance improvement in true positive rate of classification compared to that of the best performing individual classifier yields. 

[1]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[2]  L. Kuncheva An application of OWA operators to the aggregation of multiple classification decisions , 1997 .

[3]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[4]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[5]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[6]  Benoit Huet,et al.  Performance Analysis of Multiple Classifier Fusion for Semantic Video Content Indexing and Retrieval , 2007, MMM.

[7]  D. Ruta,et al.  An Overview of Classifier Fusion Methods , 2000 .

[8]  Kevin W. Bowyer,et al.  Combination of Multiple Classifiers Using Local Accuracy Estimates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[10]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Gader,et al.  Advances in fuzzy integration for pattern recognition , 1994, CVPR 1994.

[12]  Lorenzo Bruzzone,et al.  Neuro-Fuzzy Fusion: A New Approach to Multiple Classifier System , 2006, 9th International Conference on Information Technology (ICIT'06).

[13]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.