Design of dynamic Multiple Classifier Systems based on belief functions

The technique of Multiple Classifier Systems (MCSs), which is a kind of decision-level information fusion, has fast become popular among researchers to fuse multiple classification outputs for better classification accuracy. In MCSs, there exist various kinds of uncertainties such as the ambiguity of the output of individual member classifier and the inconsistency among outputs of member classifiers. In this paper, we model the uncertainties inMCSs based on the theory of belief functions. The outputs of member classifiers are modeled using belief functions. A new measure of diversity in member classifiers is established using the distance of evidence, and the fusion rule adopted for MCSs is Demspter's rule of combination. The construction of MCSs based on the proposed diversity measure is a dynamic procedure and can achieve better performance than using existing diversity measures. Experimental results and related analyses show that our proposed measure and approach are rational and effective.

[1]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[2]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[3]  Anne-Laure Jousselme,et al.  Distances in evidence theory: Comprehensive survey and generalizations , 2012, Int. J. Approx. Reason..

[4]  Ludmila I. Kuncheva,et al.  Switching between selection and fusion in combining classifiers: an experiment , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Ching Y. Suen,et al.  The behavior-knowledge space method for combination of multiple classifiers , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Anne-Laure Jousselme,et al.  A proof for the positive definiteness of the Jaccard index matrix , 2013, Int. J. Approx. Reason..

[7]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[8]  Belur V. Dasarathy.  A special issue on diversity in multiple classifier systems , 2005, Inf. Fusion.

[9]  Gérard Chollet,et al.  Comparing decision fusion paradigms using -NN based classifiers, decision trees and logistic regression in a multi-modal identity verification ap plication , 1999 .

[10]  Sorin Soviany,et al.  A Multimodal Approach for Biometric Authentication with Multiple Classifiers , 2011 .

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Anand M. Narasimhamurthy.  Theoretical bounds of majority voting performance for a binary classification problem , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[14]  Jean Dezert,et al.  Applications and Advances of DSmT for Information Fusion , 2004 .

[15]  Éloi Bossé,et al.  A new distance between two bodies of evidence , 2001, Inf. Fusion.

[16]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[17]  PhD DEng D. T. Pham BE,et al.  Intelligent Optimisation Techniques , 2000, Springer London.

[18]  Philippe Smets,et al.  The Transferable Belief Model , 1991, Artif. Intell..

[19]  Somchai Jitapunkul,et al.  Automatic Target Recognition Using Multiple Description Coding Models for Multiple Classifier Systems , 2003, Multiple Classifier Systems.

[20]  Nouria Harbi,et al.  A Multiple Classifier System Using an Adaptive Strategy for Intrusion Detection , .

[21]  Lotfi A. Zadeh,et al.  A Simple View of the Dempster-Shafer Theory of Evidence and Its Implication for the Rule of Combination , 1985, AI Mag..

[22]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Vasile Palade,et al.  Multi-Classifier Systems: Review and a roadmap for developers , 2006, Int. J. Hybrid Intell. Syst..

[24]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[25]  Bhekisipho Twala,et al.  Multiple classifier application to credit risk assessment , 2010, Expert Syst. Appl..

[26]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.