Combination of classifiers with incomplete frames of discernment

Abstract The methods for combining multiple classifiers based on belief functions require to work with a common and complete (closed) Frame of Discernment (FoD) on which the belief functions are defined before making their combination.This theoretical requirement is however difficult to satisfy in practice because some abnormal (or unknown) objects that do not belong to any pre-defined class of the FoD can appear in real classification applications. The classifiers learnt using different attributes information can provide complementary knowledge which is very useful for making the classification but they are usually based on different FoDs. In order to clearly identify the specific class of the abnormal objects, we propose a new method for combination of classifiers working with incomplete frames of discernment, named CCIF for short. This is a progressive detection method that select and add the detected abnormal objects to the training data set. Because one pattern can be considered as an abnormal object by one classifier and be committed to a specific class by another one, a weighted evidence combination method is proposed to fuse the classification results of multiple classifiers. This new method offers the advantage to make a refined classification of abnormal objects, and to improve the classification accuracy thanks to the complementarity of the classifiers. Some experimental results are given to validate the effectiveness of the proposed method using real data sets.

[1]  Deqiang Han,et al.  A new non-specificity measure in evidence theory based on belief intervals , 2016 .

[2]  Witold Pedrycz,et al.  Aggregating multiple classification results using fuzzy integration and stochastic feature selection , 2010, Int. J. Approx. Reason..

[3]  Quan Pan,et al.  A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[5]  Philippe Smets,et al.  Classification Using Belief Functions: Relationship Between Case-Based and Model-Based Approaches , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Chang-Hua Hu,et al.  Hidden Behavior Prediction of Complex Systems Under Testing Influence Based on Semiquantitative Information and Belief Rule Base , 2015, IEEE Transactions on Fuzzy Systems.

[7]  Quan Pan,et al.  Classifier Fusion With Contextual Reliability Evaluation , 2018, IEEE Transactions on Cybernetics.

[8]  Jean Dezert,et al.  Credal c-means clustering method based on belief functions , 2015, Knowl. Based Syst..

[9]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[10]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[11]  Quan Pan,et al.  A New Incomplete Pattern Classification Method Based on Evidential Reasoning , 2015, IEEE Transactions on Cybernetics.

[12]  Zhigang Wu,et al.  Epistemic uncertainty quantification in flutter analysis using evidence theory , 2015 .

[13]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[14]  Harry Wechsler,et al.  Open set face recognition using transduction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  Chang-Hua Hu,et al.  A New BRB-ER-Based Model for Assessing the Lives of Products Using Both Failure Data and Expert Knowledge , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  D. Ruta,et al.  An Overview of Classifier Fusion Methods , 2000 .

[18]  Edward A. Fox,et al.  A relevance feedback approach for the author name disambiguation problem , 2013, JCDL '13.

[19]  Thierry Denoeux,et al.  Making Use of Partial Knowledge About Hidden States in HMMs: An Approach Based on Belief Functions , 2014, IEEE Transactions on Fuzzy Systems.

[20]  Thierry Denoeux,et al.  Maximum Likelihood Estimation from Uncertain Data in the Belief Function Framework , 2013, IEEE Transactions on Knowledge and Data Engineering.

[21]  Thierry Denoeux,et al.  Combination of Transferable Classification With Multisource Domain Adaptation Based on Evidential Reasoning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[22]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[24]  Philippe Smets,et al.  Decision making in the TBM: the necessity of the pignistic transformation , 2005, Int. J. Approx. Reason..

[25]  Anderson Rocha,et al.  Toward Open Set Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[27]  Quan Pan,et al.  Credal classification rule for uncertain data based on belief functions , 2014, Pattern Recognit..

[28]  Linqing HUANG,et al.  Evidential combination of augmented multi-source of information based on domain adaptation , 2020, Science China Information Sciences.

[29]  Jean Dezert,et al.  Basic belief assignment approximations using degree of non-redundancy for focal element , 2019, Chinese Journal of Aeronautics.

[30]  Thierry Denoeux,et al.  Evidential clustering of large dissimilarity data , 2016, Knowl. Based Syst..

[31]  Quan Pan,et al.  Combination of Classifiers With Optimal Weight Based on Evidential Reasoning , 2018, IEEE Transactions on Fuzzy Systems.

[32]  Yi Yang,et al.  Belief Interval-Based Distance Measures in the Theory of Belief Functions , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Anderson Rocha,et al.  Open set source camera attribution and device linking , 2014, Pattern Recognit. Lett..

[34]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[35]  Thierry Denoeux,et al.  A new evidential K-nearest neighbor rule based on contextual discounting with partially supervised learning , 2019, Int. J. Approx. Reason..

[36]  Emanuel Radoi,et al.  Effective ATR Algorithms Using Information Fusion Models , 2004 .

[37]  Deqiang Han,et al.  An improved α -cut approach to transforming fuzzy membership function into basic belief assignment , 2016 .