Using measures of similarity and inclusion for multiple classifier fusion by decision templates

Abstract Decision templates (DT) are a technique for classifier fusion for continuous-valued individual classifier outputs. The individual outputs considered here sum up to the same value (e.g., statistical classifiers, yielding some estimates of the posterior probabilities for the classes). First, the DT fusion algorithm is explained. Second, we show that two similarity measures ( S 1 and S 2 ) and two inclusion indices ( I 1 and I 2 ) between fuzzy sets (see Dubois and Prade, Fuzzy Sets and Systems: Theory and Applications, Academic Press, New York, 1980) produce the same DT classifier. The equivalence is proven by showing that for every object submitted for classification, all four measures induce the same ordering on the set of class labels (through DT fusion), thereby assigning the object to the same class.

[1]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[2]  Galina L. Rogova,et al.  Combining the results of several neural network classifiers , 1994, Neural Networks.

[3]  D Wang,et al.  Use of fuzzy-logic-inspired features to improve bacterial recognition through classifier fusion , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Kevin W. Bowyer,et al.  Combination of multiple classifiers using local accuracy estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Sung-Bae Cho,et al.  Combining multiple neural networks by fuzzy integral for robust classification , 1995, IEEE Trans. Syst. Man Cybern..

[6]  Keung-Chi Ng,et al.  Consensus diagnosis: a simulation study , 1992, IEEE Trans. Syst. Man Cybern..

[7]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[8]  P. Gader,et al.  Advances in fuzzy integration for pattern recognition , 1994, CVPR 1994.

[9]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  J. Bezdek,et al.  On combining multiple classifiers by fuzzy templates , 1998, 1998 Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.98TH8353).

[11]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[12]  Michael I. Jordan,et al.  Local linear perceptrons for classification , 1996, IEEE Trans. Neural Networks.

[13]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[14]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[15]  Michel Grabisch,et al.  Classification by fuzzy integral: performance and tests , 1994, CVPR 1994.