Fusion of evidential CNN classifiers for image classification

We propose an information-fusion approach based on belief functions to combine convolutional neural networks. In this approach, several pre-trained DS-based CNN architectures extract features from input images and convert them into mass functions on different frames of discernment. A fusion module then aggregates these mass functions using Dempster’s rule. An end-to-end learning procedure allows us to fine-tune the overall architecture using a learning set with soft labels, which further improves the classification performance. The effectiveness of this approach is demonstrated experimentally using three benchmark databases.

[1]  Didier Dubois,et al.  Representations of Uncertainty in AI: Beyond Probability and Possibility , 2020, A Guided Tour of Artificial Intelligence Research.

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Thierry Denoeux,et al.  Evidential fully convolutional network for semantic segmentation , 2021, Applied Intelligence.

[5]  Zhiping Lin,et al.  Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[6]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[8]  Thierry Denoeux,et al.  Decision-Making with Belief Functions: a Review , 2018, Int. J. Approx. Reason..

[9]  Thierry Denoeux,et al.  Classifier fusion in the Dempster-Shafer framework using optimized t-norm based combination rules , 2011, Int. J. Approx. Reason..

[10]  Huijing Zhao,et al.  Multimodal information fusion for urban scene understanding , 2016, Machine Vision and Applications.

[11]  Philippe Smets,et al.  Constructing the Pignistic Probability Function in a Context of Uncertainty , 1989, UAI.

[12]  Yoshua Bengio,et al.  FitNets: Hints for Thin Deep Nets , 2014, ICLR.

[13]  C. V. Jawahar,et al.  Cats and dogs , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Didier Dubois,et al.  Representations of Uncertainty in Artificial Intelligence: Probability and Possibility , 2020, A Guided Tour of Artificial Intelligence Research.

[15]  Thierry Denoeux,et al.  An evidential classifier based on Dempster-Shafer theory and deep learning , 2021, Neurocomputing.

[16]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[17]  Pietro Perona,et al.  Caltech-UCSD Birds 200 , 2010 .

[18]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.