Three-Way Image Classification with Evidential Deep Convolutional Neural Networks

The farfetched certain classification of uncertain data suffers serious risks. Three-Way Decision (3WD) theory is utilized to implement uncertain data classification methods. Three-way uncertain data classification methods facilitate reducing decision risk and involving human–machine coordination through finding out uncertain cases for abstaining identification. Due to the limitation of traditional classifiers in feature learning, most existing three-way uncertain data classification methods are not good at handling the unstructural data of digital images. This shortage hinders the applications of three-way uncertain data classification in image-based decision support systems, such as the medical decision support systems based on radiographs. In this paper, we adopt deep convolutional neural networks (DCNNs) for feature learning and Dempster–Shafer (D-S) evidence theory as uncertainty measure to implement a three-way method for image classification. We utilize evidence theory to measure the uncertainty of the predictions produced by DCNNs and construct a novel evidential deep convolutional neural network (EviDCNN). Based on this, we propose a Three-Way Classification method with EviDCNN (EviDCNN-3WC). The experiments on massive medical image data sets validate that the proposed three-way classification method with EviDCNN is effective to identify uncertain images and reduce the risk in image classification. The superiorities of the proposed method facilitate its applications in image-based medical decision support systems.

[1]  Qing Li,et al.  Three-way decisions based software defect prediction , 2016, Knowl. Based Syst..

[2]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[3]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[4]  Hamido Fujita,et al.  Fuzzy neighborhood covering for three-way classification , 2020, Inf. Sci..

[5]  Thierry Denoeux,et al.  Ensemble clustering in the belief functions framework , 2011, Int. J. Approx. Reason..

[6]  Witold Pedrycz,et al.  Constrained shadowed sets and fast optimization algorithm , 2019, Int. J. Intell. Syst..

[7]  Thierry Denoeux,et al.  CEVCLUS: evidential clustering with instance-level constraints for relational data , 2014, Soft Comput..

[8]  Bing Huang,et al.  Cost-sensitive sequential three-way decision modeling using a deep neural network , 2017, Int. J. Approx. Reason..

[9]  Xiaodong Yue,et al.  Three-way decision support for diagnosis on focal liver lesions , 2017, Knowl. Based Syst..

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[12]  Zdzis?aw Pawlak,et al.  Rough sets , 2005, International Journal of Computer & Information Sciences.

[13]  Xiaodong Yue,et al.  Shadowed Neighborhoods Based on Fuzzy Rough Transformation for Three-Way Classification , 2020, IEEE Transactions on Fuzzy Systems.

[14]  Guoyin Wang,et al.  A tree-based incremental overlapping clustering method using the three-way decision theory , 2016, Knowl. Based Syst..

[15]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[16]  Thierry Denoeux,et al.  Parametric classification with soft labels using the evidential EM algorithm: linear discriminant analysis versus logistic regression , 2017, Advances in Data Analysis and Classification.

[17]  Thierry Denoeux,et al.  EVCLUS: evidential clustering of proximity data , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Thierry Denoeux,et al.  Maximum Likelihood Estimation from Uncertain Data in the Belief Function Framework , 2013, IEEE Transactions on Knowledge and Data Engineering.

[20]  Ran El-Yaniv,et al.  Selective Classification for Deep Neural Networks , 2017, NIPS.

[21]  Xiaodong Yue,et al.  Tri-partition neighborhood covering reduction for robust classification , 2017, Int. J. Approx. Reason..

[22]  D. Ciucci Orthopairs and granular computing , 2016 .

[23]  Duoqian Miao,et al.  Double-quantitative distance measurement and classification learning based on the tri-level granular structure of neighborhood system , 2021, Knowl. Based Syst..

[24]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..

[25]  Hong-Ying Zhang,et al.  Ranking interval sets based on inclusion measures and applications to three-way decisions , 2016, Knowl. Based Syst..

[26]  Wei-Zhi Wu,et al.  Three-way concept learning based on cognitive operators: An information fusion viewpoint , 2017, Int. J. Approx. Reason..

[27]  Hong Shi,et al.  Three-way k-means: integrating k-means and three-way decision , 2019, International Journal of Machine Learning and Cybernetics.

[28]  Nouman Azam,et al.  Web-Based Medical Decision Support Systems for Three-Way Medical Decision Making With Game-Theoretic Rough Sets , 2015, IEEE Transactions on Fuzzy Systems.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Thierry Denoeux,et al.  Editing training data for multi-label classification with the k-nearest neighbor rule , 2016, Pattern Analysis and Applications.

[31]  Didier Dubois,et al.  Borderline vs. unknown: comparing three-valued representations of imperfect information , 2014, Int. J. Approx. Reason..

[32]  Thierry Denoeux A k -Nearest Neighbor Classification Rule Based on Dempster-Shafer Theory , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[33]  Thierry Denoeux,et al.  An evidence-theoretic k-NN rule with parameter optimization , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[34]  Fan Min,et al.  Three-way active learning through clustering selection , 2020, International Journal of Machine Learning and Cybernetics.

[35]  Thierry Denoeux,et al.  A new evidential K-nearest neighbor rule based on contextual discounting with partially supervised learning , 2019, Int. J. Approx. Reason..

[36]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[37]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[38]  James F. Peters,et al.  Proximal three-way decisions: Theory and applications in social networks , 2016, Knowl. Based Syst..

[39]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[40]  Martin E. Hellman,et al.  The Nearest Neighbor Classification Rule with a Reject Option , 1970, IEEE Trans. Syst. Sci. Cybern..

[41]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[42]  Thierry Denoeux,et al.  ConvNet and Dempster-Shafer Theory for Object Recognition , 2019, SUM.

[43]  Decui Liang,et al.  Incorporating logistic regression to decision-theoretic rough sets for classifications , 2014, Int. J. Approx. Reason..

[44]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[45]  Thierry Denoeux,et al.  Dissimilarity Metric Learning in the Belief Function Framework , 2016, IEEE Transactions on Fuzzy Systems.

[46]  Thierry Denux Reasoning with imprecise belief structures , 1999 .

[47]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[48]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[49]  Glenn Shafer,et al.  A Mathematical Theory of Evidence turns 40 , 2016, Int. J. Approx. Reason..

[50]  Yanping Zhang,et al.  Multi-granular mining for boundary regions in three-way decision theory , 2016, Knowl. Based Syst..

[51]  Decui Liang,et al.  Deriving three-way decisions from intuitionistic fuzzy decision-theoretic rough sets , 2015, Inf. Sci..

[52]  A. Dempster Upper and Lower Probabilities Generated by a Random Closed Interval , 1968 .

[53]  Guoyin Wang,et al.  A general model of decision-theoretic three-way approximations of fuzzy sets based on a heuristic algorithm , 2020, Inf. Sci..

[54]  Nouman Azam,et al.  Evaluation functions and decision conditions of three-way decisions with game-theoretic rough sets , 2017, Eur. J. Oper. Res..

[55]  Nouman Azam,et al.  Game-theoretic rough sets for recommender systems , 2014, Knowl. Based Syst..

[56]  Yiyu Yao,et al.  Constructing shadowed sets and three-way approximations of fuzzy sets , 2017, Inf. Sci..

[57]  Ming Zhao,et al.  Evidential K-NN classification with enhanced performance via optimizing a class of parametric conjunctive t-rules , 2017, Knowl. Based Syst..

[58]  Jie Zhou,et al.  Three-way decision with co-training for partially labeled data , 2021, Inf. Sci..

[59]  Peter Walley,et al.  Belief Function Representations of Statistical Evidence , 1987 .

[60]  Fan Min,et al.  Three-way recommender systems based on random forests , 2016, Knowl. Based Syst..

[61]  Ling Wei,et al.  The connections between three-way and classical concept lattices , 2016, Knowl. Based Syst..

[62]  Yiyu Yao,et al.  Advances in three-way decisions and granular computing , 2016, Knowl. Based Syst..

[63]  Dorin Comaniciu,et al.  Quantifying and Leveraging Classification Uncertainty for Chest Radiograph Assessment , 2019, MICCAI.

[64]  Raymond Y. K. Lau,et al.  Enhancing Binary Classification by Modeling Uncertain Boundary in Three-Way Decisions , 2017, IEEE Transactions on Knowledge and Data Engineering.

[65]  Thierry Denoeux,et al.  k-CEVCLUS: Constrained evidential clustering of large dissimilarity data , 2017, Knowl. Based Syst..

[66]  Thierry Denoeux Logistic Regression Revisited: Belief Function Analysis , 2018, BELIEF.

[67]  Guangming Lang,et al.  Three-Way Group Conflict Analysis Based on Pythagorean Fuzzy Set Theory , 2020, IEEE Transactions on Fuzzy Systems.

[68]  Nan Zhang,et al.  Attribute reduction for sequential three-way decisions under dynamic granulation , 2017, Int. J. Approx. Reason..

[69]  Murat Sensoy,et al.  Evidential Deep Learning to Quantify Classification Uncertainty , 2018, NeurIPS.

[70]  Witold Pedrycz,et al.  Shadowed sets: representing and processing fuzzy sets , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[71]  Yiyu Yao,et al.  Three-Way Decisions and Cognitive Computing , 2016, Cognitive Computation.

[72]  Diana Mateus,et al.  Uncertainty Measurements for the Reliable Classification of Mammograms , 2019, MICCAI.

[73]  Thierry Denoeux,et al.  Evidential multinomial logistic regression for multiclass classifier calibration , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[74]  Yiyu Yao,et al.  Cost-sensitive three-way email spam filtering , 2013, Journal of Intelligent Information Systems.

[75]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..