Extracting easily interpreted diagnostic rules

Abstract Diagnosis support systems are often disregarded because of their high costs, complicated inference and inability to modify the knowledge base. The aim of this work is to propose a method that helps to resolve these problems by extracting diagnostic rules that can be easily interpreted and verified by experts. The rules can be obtained from data, even if the latter are imperfect, which is usual in medical databases. Next, intuitively clear reasoning is suggested to elaborate on the diagnosis. Rules are focal elements in the framework of the Dempster–Shafer theory. They include fuzzy sets in their premises. Thus, a measure of imprecision as a fuzzy membership function and a measure of uncertainty as the basic probability value are used. Moreover, a rule selection algorithm and a rule evaluation method that prevent some of the imperfections of the existing methods are proposed. Particular attention is paid to the evaluation of the extracted rule set according to its reliability and clarity for a human user. Experimental results obtained for popular medical data sets demonstrate the advantages of the proposed approach. For each data set, simple and readable rule sets are determined. They provide comparable or better results than the approaches published so far.

[1]  Chee Peng Lim,et al.  A hybrid intelligent system for medical data classification , 2014, Expert Syst. Appl..

[2]  Yong Hu,et al.  A novel method to use fuzzy soft sets in decision making based on ambiguity measure and Dempster-Shafer theory of evidence: An application in medical diagnosis , 2016, Artif. Intell. Medicine.

[3]  Ewa Straszecka,et al.  Membership Functions for Fuzzy Focal Elements , 2016 .

[4]  Ronald R. Yager,et al.  Generalized probabilities of fuzzy events from fuzzy belief structures , 1982, Inf. Sci..

[5]  José Angel Olivas,et al.  An Application of Fuzzy Prototypes to the Diagnosis and Treatment of Fuzzy Diseases , 2017, Int. J. Intell. Syst..

[6]  Witold Pedrycz,et al.  Extraction of fuzzy rules from fuzzy decision trees: An axiomatic fuzzy sets (AFS) approach , 2013, Data Knowl. Eng..

[7]  Luigi Chisci,et al.  An approach to threat assessment based on evidential networks , 2007, 2007 10th International Conference on Information Fusion.

[8]  E. Berner,et al.  Clinical Decision Support Systems: Theory and Practice , 1998 .

[9]  Haiyan Zhao,et al.  Decision-theoretic rough fuzzy set model and application , 2014, Inf. Sci..

[10]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[11]  Alicja Wakulicz-Deja,et al.  Hybrid approach to the generation of medical guidelines for insulin therapy for children , 2017, Inf. Sci..

[12]  Patricia Melin,et al.  Neuro-Fuzzy Hybrid Model for the Diagnosis of Blood Pressure , 2017, Nature-Inspired Design of Hybrid Intelligent Systems.

[13]  Zhi-gang Su,et al.  Maximal confidence intervals of the interval-valued belief structure and applications , 2011, Inf. Sci..

[14]  Lala Septem Riza,et al.  A new approach on prediction of fever disease by using a combination of Dempster Shafer and Naïve bayes , 2016, 2016 2nd International Conference on Science in Information Technology (ICSITech).

[15]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[16]  Amir-Masoud Eftekhari-Moghadam,et al.  Knowledge discovery in medicine: Current issue and future trend , 2014, Expert Syst. Appl..

[17]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[18]  Efendi N. Nasibov,et al.  Influence of T-norm and T-conorm operators in Fuzzy ID3 algorithm , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[19]  Debela Tesfaye,et al.  Developing a Knowledge-Based System for Diagnosis and Treatment of Malaria , 2016, J. Inf. Knowl. Manag..

[20]  Patricia Melin,et al.  A Hybrid Intelligent System Model for Hypertension Diagnosis , 2017, Nature-Inspired Design of Hybrid Intelligent Systems.

[21]  Elias Oliveira,et al.  Achieving a compromise between performance and complexity of structure: An incremental approach , 2015, Inf. Sci..

[22]  Kemal Polat,et al.  Automatic detection of heart disease using an artificial immune recognition system (AIRS) with fuzzy resource allocation mechanism and k , 2007, Expert Syst. Appl..

[23]  Christian Esposito,et al.  A collaborative clinical analysis service based on theory of evidence, fuzzy linguistic sets and prospect theory and its application to craniofacial disorders in infants , 2017, Future Gener. Comput. Syst..

[24]  Saeid Nahavandi,et al.  Classification of healthcare data using genetic fuzzy logic system and wavelets , 2015, Expert Syst. Appl..

[25]  M. Beynon,et al.  The Dempster-Shafer theory of evidence: an alternative approach to multicriteria decision modelling , 2000 .

[26]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[27]  Dayou Liu,et al.  Evolving support vector machines using fruit fly optimization for medical data classification , 2016, Knowl. Based Syst..

[28]  Ewa Straszecka,et al.  Combining knowledge from different sources , 2010, Expert Syst. J. Knowl. Eng..

[29]  Piotr Porwik,et al.  Feature projection k-NN classifier model for imbalanced and incomplete medical data , 2016 .

[30]  Dayou Liu,et al.  A Computer Aided Diagnosis System for Thyroid Disease Using Extreme Learning Machine , 2012, Journal of Medical Systems.

[31]  H. Marateb,et al.  A noninvasive method for coronary artery diseases diagnosis using a clinically-interpretable fuzzy rule-based system , 2015, Journal of research in medical sciences : the official journal of Isfahan University of Medical Sciences.

[32]  Jan Stoklasa,et al.  Set-theoretic methodology using fuzzy sets in rule extraction and validation - consistency and coverage revisited , 2017, Inf. Sci..

[33]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[34]  Luca Cagliero,et al.  Digging deep into weighted patient data through multiple-level patterns , 2015, Inf. Sci..

[35]  Esin Dogantekin,et al.  An automatic diagnosis system based on thyroid gland: ADSTG , 2010, Expert Syst. Appl..

[36]  Jesús Alcalá-Fdez,et al.  Mining fuzzy association rules from low-quality data , 2011, Soft Computing.

[37]  Gang Wang,et al.  A Three-Stage Expert System Based on Support Vector Machines for Thyroid Disease Diagnosis , 2012, Journal of Medical Systems.

[38]  Witold Pedrycz,et al.  Fuzzy logic-based generalized decision theory with imperfect information , 2012, Inf. Sci..

[39]  Hasan Bal,et al.  Comparing performances of backpropagation and genetic algorithms in the data classification , 2011, Expert Syst. Appl..

[40]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[41]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[42]  Olatunji Mumini Omisore,et al.  A web based decision support system driven by fuzzy logic for the diagnosis of typhoid fever , 2013, Expert Syst. Appl..

[43]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[44]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[45]  Pasi Luukka,et al.  Similarity classifier using similarity measure derived from Yu's norms in classification of medical data sets , 2007, Comput. Biol. Medicine.

[46]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[47]  Jacek M. Leski,et al.  Fuzzy $(c+p)$-Means Clustering and Its Application to a Fuzzy Rule-Based Classifier: Toward Good Generalization and Good Interpretability , 2015, IEEE Transactions on Fuzzy Systems.

[48]  Ewa Straszecka,et al.  Combining uncertainty and imprecision in models of medical diagnosis , 2006, Inf. Sci..

[49]  Ljiljana Gajic,et al.  Fuzzy valued probability , 2015, Inf. Sci..

[50]  Wlodzislaw Duch,et al.  Support Feature Machines: Support vectors are not enough , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).