Multi-objective evolutionary algorithms for fuzzy classification in survival prediction

OBJECTIVE This paper presents a novel rule-based fuzzy classification methodology for survival/mortality prediction in severe burnt patients. Due to the ethical aspects involved in this medical scenario, physicians tend not to accept a computer-based evaluation unless they understand why and how such a recommendation is given. Therefore, any fuzzy classifier model must be both accurate and interpretable. METHODS AND MATERIALS The proposed methodology is a three-step process: (1) multi-objective constrained optimization of a patient's data set, using Pareto-based elitist multi-objective evolutionary algorithms to maximize accuracy and minimize the complexity (number of rules) of classifiers, subject to interpretability constraints; this step produces a set of alternative (Pareto) classifiers; (2) linguistic labeling, which assigns a linguistic label to each fuzzy set of the classifiers; this step is essential to the interpretability of the classifiers; (3) decision making, whereby a classifier is chosen, if it is satisfactory, according to the preferences of the decision maker. If no classifier is satisfactory for the decision maker, the process starts again in step (1) with a different input parameter set. RESULTS The performance of three multi-objective evolutionary algorithms, niched pre-selection multi-objective algorithm, elitist Pareto-based multi-objective evolutionary algorithm for diversity reinforcement (ENORA) and the non-dominated sorting genetic algorithm (NSGA-II), was tested using a patient's data set from an intensive care burn unit and a standard machine learning data set from an standard machine learning repository. The results are compared using the hypervolume multi-objective metric. Besides, the results have been compared with other non-evolutionary techniques and validated with a multi-objective cross-validation technique. Our proposal improves the classification rate obtained by other non-evolutionary techniques (decision trees, artificial neural networks, Naive Bayes, and case-based reasoning) obtaining with ENORA a classification rate of 0.9298, specificity of 0.9385, and sensitivity of 0.9364, with 14.2 interpretable fuzzy rules on average. CONCLUSIONS Our proposal improves the accuracy and interpretability of the classifiers, compared with other non-evolutionary techniques. We also conclude that ENORA outperforms niched pre-selection and NSGA-II algorithms. Moreover, given that our multi-objective evolutionary methodology is non-combinational based on real parameter optimization, the time cost is significantly reduced compared with other evolutionary approaches existing in literature based on combinational optimization.

[1]  Xiao Jie,et al.  Mortality rates among 5321 patients with burns admitted to a burn unit in China: 1980-1998. , 2003, Burns : journal of the International Society for Burn Injuries.

[2]  Shyi-Ming Chen,et al.  A New Approach for Handling the Iris Data Classification Problem , 2005 .

[3]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[4]  Bernhard Sendhoff,et al.  Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  E. Tredget,et al.  Infection control in the burn unit. , 2011, Burns : journal of the International Society for Burn Injuries.

[6]  María José del Jesús,et al.  Special Issue on Genetic Fuzzy Systems and the Interpretability-Accuracy Trade-off , 2007, Int. J. Approx. Reason..

[7]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  Abraham Kandel,et al.  Feature-based fuzzy classification for interpretation of mammograms , 2000, Fuzzy Sets Syst..

[10]  Andrés Esteban,et al.  A model for predicting mortality among critically ill burn victims. , 2009, Burns : journal of the International Society for Burn Injuries.

[11]  Magne Setnes,et al.  Rule-based modeling: precision and transparency , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[12]  P. Villar,et al.  A multiobjective genetic algorithm for feature selection and granularity learning in fuzzy-rule based classification systems , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[13]  B. Atiyeh,et al.  State of the Art in Burn Treatment , 2005, World Journal of Surgery.

[14]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[15]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[16]  Gang Feng,et al.  T‚ÄìS Fuzzy Modeling and Identification , 2010 .

[17]  Marco Laumanns,et al.  On the Effects of Archiving, Elitism, and Density Based Selection in Evolutionary Multi-objective Optimization , 2001, EMO.

[18]  A. Abu-Hanna,et al.  Evaluation of SOFA-based models for predicting mortality in the ICU: A systematic review , 2008, Critical care.

[19]  José M. Alonso,et al.  Special issue on interpretable fuzzy systems , 2011, Inf. Sci..

[20]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[21]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[22]  G. O’Keefe,et al.  The risk factors and time course of sepsis and organ dysfunction after burn trauma. , 2003, The Journal of trauma.

[23]  Ivan Křivý,et al.  Fuzzy Modeling Optimization of fuzzy models using evolutionary algorithms , 2007 .

[24]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[25]  Edward H. Shortliffe,et al.  Computer-based medical consultations, MYCIN , 1976 .

[26]  M. Rotondo,et al.  A new approach to probability of survival scoring for trauma quality assurance. , 1992, The Journal of trauma.

[27]  A Burd,et al.  Outcome analysis of 286 severely burned patients: retrospective study. , 2002, Hong Kong medical journal = Xianggang yi xue za zhi.

[28]  Roque Marín,et al.  T‐CARE: temporal case retrieval system , 2011, Expert Syst. J. Knowl. Eng..

[29]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[30]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[31]  D. Hosmer,et al.  Simplified estimates of the probability of death after burn injuries: extending and updating the baux score. , 2010, The Journal of trauma.

[32]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[33]  R F Edlich,et al.  The abbreviated burn severity index. , 1982, Annals of emergency medicine.

[34]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[35]  Lucila Ohno-Machado,et al.  Prediction of mortality in an Indian intensive care unit , 2004, Intensive Care Medicine.

[36]  Juan Zhang,et al.  Classification tree modeling to identify severe and moderate vehicular injuries in young and middle-aged adults , 2009, Artif. Intell. Medicine.

[37]  Hiroshi Wada,et al.  Characteristics of burn patients transported by ambulance to treatment facilities in Akita Prefecture, Japan. , 2002, Burns : journal of the International Society for Burn Injuries.

[38]  Francisco Herrera,et al.  Genetic Fuzzy Systems: Status, Critical Considerations and Future Directions , 2005 .

[39]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[40]  Yaochu Jin,et al.  Multi-Objective Machine Learning , 2006, Studies in Computational Intelligence.

[41]  F. Jim Pareto-optimality in Fuzzy Modeling , 1998 .

[42]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[43]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[44]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[45]  Rudolf Kruse,et al.  Obtaining interpretable fuzzy classification rules from medical data , 1999, Artif. Intell. Medicine.

[46]  M. Frize,et al.  Clinical decision-support systems for intensive care units using case-based reasoning. , 2000, Medical engineering & physics.

[47]  T. Buchman,et al.  A comparison of statistical and connectionist models for the prediction of chronicity in a surgical intensive care unit , 1994, Critical care medicine.

[48]  Tudor Toma,et al.  Discovery and inclusion of SOFA score episodes in mortality prediction , 2007, J. Biomed. Informatics.

[49]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[50]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[51]  Moshe Sipper,et al.  Evolutionary computation in medicine: an overview , 2000, Artif. Intell. Medicine.

[52]  R. Gamelli,et al.  Outcome for older burn patients. , 2000, Archives of surgery.

[53]  J L Pujol,et al.  Comparison of an expert system with other clinical scores for the evaluation of severity of asthma. , 1996, The European respiratory journal.

[54]  Roque Marín,et al.  A Reuse-Based CBR System Evaluation in Critical Medical Scenarios , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[55]  A.F. Gomez-Skarmeta,et al.  An evolutionary algorithm for constrained multi-objective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[56]  W H Gilmour,et al.  Mortality probability in victims of fire trauma: revised equation to include inhalation injury. , 1986, British medical journal.

[57]  María José del Jesús,et al.  Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction , 2005, IEEE Transactions on Fuzzy Systems.

[58]  John Yen,et al.  Improving the interpretability of TSK fuzzy models by combining global learning and local learning , 1998, IEEE Trans. Fuzzy Syst..

[59]  Haijia Shi Best-first Decision Tree Learning , 2007 .

[60]  Antonio F. Gómez-Skarmeta,et al.  Fuzzy modeling with hybrid systems , 1999, Fuzzy Sets Syst..

[61]  Antonio F. Gómez-Skarmeta,et al.  Accurate, Transparent, and Compact Fuzzy Models for Function Approximation and Dynamic Modeling through Multi-objective Evolutionary Optimization , 2001, EMO.

[62]  T. Coats,et al.  Comparison of artificial intelligence techniques with UKTRISS for estimating probability of survival after trauma. UK Trauma and Injury Severity Score. , 2001, The Journal of trauma.

[63]  Francisco Herrera,et al.  A Fast and Scalable Multiobjective Genetic Fuzzy System for Linguistic Fuzzy Modeling in High-Dimensional Regression Problems , 2011, IEEE Transactions on Fuzzy Systems.

[64]  Zhiming Cui,et al.  A Novel Medical Image Dynamic Fuzzy Classification Model Based on Ridgelet Transform , 2010, J. Softw..

[65]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[66]  J. Barret,et al.  Epidemiology and mortality of adult burns in Catalonia. , 1999, Burns : journal of the International Society for Burn Injuries.

[67]  Ludmila I. Kuncheva,et al.  On the optimality of Naïve Bayes with dependent binary features , 2006, Pattern Recognit. Lett..

[68]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[69]  A. Gómez-Skarmeta,et al.  Improving interpretability in approximative fuzzy models via multiobjective evolutionary algorithms: Research Articles , 2007 .

[70]  Gary B. Lamont,et al.  Applications Of Multi-Objective Evolutionary Algorithms , 2004 .

[71]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[72]  Takeshi Furuhashi,et al.  Efficient fuzzy modeling under multiple criteria by using genetic algorithm , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[73]  C. Smith Diagnostic tests (1) – sensitivity and specificity , 2012, Phlebology.

[74]  Chien-Lung Chan,et al.  Constructing a novel mortality prediction model with Bayes theorem and genetic algorithm , 2011, Expert Syst. Appl..

[75]  P. Heagerty,et al.  Survival Model Predictive Accuracy and ROC Curves , 2005, Biometrics.

[76]  César Hervás-Martínez,et al.  Multi-objective evolutionary algorithm for donor-recipient decision system in liver transplants , 2012, Eur. J. Oper. Res..

[77]  Francisco Herrera,et al.  Generating the knowledge base of a fuzzy rule-based system by the genetic learning of the data base , 2001, IEEE Trans. Fuzzy Syst..

[78]  Beatrice Lazzerini,et al.  Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets , 2010, Soft Comput..

[79]  Juan Ruiz-Alzola,et al.  A fuzzy system for helping medical diagnosis of malformations of cortical development , 2007, J. Biomed. Informatics.

[80]  Geoffrey J. Gordon,et al.  Artificial Intelligence in Medicine: 17th Conference on Artificial Intelligence in Medicine, AIME 2019, Poznan, Poland, June 26–29, 2019, Proceedings , 2019, Lecture Notes in Computer Science.

[81]  Ludmil Mikhailov,et al.  An interpretable fuzzy rule-based classification methodology for medical diagnosis , 2009, Artif. Intell. Medicine.

[82]  Friedrich Steimann,et al.  On the use and usefulness of fuzzy sets in medical AI , 2001, Artif. Intell. Medicine.

[83]  Lalit M. Patnaik,et al.  Adaptive probabilities of crossover and mutation in genetic algorithms , 1994, IEEE Trans. Syst. Man Cybern..

[84]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[85]  Corrado Mencar,et al.  Interpretability of Fuzzy Information Granules , 2009, Human-Centric Information Processing Through Granular Modelling.

[86]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study , 1993 .

[87]  Robert Babuška,et al.  A multi-objective evolutionary algorithm for fuzzy modeling , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[88]  V. Kreinovich,et al.  Gaussian membership functions are most adequate in representing uncertainty in measurements , 1992 .

[89]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[90]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[91]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[92]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[93]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[94]  S Hemington-Gorse,et al.  Prognostic scoring systems in burns: a review. , 2011, Burns : journal of the International Society for Burn Injuries.

[95]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[96]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[97]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[98]  E. Shortliffe Computer-based medical consultations: mycin (elsevier north holland , 1976 .

[99]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..

[100]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[101]  Seymour Geisser,et al.  8. Predictive Inference: An Introduction , 1995 .

[102]  Y. Godwin,et al.  Major burns in Cape Town: a modified burns score for patient triage. , 1998, Burns : journal of the International Society for Burn Injuries.

[103]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[104]  Giancarlo Mauri,et al.  Identification of Individualized Feature Combinations for Survival Prediction in Breast Cancer: A Comparison of Machine Learning Techniques , 2010, EvoBIO.

[105]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[106]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[107]  Yoav Freund,et al.  The Alternating Decision Tree Learning Algorithm , 1999, ICML.

[108]  M F Khadim,et al.  Mortality estimates in the elderly burn patients: the Northern Ireland experience. , 2009, Burns : journal of the International Society for Burn Injuries.

[109]  Paulo J. G. Lisboa,et al.  A review of evidence of health benefit from artificial neural networks in medical intervention , 2002, Neural Networks.