Multi-stage modeling using fuzzy multi-criteria feature selection to improve survival prediction of ICU septic shock patients

In many binary medical classification problems, the cost of misclassifying one category is higher than the other, and in these applications it is desirable to employ a classifier with selective sensitivity or specificity. This work explores the utility of a fuzzy multi-criteria function for performance evaluation during knowledge-based medical classification and prediction. The method presented here uses fuzzy optimization to combine the sensitivity, specificity, and accuracy of classification as goals in a single objective function. This approach is used to assign flexible goals, which can be used to maximize the outcome in terms of each one of the goals. The proposed approach significantly increases the sensitivity and the specificity while maintaining or increasing accuracy. The versatility of the method is further exploited in a multi-model approach, using individual structures of multi-objective optimization of sensitivity and specificity separately, and then combining their outcomes through a decision-making module. Among various medical benefits derived from applying this technique, the divergent feature sets selected by high sensitivity and specificity models lend insight into factors more integrally connected to what causes risk of death for patients.

[1]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Blaise Hanczar,et al.  Small-sample precision of ROC-related estimates , 2010, Bioinform..

[3]  Gary Weiss,et al.  Improving classifier utility by altering the misclassification cost ratio , 2005, UBDM '05.

[4]  João Miguel da Costa Sousa,et al.  Decision tree search methods in fuzzy modeling and classification , 2007, Int. J. Approx. Reason..

[5]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[6]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[7]  Jürgen Paetz Knowledge-based approach to septic shock patient data using a neural network with trapezoidal activation functions , 2003, Artif. Intell. Medicine.

[8]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[9]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[10]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[11]  Gil Alterovitz,et al.  An artificial intelligence tool to predict fluid requirement in the intensive care unit: a proof-of-concept study , 2008, Critical care.

[12]  R. Real,et al.  AUC: a misleading measure of the performance of predictive distribution models , 2008 .

[13]  Ronald R. Yager,et al.  General Multiple-Objective Decision Functions and Linguistically Quantified Statements , 1984, Int. J. Man Mach. Stud..

[14]  R. Yager Fuzzy decision making including unequal objectives , 1978 .

[15]  W. Knaus,et al.  Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. , 1992, Chest.

[16]  João Miguel da Costa Sousa,et al.  Predicting Outcomes of Septic Shock Patients Using Feature Selection Based on Soft Computing Techniques , 2010, IPMU.

[17]  Uzay Kaymak,et al.  Weighted Constraint Aggregation in Fuzzy Optimization , 2004, Constraints.

[18]  H. Schächinger,et al.  Calcitonin precursors are reliable markers of sepsis in a medical intensive care unit , 2000, Critical care medicine.

[19]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[20]  Enrique Alba,et al.  Sensitivity and specificity based multiobjective approach for feature selection: Application to cancer diagnosis , 2009, Inf. Process. Lett..

[21]  Thomas G. Dietterich,et al.  Learning Boolean Concepts in the Presence of Many Irrelevant Features , 1994, Artif. Intell..

[22]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  João Miguel da Costa Sousa,et al.  Fuzzy modeling to predict administration of vasopressors in intensive care unit patients , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[24]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[25]  Uzay Kaymak,et al.  Fuzzy criteria for feature selection , 2012, Fuzzy Sets Syst..

[26]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[27]  Derek C. Angus,et al.  Epidemiology of sepsis: An update , 2001, Critical care medicine.

[28]  David J. Hand,et al.  Measuring classifier performance: a coherent alternative to the area under the ROC curve , 2009, Machine Learning.

[29]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[30]  Chuhsing Kate Hsiao,et al.  Alternative Summary Indices for the Receiver Operating Characteristic Curve , 1996, Epidemiology.

[31]  Abigail L. Horn,et al.  Multi-Objective Performance Evaluation Using Fuzzy Criteria: Increasing Sensitivity Prediction for Outcome of Septic Shock Patients , 2011 .

[32]  E H Shortliffe,et al.  Computer-assisted decision making in medicine. , 1984, The Journal of medicine and philosophy.

[33]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[34]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .