Use of learning approaches to predict clinical deterioration in patients based on various variables: a review of the literature

Machine learning can be considered as the current gold standard for predicting deterioration in Intensive Care Unit patients and is in extensive use throughout the world in different fields. As confirmed by many studies, preventing the occurrence of the onset of deterioration in a sufficient time window is a priority in healthcare centers. Also, the significance of enhancing the quality of hospital care and the reduction of adverse outcomes is of great importance. Notably, it is hypothesized that by exploiting recent technologies, models built upon dynamic variables (e.g. vital signs, lab tests, and demographic variables) could reinforce the predictive ability of models aimed at detection of in clinical deterioration with high accuracy, sensitivity and specificity. This manuscript summarises the techniques and approaches proposed in the literature for predicting deterioration and compares the performance and limitations of various approaches grouped based on their application. While several approaches can attain promising results, there is still room for additional improvement, especially in pre-processing and modeling enhancement steps where most methods do not take the necessary steps for ensuring a high-performance result. In this manuscript, the most effective machine learning models, as well as deep learning models, for predicting deterioration of patients are discussed in hopes of assisting the readers with ascertaining the best possible solutions for this problem.

[1]  B. Nicklas,et al.  Standardized Rehabilitation and Hospital Length of Stay Among Patients With Acute Respiratory Failure: A Randomized Clinical Trial. , 2016, JAMA.

[2]  Segyeong Joo,et al.  Prediction of Ventricular Tachycardia One Hour before Occurrence Using Artificial Neural Networks , 2016, Scientific Reports.

[3]  Abiel Roche-Lima,et al.  Learning stochastic finite-state transducer to predict individual patient outcomes , 2016, Health and technology.

[4]  R. Morgan,et al.  An early warning scoring system for detecting developing critical illness , 1997 .

[5]  Nigel H Lovell,et al.  Non-invasive classification of severe sepsis and systemic inflammatory response syndrome using a nonlinear support vector machine: a preliminary study , 2010, Physiological measurement.

[6]  Jiyoul Lee,et al.  Pulse-modulated multilevel data storage in an organic ferroelectric resistive memory diode , 2016, Scientific Reports.

[7]  Kotagiri Ramamohanarao,et al.  Septic shock prediction for ICU patients via coupled HMM walking on sequential contrast patterns , 2017, J. Biomed. Informatics.

[8]  J. Rethans,et al.  A review of educational strategies to improve nurses' roles in recognizing and responding to deteriorating patients. , 2011, International nursing review.

[9]  Nan Liu,et al.  Prediction of cardiac arrest in critically ill patients presenting to the emergency department using a machine learning score incorporating heart rate variability compared with the modified early warning score , 2012, Critical Care.

[10]  Christopher P. Bonafide,et al.  Cost-Benefit Analysis of a Medical Emergency Team in a Children’s Hospital , 2014, Pediatrics.

[11]  G. Moody,et al.  Predicting acute hypotensive episodes: The 10th annual PhysioNet/Computers in Cardiology Challenge , 2010, 2009 36th Annual Computers in Cardiology Conference (CinC).

[12]  Kenichi Nitta,et al.  Importance of respiratory rate for the prediction of clinical deterioration after emergency department discharge: a single‐center, case–control study , 2016, Acute medicine & surgery.

[13]  C. Subbe,et al.  Validation of a modified Early Warning Score in medical admissions. , 2001, QJM : monthly journal of the Association of Physicians.

[14]  Validation of the VitalPAC Early Warning Score at the Intermediate Care Unit , 2018, World journal of critical care medicine.

[15]  Vincent Liu,et al.  Adverse outcomes associated with delayed intensive care unit transfers in an integrated healthcare system. , 2012, Journal of hospital medicine.

[16]  William Fleischman,et al.  Prediction of In-hospital Mortality in Emergency Department Patients With Sepsis: A Local Big Data-Driven, Machine Learning Approach. , 2016, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[17]  Mark Hoogendoorn,et al.  Prediction using patient comparison vs. modeling: A case study for mortality prediction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Gary B. Smith,et al.  Calculating early warning scores--a classroom comparison of pen and paper and hand-held computer methods. , 2006, Resuscitation.

[19]  Sylvie Chevret,et al.  Delayed intensive care unit admission is associated with increased mortality in patients with cancer with acute respiratory failure , 2013, Leukemia & lymphoma.

[20]  M. Cecchini,et al.  Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease , 2016, Scientific Reports.

[21]  Y. Pawitan In all likelihood : statistical modelling and inference using likelihood , 2002 .

[22]  K. Samuelson,et al.  The National Early Warning Score: Translation, testing and prediction in a Swedish setting. , 2016, Intensive & critical care nursing.

[23]  Xiao Hu,et al.  Reducing False Intracranial Pressure Alarms Using Morphological Waveform Features , 2013, IEEE Transactions on Biomedical Engineering.

[24]  Nada Lavrac,et al.  Machine Learning for Data Mining in Medicine , 1999, AIMDM.

[25]  S. Grant Limitations of track and trigger systems and the National Early Warning Score. Part 1: areas of contention. , 2018, British journal of nursing.

[26]  Vincent M. Quinten,et al.  Repeated vital sign measurements in the emergency department predict patient deterioration within 72 hours: a prospective observational study , 2018, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.

[27]  G. Clifford,et al.  Signal quality and data fusion for false alarm reduction in the intensive care unit. , 2012, Journal of electrocardiology.

[28]  Yi Zheng,et al.  Exploiting multi-channels deep convolutional neural networks for multivariate time series classification , 2015, Frontiers of Computer Science.

[29]  Zuren Feng,et al.  Fireworks algorithm for the multi-satellite control resource scheduling problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[30]  Leo A. Celi,et al.  The MIMIC Code Repository: enabling reproducibility in critical care research , 2017, J. Am. Medical Informatics Assoc..

[31]  A. Yli-Hankala,et al.  National early warning score (NEWS) in a Finnish multidisciplinary emergency department and direct vs. late admission to intensive care. , 2018, Resuscitation.

[32]  G. Clermont,et al.  Dynamic and Personalized Risk Forecast in Step‐Down Units. Implications for Monitoring Paradigms , 2017, Annals of the American Thoracic Society.

[33]  T. H. Kyaw,et al.  Multiparameter Intelligent Monitoring in Intensive Care II: A public-access intensive care unit database* , 2011, Critical care medicine.

[34]  Larry J. Eshelman,et al.  Development and Evaluation of Predictive Alerts for Hemodynamic Instability in ICU Patients , 2008, AMIA.

[35]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[36]  Kuldip K. Paliwal,et al.  Deep learning for minimum mean-square error approaches to speech enhancement , 2019, Speech Commun..

[37]  Paul E. Schmidt,et al.  Review and performance evaluation of aggregate weighted 'track and trigger' systems. , 2008, Resuscitation.

[38]  Russell E. Lewis,et al.  Development and Applications of Prognostic Risk Models in the Management of Invasive Mold Disease , 2018, Journal of fungi.

[39]  David O. Meltzer,et al.  Multicenter Comparison of Machine Learning Methods and Conventional Regression for Predicting Clinical Deterioration on the Wards , 2016, Critical care medicine.

[40]  Weijie Wang,et al.  Analysis of the Mean Absolute Error (MAE) and the Root Mean Square Error (RMSE) in Assessing Rounding Model , 2018 .

[41]  F. Rosenow,et al.  Costs, length of stay, and mortality of super‐refractory status epilepticus: A population‐based study from Germany , 2017, Epilepsia.

[42]  Gary B. Smith,et al.  The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. , 2013, Resuscitation.

[43]  Matthew M Churpek,et al.  Predicting clinical deterioration in the hospital: the impact of outcome selection. , 2013, Resuscitation.

[44]  Rohit J. Kate,et al.  Prediction and detection models for acute kidney injury in hospitalized older adults , 2016, BMC Medical Informatics and Decision Making.

[45]  T. Lasko,et al.  Computational Phenotype Discovery Using Unsupervised Feature Learning over Noisy, Sparse, and Irregular Clinical Data , 2013, PloS one.

[46]  Aldo A. Faisal,et al.  The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care , 2018, Nature Medicine.

[47]  Vincent Liu,et al.  Development and validation of an electronic medical record-based alert score for detection of inpatient deterioration outside the ICU , 2016, J. Biomed. Informatics.

[48]  Julie S. Ivy,et al.  Individualizing and optimizing the use of early warning scores in acute medical care for deteriorating hospitalized patients. , 2015, Resuscitation.

[49]  Christian Guttmann,et al.  Deep learning architectures for vector representations of patients and exploring predictors of 30-day hospital readmissions in patients with multiple chronic conditions , 2018, AIH@IJCAI.

[50]  Azhar Rafiq,et al.  Using Bayesian Networks and Rule-Based Trending to Predict Patient Status in the Intensive Care Unit , 2009, AMIA.

[51]  Ben Wellner,et al.  Predicting Unplanned Transfers to the Intensive Care Unit: A Machine Learning Approach Leveraging Diverse Clinical Elements , 2017, JMIR medical informatics.

[52]  R. Paradiso,et al.  Wearable health care system for vital signs monitoring , 2003, 4th International IEEE EMBS Special Topic Conference on Information Technology Applications in Biomedicine, 2003..

[53]  Yixin Chen,et al.  An integrated data mining approach to real-time clinical monitoring and deterioration warning , 2012, KDD.

[54]  Robert Gibbons,et al.  Using Electronic Health Record Data to Develop and Validate a Prediction Model for Adverse Outcomes in the Wards* , 2012, Critical care medicine.

[55]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[56]  Ruili Wang,et al.  A Survey on an Emerging Area: Deep Learning for Smart City Data , 2019, IEEE Transactions on Emerging Topics in Computational Intelligence.

[57]  Jimeng Sun,et al.  Automatic identification of heart failure diagnostic criteria, using text analysis of clinical notes from electronic health records , 2014, Int. J. Medical Informatics.

[58]  R G Mark,et al.  MIMIC II: a massive temporal ICU patient database to support research in intelligent patient monitoring , 2002, Computers in Cardiology.

[59]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[60]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[61]  Michael J. Rothman,et al.  Development and validation of a continuous measure of patient condition using the Electronic Medical Record , 2013, J. Biomed. Informatics.

[62]  Igor Kononenko,et al.  Machine learning for medical diagnosis: history, state of the art and perspective , 2001, Artif. Intell. Medicine.

[63]  Jinchang Ren,et al.  ANN vs. SVM: Which one performs better in classification of MCCs in mammogram imaging , 2012, Knowl. Based Syst..

[64]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[65]  Valerie J. Gooder,et al.  Inpatient transfers to the intensive care unit , 2003 .

[66]  Jane C. Deng,et al.  Prediction of Clinical Deterioration in Hospitalized Adult Patients with Hematologic Malignancies Using a Neural Network Model , 2016, PloS one.

[67]  Mark J. van der Laan,et al.  Super Learner In Prediction , 2010 .

[68]  Chin-Hui Lee,et al.  On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression , 2020, IEEE Signal Processing Letters.

[69]  Daniel A Reuter,et al.  Patient monitoring alarms in the ICU and in the operating room , 2013, Critical Care.

[70]  Y. Kondo,et al.  The nutritional index 'CONUT' is useful for predicting long-term prognosis of patients with end-stage liver diseases. , 2011, The Tohoku journal of experimental medicine.

[71]  Svetha Venkatesh,et al.  $\mathtt {Deepr}$: A Convolutional Net for Medical Records , 2016, IEEE Journal of Biomedical and Health Informatics.

[72]  Dev Jayaraman,et al.  Adverse outcomes associated with delayed intensive care consultation in medical and surgical inpatients. , 2012, Journal of critical care.

[73]  N. Black,et al.  Interventions to reduce mortality from in-hospital cardiac arrest: a mixed-methods study , 2019, Health Services and Delivery Research.

[74]  Ibrahim Khalil,et al.  ViSiBiD: A learning model for early discovery and real-time prediction of severe clinical events using vital signs as big data , 2017, Comput. Networks.

[75]  P. Nanayakkara,et al.  Prognostic value of early warning scores in the emergency department (ED) and acute medical unit (AMU): A narrative review. , 2017, European journal of internal medicine.

[76]  J Lee,et al.  A hypotensive episode predictor for intensive care based on heart rate and blood pressure time series , 2010, 2010 Computing in Cardiology.

[77]  S. A. Becker,et al.  NMC Horizon Report: 2016 Higher Education Edition , 2015 .

[78]  Hiram Galeana-Zapién,et al.  Evaluation of the Impact of Data Uncertainty on the Prediction of Physiological Patient Deterioration , 2018, IEEE Access.

[79]  Geok Soon Hong,et al.  Nozzle condition monitoring in 3D printing , 2018, Robotics and Computer-Integrated Manufacturing.

[80]  Annmarie Touborg Lassen,et al.  Prognosis and Risk Factors for Deterioration in Patients Admitted to a Medical Emergency Department , 2014, PloS one.

[81]  R. Bellomo,et al.  The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). , 2016, JAMA.

[82]  Roy D Sleator,et al.  Biologically inspired intelligent decision making , 2013, Bioengineered.

[83]  Aram Galstyan,et al.  Multitask learning and benchmarking with clinical time series data , 2017, Scientific Data.

[84]  Olivier Bodenreider,et al.  The digital revolution in phenotyping , 2015, Briefings Bioinform..

[85]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[86]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[87]  Alex Chan,et al.  Identification of serious illness conversations in unstructured clinical notes using deep neural networks , 2018, AIH@IJCAI.

[88]  Mohammad Mehedy Masud,et al.  Mortality prediction of ICU patients using lab test data by feature vector compaction & classification , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[89]  Shutao Li,et al.  Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[90]  Yizhao Ni,et al.  Developing and evaluating a machine learning based algorithm to predict the need of pediatric intensive care unit transfer for newly hospitalized children. , 2014, Resuscitation.

[91]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[92]  Uli K. Chettipally,et al.  Prediction of Sepsis in the Intensive Care Unit With Minimal Electronic Health Record Data: A Machine Learning Approach , 2016, JMIR medical informatics.

[93]  A. Belton,et al.  Continuous Monitoring of Health Status Outcomes: Experience With a Diabetes Education Program , 1995, The Diabetes educator.

[94]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[95]  Romain Pirracchio,et al.  Mortality Prediction in the ICU Based on MIMIC-II Results from the Super ICU Learner Algorithm (SICULA) Project , 2016 .

[96]  R. Mark,et al.  An investigation of patterns in hemodynamic data indicative of impending hypotension in intensive care , 2010, Biomedical engineering online.