Application of Machine Learning in Intensive Care Unit (ICU) Settings Using MIMIC Dataset: Systematic Review

Modern Intensive Care Units (ICUs) provide continuous monitoring of critically ill patients susceptible to many complications affecting morbidity and mortality. ICU settings require a high staff-to-patient ratio and generates a sheer volume of data. For clinicians, the real-time interpretation of data and decision-making is a challenging task. Machine Learning (ML) techniques in ICUs are making headway in the early detection of high-risk events due to increased processing power and freely available datasets such as the Medical Information Mart for Intensive Care (MIMIC). We conducted a systematic literature review to evaluate the effectiveness of applying ML in the ICU settings using the MIMIC dataset. A total of 322 articles were reviewed and a quantitative descriptive analysis was performed on 61 qualified articles that applied ML techniques in ICU settings using MIMIC data. We assembled the qualified articles to provide insights into the areas of application, clinical variables used, and treatment outcomes that can pave the way for further adoption of this promising technology and possible use in routine clinical decision-making. The lessons learned from our review can provide guidance to researchers on application of ML techniques to increase their rate of adoption in healthcare.

[1]  L. Ungar,et al.  Inclusion of Unstructured Clinical Text Improves Early Prediction of Death or Prolonged ICU Stay* , 2018, Critical care medicine.

[2]  V. Mohan,et al.  Frequency of Passive EHR Alerts in the ICU: Another Form of Alert Fatigue? , 2016, Journal of patient safety.

[3]  Yan Liu,et al.  Benchmarking deep learning models on large healthcare datasets , 2018, J. Biomed. Informatics.

[4]  Kotagiri Ramamohanarao,et al.  Septic shock prediction for ICU patients via coupled HMM walking on sequential contrast patterns , 2017, J. Biomed. Informatics.

[5]  Fei Tang,et al.  Random forest missing data algorithms , 2017, Stat. Anal. Data Min..

[6]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[7]  Maryellen L Giger,et al.  Machine Learning in Medical Imaging. , 2018, Journal of the American College of Radiology : JACR.

[8]  Xin Ma,et al.  Health status monitoring for ICU patients based on locally weighted principal component analysis , 2018, Comput. Methods Programs Biomed..

[9]  Sherif Sakr,et al.  On the interpretability of machine learning-based model for predicting hypertension , 2019, BMC Medical Informatics and Decision Making.

[10]  L. Celi,et al.  A machine learning-based model for 1-year mortality prediction in patients admitted to an Intensive Care Unit with a diagnosis of sepsis. , 2020, Medicina intensiva.

[11]  R. Mark,et al.  An investigation of patterns in hemodynamic data indicative of impending hypotension in intensive care , 2010, Biomedical engineering online.

[12]  Paul Heidenreich,et al.  Electronic health record-based clinical decision support alert for severe sepsis: a randomised evaluation , 2019, BMJ Quality & Safety.

[13]  Xiaoqian Jiang,et al.  Early Prediction of Acute Kidney Injury in Critical Care Setting Using Clinical Notes , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[14]  May D. Wang,et al.  Interpretable Predictions of Clinical Outcomes with An Attention-based Recurrent Neural Network , 2017, BCB.

[15]  Yuan Wang,et al.  Utilizing imbalanced electronic health records to predict acute kidney injury by ensemble learning and time series model , 2020, BMC Medical Informatics and Decision Making.

[16]  Shubhajit Roy Chowdhury,et al.  Coronary artery disease detection using photoplethysmography , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Martin G. Seneviratne,et al.  Predicting the Incidence of Pressure Ulcers in the Intensive Care Unit Using Machine Learning , 2019, EGEMS.

[18]  M. J. van der Laan,et al.  Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based study. , 2015, The Lancet. Respiratory medicine.

[19]  Mark Hoogendoorn,et al.  Prediction using patient comparison vs. modeling: A case study for mortality prediction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Elizabeth S. Chen,et al.  Predicting Mortality in Diabetic ICU Patients Using Machine Learning and Severity Indices , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[21]  Qiao Li,et al.  ECG Signal Quality During Arrhythmia and Its Application to False Alarm Reduction , 2013, IEEE Transactions on Biomedical Engineering.

[22]  Yuan Luo,et al.  Predictive modeling of bacterial infections and antibiotic therapy needs in critically ill adults , 2020, J. Biomed. Informatics.

[23]  Stephen M Borstelmann,et al.  Machine Learning Principles for Radiology Investigators. , 2020, Academic radiology.

[24]  Antoine Chambaz,et al.  Prediction of an Acute Hypotensive Episode During an ICU Hospitalization With a Super Learner Machine-Learning Algorithm , 2020, Anesthesia and analgesia.

[25]  J Lee,et al.  A hypotensive episode predictor for intensive care based on heart rate and blood pressure time series , 2010, 2010 Computing in Cardiology.

[26]  Peter Szolovits,et al.  Early Prediction of Acute Kidney Injury in Critical Care Setting Using Clinical Notes and Structured Multivariate Physiological Measurements , 2019, MedInfo.

[27]  Sebastian Raschka,et al.  Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning , 2018, ArXiv.

[28]  Ke Lin,et al.  Predicting in-hospital mortality of patients with acute kidney injury in the ICU using random forest model , 2019, Int. J. Medical Informatics.

[29]  Jairo A. Gutiérrez,et al.  ISeeU: Visually interpretable deep learning for mortality prediction inside the ICU , 2019, J. Biomed. Informatics.

[30]  Ben J. Marafino,et al.  Research and applications: N-gram support vector machines for scalable procedure and diagnosis classification, with applications to clinical free text data from the intensive care unit , 2014, J. Am. Medical Informatics Assoc..

[31]  Sihai Dave Zhao,et al.  A closer look at cross-validation for assessing the accuracy of gene regulatory networks and models , 2017, bioRxiv.

[32]  Miguel Rocha,et al.  Machine Learning-Enhanced T Cell Neoepitope Discovery for Immunotherapy Design , 2019, Cancer informatics.

[33]  Jiang Bian,et al.  Enhancing Prediction Models for One-Year Mortality in Patients with Acute Myocardial Infarction and Post Myocardial Infarction Syndrome , 2019, MedInfo.

[34]  Uli K. Chettipally,et al.  Prediction of Sepsis in the Intensive Care Unit With Minimal Electronic Health Record Data: A Machine Learning Approach , 2016, JMIR medical informatics.

[35]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[36]  Yonghua Hu,et al.  Using machine learning methods to predict in-hospital mortality of sepsis patients in the ICU , 2020, BMC Medical Informatics and Decision Making.

[37]  Hong Yu,et al.  Learning Latent Space Representations to Predict Patient Outcomes: Model Development and Validation , 2019, Journal of medical Internet research.

[38]  Pablo Varona,et al.  Modeling Biological Neural Networks , 2012, Handbook of Natural Computing.

[39]  Leo Anthony Celi,et al.  A Database-driven Decision Support System: Customized Mortality Prediction , 2012, Journal of personalized medicine.

[40]  Qing Zeng-Treitler,et al.  Predicting sample size required for classification performance , 2012, BMC Medical Informatics and Decision Making.

[41]  Jiang Bian,et al.  Development of a personalized diagnostic model for kidney stone disease tailored to acute care by integrating large clinical, demographics and laboratory data: the diagnostic acute care algorithm - kidney stones (DACA-KS) , 2018, BMC Medical Informatics and Decision Making.

[42]  Mohammad Hassan Moradi,et al.  Mortality prediction in intensive care units (ICUs) using a deep rule-based fuzzy classifier , 2018, J. Biomed. Informatics.

[43]  Joseph L Greenstein,et al.  Data-driven discovery of a novel sepsis pre-shock state predicts impending septic shock in the ICU , 2019, Scientific Reports.

[44]  Sunghwan Sohn,et al.  Deep learning and alternative learning strategies for retrospective real-world clinical data , 2019, npj Digital Medicine.

[45]  Elizabeth S. Chen,et al.  Using Demographic Factors and Comorbidities to Develop a Predictive Model for ICU Mortality in Patients with Acute Exacerbation COPD , 2018, AMIA.

[46]  Hagen Malberg,et al.  Predicting sepsis with a recurrent neural network using the MIMIC III database , 2019, Comput. Biol. Medicine.

[47]  Hongya Wang,et al.  Toward Optimal Heparin Dosing by Comparing Multiple Machine Learning Methods: Retrospective Study , 2019, JMIR medical informatics.

[48]  T. Davenport,et al.  The potential for artificial intelligence in healthcare , 2019, Future Healthcare Journal.

[49]  Mohammad M. Ghassemi,et al.  The effects of deep network topology on mortality prediction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[50]  R. Campbell,et al.  Analysis and prediction of unplanned intensive care unit readmission using recurrent neural networks with long short-term memory , 2018, bioRxiv.

[51]  Yuan Luo,et al.  Big Data and Data Science in Critical Care. , 2018, Chest.

[52]  K. Ho,et al.  Machine learning for the prediction of volume responsiveness in patients with oliguric acute kidney injury in critical care , 2019, Critical Care.

[53]  Albion Dervishi,et al.  Fuzzy risk stratification and risk assessment model for clinical monitoring in the ICU , 2017, Comput. Biol. Medicine.

[54]  Eric Horvitz,et al.  Predicting severe clinical events by learning about life-saving actions and outcomes using distant supervision , 2020, J. Biomed. Informatics.

[55]  Syed Ahmad Chan Bukhari,et al.  A statistically rigorous deep neural network approach to predict mortality in trauma patients admitted to the intensive care unit , 2020, The journal of trauma and acute care surgery.

[56]  Ari Ercole,et al.  Prediction of early unplanned intensive care unit readmission in a UK tertiary care hospital: a cross-sectional machine learning approach , 2017, BMJ Open.

[57]  Thomas Hofmann,et al.  Machine learning for real-time prediction of complications in critical care: a retrospective study. , 2018, The Lancet. Respiratory medicine.

[58]  A Machine Learning-Based Prediction of Hospital Mortality in Patients With Postoperative Sepsis , 2020, Frontiers in Medicine.

[59]  Hye Jin Kam,et al.  Learning representations for the early detection of sepsis with deep neural networks , 2017, Comput. Biol. Medicine.

[60]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[61]  Michael D. Howell,et al.  Predicting Intensive Care Unit Readmission with Machine Learning Using Electronic Health Record Data , 2018, Annals of the American Thoracic Society.

[62]  C. Yin,et al.  Combining structured and unstructured data for predictive models: a deep learning approach , 2020, BMC Medical Informatics and Decision Making.

[63]  Jiayu Zhou,et al.  Predictive modeling in urgent care: a comparative study of machine learning approaches , 2018, JAMIA open.

[64]  Chih-Wei Yang,et al.  Comparison of RIFLE, AKIN, and KDIGO classifications for assessing prognosis of patients on extracorporeal membrane oxygenation. , 2017, Journal of the Formosan Medical Association = Taiwan yi zhi.

[65]  Mohamed Bader-El-Den,et al.  Early hospital mortality prediction of intensive care unit patients using an ensemble learning approach , 2017, Int. J. Medical Informatics.

[66]  Magnus Bång,et al.  LiSep LSTM: A Machine Learning Algorithm for Early Detection of Septic Shock , 2019, Scientific Reports.

[67]  Mohammad Ali Moni,et al.  Comparing different supervised machine learning algorithms for disease prediction , 2019, BMC Medical Informatics and Decision Making.

[68]  Shuping Xiong,et al.  A Unified Deep-Learning Model for Classifying the Cross-Country Skiing Techniques Using Wearable Gyroscope Sensors , 2018, Sensors.

[69]  Colleen M. Ennett,et al.  Prediction of extubation failure for neonates with respiratory distress syndrome using the MIMIC-II clinical database , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[70]  Mikhail Belkin,et al.  Reconciling modern machine-learning practice and the classical bias–variance trade-off , 2018, Proceedings of the National Academy of Sciences.

[71]  Jun S. Kim,et al.  An attention based deep learning model of clinical events in the intensive care unit , 2019, PloS one.

[72]  Guilherme Del Fiol,et al.  Temporal Pattern Detection to Predict Adverse Events in Critical Care: Case Study With Acute Kidney Injury , 2020, JMIR medical informatics.

[73]  Zeeshan Ahmed,et al.  Artificial intelligence with multi-functional machine learning platform development for better healthcare and precision medicine , 2020, Database J. Biol. Databases Curation.

[74]  R. Gillum,et al.  Disparities in Sepsis Mortality by Region, Urbanization, and Race in the USA: a Multiple Cause of Death Analysis , 2019, Journal of Racial and Ethnic Health Disparities.

[75]  I. Gilchrist,et al.  Towards a decision support tool for intensive care discharge: machine learning algorithm development using electronic healthcare data from MIMIC-III and Bristol, UK , 2019, BMJ Open.

[76]  Peter Szolovits,et al.  Artificial intelligence, machine learning and health systems , 2018, Journal of global health.

[77]  S. Jung,et al.  A Predictive Model Based on Machine Learning for the Early Detection of Late-Onset Neonatal Sepsis: Development and Observational Study , 2020, JMIR medical informatics.

[78]  Ben J. Marafino,et al.  Efficient and sparse feature selection for biomedical text classification via the elastic net: Application to ICU risk stratification from nursing notes , 2015, J. Biomed. Informatics.

[79]  Haipeng Shen,et al.  Artificial intelligence in healthcare: past, present and future , 2017, Stroke and Vascular Neurology.

[80]  Su Pan,et al.  A Long Short-Term Memory Ensemble Approach for Improving the Outcome Prediction in Intensive Care Unit , 2019, Comput. Math. Methods Medicine.

[81]  Jiang Bian,et al.  Building Computational Models to Predict One-Year Mortality in ICU Patients with Acute Myocardial Infarction and Post Myocardial Infarction Syndrome , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[82]  Corey Chivers,et al.  A Machine Learning Algorithm to Predict Severe Sepsis and Septic Shock: Development, Implementation, and Impact on Clinical Practice. , 2019, Critical care medicine.

[83]  Yuan Luo,et al.  Early prediction of acute kidney injury following ICU admission using a multivariate panel of physiological measurements , 2019, BMC Medical Informatics and Decision Making.

[84]  G. Escobar,et al.  Hospital deaths in patients with sepsis from 2 independent cohorts. , 2014, JAMA.

[85]  J. Bakker,et al.  Biomarkers for the prediction of acute kidney injury: a narrative review on current status and future challenges , 2012, Clinical kidney journal.

[86]  Eleonore Bayen,et al.  Unsupervised Machine Learning to Identify High Likelihood of Dementia in Population-Based Surveys: Development and Validation Study , 2018, Journal of medical Internet research.

[87]  Timothy R. Smith,et al.  Natural and Artificial Intelligence in Neurosurgery: A Systematic Review , 2018, Neurosurgery.