Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms

Purpose We aimed to develop a machine-learning (ML) algorithm that can predict intensive care unit (ICU)-acquired bloodstream infections (BSI) among patients suspected of infection in the ICU. Methods The study was based on patients’ electronic health records at Beth Israel Deaconess Medical Center (BIDMC) in Boston, Massachusetts, USA, and at Rambam Health Care Campus (RHCC), Haifa, Israel. We included adults from whom blood cultures were collected for suspected BSI at least 48 h after admission. Clinical data, including time-series variables and their interactions, were analyzed by an ML algorithm at each site. Prediction ability for ICU-acquired BSI was assessed by the area under the receiver operating characteristics (AUROC) of ten-fold cross-validation and validation sets with 95% confidence intervals. Results The datasets comprised 2351 patients from BIDMC (151 with BSI) and 1021 from RHCC (162 with BSI). The median (inter-quartile range) age was 62 (51–75) and 56 (38–69) years, respectively; the median Acute Physiology and Chronic Health Evaluation II scores were 26 (21–32) and 24 (20–29), respectively. The means of the cross-validation AUROCs were 0.87 ± 0.02 for BIDMC and 0.93 ± 0.03 for RHCC. AUROCs of 0.89 ± 0.01 and 0.92 ± 0.02 were maintained in both centers with internal validation, while external validation deteriorated. Valuable predictors were mainly the trends of time-series variables such as laboratory results and vital signs. Conclusion An ML approach that uses temporal and site-specific data achieved high performance in recognizing BC samples with a high probability for ICU-acquired BSI.

[1]  D. Bates,et al.  Predicting bacteraemia in validated models--a systematic review. , 2015, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[2]  C. Sprung,et al.  Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock 2012 , 2013, Critical care medicine.

[3]  L. Leibovici,et al.  Benchmarking inappropriate empirical antibiotic treatment. , 2013, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[4]  L. Barth Reller,et al.  Detection of Bloodstream Infections in Adults: How Many Blood Cultures Are Needed? , 2006, Journal of Clinical Microbiology.

[5]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[6]  M. Booth,et al.  Mortality in intensive care: The impact of bacteremia and the utility of systemic inflammatory response syndrome. , 2016, American journal of infection control.

[7]  I. Kohane,et al.  Big Data and Machine Learning in Health Care. , 2018, JAMA.

[8]  M. Antonelli,et al.  Characteristics and determinants of outcome of hospital-acquired bloodstream infections in intensive care units: the EUROBACT International Cohort Study , 2012, Intensive Care Medicine.

[9]  Aseem Kumar,et al.  Procalcitonin-guided interventions against infections to increase early appropriate antibiotics and improve survival in the intensive care unit: A randomized trial , 2012 .

[10]  Mitchell M. Levy,et al.  The Surviving Sepsis Campaign Bundle: 2018 update , 2018, Intensive Care Medicine.

[11]  Jeffrey Dean,et al.  Machine Learning in Medicine , 2019, The New England journal of medicine.

[12]  I. Raad,et al.  Correlation between early clinical response after catheter removal and diagnosis of catheter-related bloodstream infection. , 2007, Diagnostic microbiology and infectious disease.

[13]  M. Levy,et al.  The Surviving Sepsis Campaign Bundle: 2018 Update. , 2018, Critical care medicine.

[14]  C. Yansouni,et al.  Blood Culture Results Before and After Antimicrobial Administration in Patients With Severe Manifestations of Sepsis , 2019, Annals of Internal Medicine.

[15]  Maya Petersen,et al.  Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates. , 2015, Electronic journal of statistics.

[16]  Matthieu Komorowski,et al.  Artificial intelligence in intensive care: are we there yet? , 2019, Intensive Care Medicine.

[17]  Steen Andreassen,et al.  Prediction of bacteremia using TREAT, a computerized decision-support system. , 2006, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[18]  S. Bailly,et al.  What’s new in ICU in 2050: big data and machine learning , 2018, Intensive Care Medicine.

[19]  D. Cook,et al.  The Effect of Inadequate Initial Empiric Antimicrobial Treatment on Mortality in Critically Ill Patients with Bloodstream Infections: A Multi-Centre Retrospective Cohort Study , 2016, PloS one.

[20]  Luís B. Almeida,et al.  The fractional Fourier transform and time-frequency representations , 1994, IEEE Trans. Signal Process..

[21]  M. Terblanche,et al.  Neural networks and deep learning: a brief introduction , 2019, Intensive Care Medicine.

[22]  B. Souweine,et al.  Attributable mortality of ICU-acquired bloodstream infections: Impact of the source, causative micro-organism, resistance profile and antimicrobial therapy. , 2017, The Journal of infection.

[23]  LarrañagaPedro,et al.  A review of feature selection techniques in bioinformatics , 2007 .

[24]  Mark A. Miller,et al.  Adequacy of early empiric antibiotic treatment and survival in severe sepsis: experience from the MONARCS trial. , 2004, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[25]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[26]  R. Wenzel,et al.  Nosocomial bloodstream infections in US hospitals: analysis of 24,179 cases from a prospective nationwide surveillance study. , 2004, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[27]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[28]  P. L. Petersen,et al.  Procalcitonin-guided interventions against infections to increase early appropriate antibiotics and improve survival in the intensive care unit: A randomized trial* , 2011, Critical care medicine.

[29]  C. Sprung,et al.  Sepsis in European intensive care units: Results of the SOAP study* , 2006, Critical care medicine.

[30]  L. Leibovici,et al.  Efficacy and safety of aminoglycoside monotherapy: systematic review and meta-analysis of randomized controlled trials. , 2007, The Journal of antimicrobial chemotherapy.

[31]  Jordi Rello,et al.  International study of the prevalence and outcomes of infection in intensive care units. , 2009, JAMA.

[32]  Xavier Hoenner,et al.  Continental-scale animal tracking reveals functional movement classes across marine taxa , 2018, Scientific Reports.

[33]  G. Heinze,et al.  Machine learning for fast identification of bacteraemia in SIRS patients treated on standard care wards: a cohort study , 2018, Scientific Reports.

[34]  Tom Dormans,et al.  Efficacy and safety of procalcitonin guidance in reducing the duration of antibiotic treatment in critically ill patients: a randomised, controlled, open-label trial. , 2016, The Lancet. Infectious diseases.

[35]  W. Harmsen,et al.  Optimal testing parameters for blood cultures. , 2004, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[36]  Sangeeta Mehta,et al.  Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock: 2016 , 2017, Intensive Care Medicine.

[37]  Jay Steingrub,et al.  International study of the prevalence and outcomes of infection in intensive care units , 2009 .

[38]  G Sherman,et al.  The influence of inadequate antimicrobial treatment of bloodstream infections on patient outcomes in the ICU setting. , 2000, Chest.

[39]  J. Bartlett Nosocomial bloodstream infections in US hospitals: Analysis of 24,179 cases from a prospective nationwide surveillance study , 2004 .

[40]  L. Leibovici,et al.  Trimethoprim-sulfamethoxazole versus vancomycin for severe infections caused by meticillin resistant Staphylococcus aureus: randomised controlled trial , 2015, BMJ : British Medical Journal.

[41]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.