Real-Time Automated Sampling of Electronic Medical Records Predicts Hospital Mortality.

BACKGROUND Real-time automated continuous sampling of electronic medical record data may expeditiously identify patients at risk for death and enable prompt life-saving interventions. We hypothesized that a real-time electronic medical record-based alert could identify hospitalized patients at risk for mortality. METHODS An automated alert was developed and implemented to continuously sample electronic medical record data and trigger when at least 2 of 4 systemic inflammatory response syndrome criteria plus at least one of 14 acute organ dysfunction parameters was detected. The systemic inflammatory response syndrome and organ dysfunction alert was applied in real time to 312,214 patients in 24 hospitals and analyzed in 2 phases: training and validation datasets. RESULTS In the training phase, 29,317 (18.8%) triggered the alert and 5.2% of such patients died, whereas only 0.2% without the alert died (unadjusted odds ratio 30.1; 95% confidence interval, 26.1-34.5; P < .0001). In the validation phase, the sensitivity, specificity, area under the curve, and positive and negative likelihood ratios for predicting mortality were 0.86, 0.82, 0.84, 4.9, and 0.16, respectively. Multivariate Cox-proportional hazard regression model revealed greater hospital mortality when the alert was triggered (adjusted hazards ratio 4.0; 95% confidence interval, 3.3-4.9; P < .0001). Triggering the alert was associated with additional hospitalization days (+3.0 days) and ventilator days (+1.6 days; P < .0001). CONCLUSION An automated alert system that continuously samples electronic medical record data can be implemented, has excellent test characteristics, and can assist in the real-time identification of hospitalized patients at risk for death.

[1]  J. Zimmerman,et al.  Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited* , 2007, Critical care medicine.

[2]  A. Vickers,et al.  Prognostic and Prediction Tools in Bladder Cancer: A Comprehensive Review of the Literature. , 2015, European urology.

[3]  E. Scruth,et al.  Risk Determination After an Acute Myocardial Infarction: Review of 3 Clinical Risk Prediction Tools , 2012, Clinical nurse specialist CNS.

[4]  Hoangmai H Pham,et al.  Association of Pioneer Accountable Care Organizations vs traditional Medicare fee for service with spending, utilization, and patient experience. , 2015, JAMA.

[5]  C. Sprung,et al.  Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock 2012 , 2013, Critical care medicine.

[6]  Leslie L. Davis,et al.  Prevention of Unplanned Intensive Care Unit Admissions and Hospital Mortality by Early Warning Systems , 2013, Dimensions of critical care nursing : DCCN.

[7]  Jose H. Salazar,et al.  Use of risk stratification indices to predict mortality in critically ill children , 2013, European Journal of Pediatrics.

[8]  Benjamin French,et al.  Development, implementation, and impact of an automated early warning and response system for sepsis. , 2015, Journal of hospital medicine.

[9]  P. Pronovost,et al.  A targeted real-time early warning score (TREWScore) for septic shock , 2015, Science Translational Medicine.

[10]  Peter K Lindenauer,et al.  Development and validation of a model that uses enhanced administrative data to predict mortality in patients with sepsis , 2011, Critical care medicine.

[11]  Javier Llorca,et al.  Impact of the Surviving Sepsis Campaign protocols on hospital length of stay and mortality in septic shock patients: Results of a three-year follow-up quasi-experimental study* , 2010, Critical care medicine.

[12]  Michael J. Rothman,et al.  Development and validation of a continuous measure of patient condition using the Electronic Medical Record , 2013, J. Biomed. Informatics.

[13]  G. Riet,et al.  Risk Prediction Models for Postoperative Delirium: A Systematic Review and Meta‐Analysis , 2014 .

[14]  K. Rowan,et al.  Risk Stratification Tools for Predicting Morbidity and Mortality in Adult Patients Undergoing Major Surgery: Qualitative Systematic Review , 2013, Anesthesiology.

[15]  Michael Bailey,et al.  Systemic inflammatory response syndrome criteria in defining severe sepsis. , 2015, The New England journal of medicine.

[16]  Patricia Kipnis,et al.  Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record. , 2012, Journal of hospital medicine.

[17]  A. Rapsang,et al.  Scoring systems in the intensive care unit: A compendium , 2014, Indian journal of critical care medicine : peer-reviewed, official publication of Indian Society of Critical Care Medicine.

[18]  N. Ayas,et al.  Reliability of intensive care unit admitting and comorbid diagnoses, race, elements of Acute Physiology and Chronic Health Evaluation II score, and predicted probability of mortality in an electronic intensive care unit database. , 2009, Journal of critical care.

[19]  Robert Gibbons,et al.  Using Electronic Health Record Data to Develop and Validate a Prediction Model for Adverse Outcomes in the Wards* , 2012, Critical care medicine.

[20]  J. Vincent,et al.  Clinical review: Scoring systems in the critically ill , 2010, Critical care.

[21]  Stephen D. Persell,et al.  Prompting physicians to address a daily checklist and process of care and clinical outcomes: a single-site study. , 2011, American journal of respiratory and critical care medicine.

[22]  Customized probability models for severe sepsis: correction and clarification. , 1995, JAMA.

[23]  S Lemeshow,et al.  Customized probability models for early severe sepsis in adult intensive care patients. Intensive Care Unit Scoring Group. , 1995, JAMA.

[24]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[25]  T. Higgins Severe sepsis outcomes: how are we doing?*. , 2014, Critical care medicine.

[26]  David W Bates,et al.  Continuous monitoring in an inpatient medical-surgical unit: a controlled clinical trial. , 2014, The American journal of medicine.

[27]  Theodore J Iwashyna,et al.  Identifying Patients With Severe Sepsis Using Administrative Claims: Patient-Level Validation of the Angus Implementation of the International Consensus Conference Definition of Severe Sepsis , 2014, Medical care.