Development and validation of a continuous measure of patient condition using the Electronic Medical Record

Patient condition is a key element in communication between clinicians. However, there is no generally accepted definition of patient condition that is independent of diagnosis and that spans acuity levels. We report the development and validation of a continuous measure of general patient condition that is independent of diagnosis, and that can be used for medical-surgical as well as critical care patients. A survey of Electronic Medical Record data identified common, frequently collected non-static candidate variables as the basis for a general, continuously updated patient condition score. We used a new methodology to estimate in-hospital risk associated with each of these variables. A risk function for each candidate input was computed by comparing the final pre-discharge measurements with 1-year post-discharge mortality. Step-wise logistic regression of the variables against 1-year mortality was used to determine the importance of each variable. The final set of selected variables consisted of 26 clinical measurements from four categories: nursing assessments, vital signs, laboratory results and cardiac rhythms. We then constructed a heuristic model quantifying patient condition (overall risk) by summing the single-variable risks. The model's validity was assessed against outcomes from 170,000 medical-surgical and critical care patients, using data from three US hospitals. Outcome validation across hospitals yields an area under the receiver operating characteristic curve(AUC) of ≥0.92 when separating hospice/deceased from all other discharge categories, an AUC of ≥0.93 when predicting 24-h mortality and an AUC of 0.62 when predicting 30-day readmissions. Correspondence with outcomes reflective of patient condition across the acuity spectrum indicates utility in both medical-surgical units and critical care units. The model output, which we call the Rothman Index, may provide clinicians with a longitudinal view of patient condition to help address known challenges in caregiver communication, continuity of care, and earlier detection of acuity trends.

[1]  Michael J Rothman,et al.  Clinical implications and validity of nursing assessments: a longitudinal measure of patient condition from analysis of the Electronic Medical Record , 2012, BMJ Open.

[2]  K. Hillman,et al.  Findings of the First Consensus Conference on Medical Emergency Teams* , 2006, Critical care medicine.

[3]  M. Finkelstein,et al.  Sensitivity of the Pediatric Early Warning Score to Identify Patient Deterioration , 2010, Pediatrics.

[4]  Patricia Kipnis,et al.  Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record. , 2012, Journal of hospital medicine.

[5]  Allen L Hsiao,et al.  Automated analysis of electronic medical record data reflects the pathophysiology of operative complications. , 2013, Surgery.

[6]  Anders Odén,et al.  A simple score to assess mortality risk in patients waiting for coronary artery bypass grafting. , 2006, The Annals of thoracic surgery.

[7]  Catherine Anne Kelly,et al.  Comparison of consciousness level assessment in the poisoned patient using the alert/verbal/painful/unresponsive scale and the Glasgow Coma Scale. , 2004, Annals of emergency medicine.

[8]  Alon Stamler,et al.  Validation of the 2000 Bernstein-Parsonnet score versus the EuroSCORE as a prognostic tool in cardiac surgery. , 2006, The Annals of thoracic surgery.

[9]  M. Mclellan,et al.  The Cardiac Children's Hospital Early Warning Score (C-CHEWS). , 2013, Journal of pediatric nursing.

[10]  D. Tait,et al.  Nursing recognition and response to signs of clinical deterioration. , 2010, Nursing management.

[11]  K. Hillman,et al.  The objective medical emergency team activation criteria: a case-control study. , 2007, Resuscitation.

[12]  Kathy D. Duncan,et al.  Early warning systems: The next level of rapid response , 2012, Nursing.

[13]  K. Hillman,et al.  Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial , 2005, The Lancet.

[14]  U. Ruttimann,et al.  PRISM III: an updated Pediatric Risk of Mortality score. , 1996, Critical care medicine.

[15]  Gary B. Smith,et al.  ViEWS--Towards a national early warning score for detecting adult inpatient deterioration. , 2010, Resuscitation.

[16]  D. Fraser,et al.  The PEWS score: potential calling criteria for critical care response teams in children's hospitals. , 2006, Journal of critical care.

[17]  Heather Duncan,et al.  The Pediatric Early Warning System score: a severity of illness score to predict urgent medical need in hospitalized children. , 2006, Journal of critical care.

[18]  R. Lowry,et al.  Concepts and Applications of Inferential Statistics , 2014 .

[19]  C. Subbe,et al.  Effect of introducing the Modified Early Warning score on clinical outcomes, cardio‐pulmonary arrests and intensive care utilisation in acute medical admissions * , 2003, Anaesthesia.

[20]  K. Hillman,et al.  Antecedents to hospital deaths , 2001, Internal medicine journal.

[21]  J Concato,et al.  Importance of functional measures in predicting mortality among older hospitalized patients. , 1998, JAMA.

[22]  R. Fortinsky,et al.  Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization. , 2000, JAMA.

[23]  L. Ohno-Machado Journal of Biomedical Informatics , 2001 .

[24]  Yixin Chen,et al.  Early Deterioration Warning for Hospitalized Patients by Mining Clinical Data , 2011, Int. J. Knowl. Discov. Bioinform..

[25]  Brian H Cuthbertson,et al.  Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient?* , 2007, Critical care medicine.

[26]  G. Moore,et al.  Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study , 2002, BMJ : British Medical Journal.

[27]  P. Austin,et al.  Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community , 2010, Canadian Medical Association Journal.

[28]  K. Hillman,et al.  A comparison of Antecedents to Cardiac Arrests, Deaths and EMergency Intensive care Admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA study , 2004 .

[29]  C. Subbe,et al.  Validation of a modified Early Warning Score in medical admissions. , 2001, QJM : monthly journal of the Association of Physicians.

[30]  David J. Stone,et al.  Effect of a multiple-site intensive care unit telemedicine program on clinical and economic outcomes: An alternative paradigm for intensivist staffing* , 2004, Critical care medicine.

[31]  Kerr Sd A comparison of four nursing documentation systems. , 1992 .

[32]  Elizabeth H. Bradley,et al.  Identifying Patients at Increased Risk for Unplanned Readmission , 2013, Medical care.

[33]  U. Kyriacos,et al.  Monitoring vital signs using early warning scoring systems: a review of the literature. , 2011, Journal of nursing management.

[34]  D. Harrison,et al.  Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward , 2007, Intensive Care Medicine.

[35]  S D Kerr A comparison of four nursing documentation systems. , 1992, Journal of nursing staff development : JNSD.

[36]  Tosha B. Wetterneck,et al.  Hospital Readmission in General Medicine Patients: A Prediction Model , 2009, Journal of General Internal Medicine.

[37]  J. Rethans,et al.  A review of educational strategies to improve nurses' roles in recognizing and responding to deteriorating patients. , 2011, International nursing review.

[38]  G. Guyatt,et al.  Clinical Prediction Rules , 2004 .

[39]  Abel N. Kho,et al.  Utility of commonly captured data from an EHR to identify hospitalized patients at risk for clinical deterioration , 2007, AMIA.

[40]  Paul E. Schmidt,et al.  Review and performance evaluation of aggregate weighted 'track and trigger' systems. , 2008, Resuscitation.

[41]  L. Forni,et al.  Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. , 2007, British journal of anaesthesia.

[42]  Harlan M Krumholz,et al.  Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia. , 2011, Journal of hospital medicine.

[43]  J. Vincent,et al.  The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure , 1996, Intensive Care Medicine.

[44]  B. Cuthbertson,et al.  A warning on early-warning scores! , 2007, British journal of anaesthesia.

[45]  Edwin D Boudreaux,et al.  Emergency department patient satisfaction: examining the role of acuity. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[46]  Douglas G Altman,et al.  Statistics Notes: Validating scales and indexes. , 2002, BMJ.

[47]  H. Sox,et al.  Clinical prediction rules. Applications and methodological standards. , 1985, The New England journal of medicine.

[48]  Heather Baid The process of conducting a physical assessment: a nursing perspective. , 2006, British journal of nursing.

[49]  W. Grobman,et al.  Methods of clinical prediction. , 2006, American journal of obstetrics and gynecology.

[50]  C. Parshuram,et al.  Development and initial validation of the Bedside Paediatric Early Warning System score , 2009, Critical care.

[51]  D. Bates,et al.  Improving safety with information technology. , 2003, The New England journal of medicine.

[52]  Jane Marie Cioffi,et al.  Nurses' experiences of making decisions to call emergency assistance to their patients. , 2000, Journal of advanced nursing.

[53]  Yvonne Higgins,et al.  Promoting patient safety using an early warning scoring system. , 2008, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[54]  T Treasure,et al.  EuroSCORE: a systematic review of international performance. , 2004, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[55]  J. Benson,et al.  A Clinical Deterioration Prediction Tool for Internal Medicine Patients , 2013, American journal of medical quality : the official journal of the American College of Medical Quality.

[56]  Ann Scott Blouin,et al.  Improving Hand-Off Communications: New Solutions for Nurses , 2011, Journal of nursing care quality.

[57]  D. Goldhill,et al.  Physiological abnormalities in early warning scores are related to mortality in adult inpatients. , 2004, British journal of anaesthesia.

[58]  L. Egevad,et al.  Prognostic value of the Gleason score in prostate cancer , 2002, BJU international.

[59]  D. Richardson,et al.  Score for Neonatal Acute Physiology: a physiologic severity index for neonatal intensive care. , 1993, Pediatrics.

[60]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[61]  D. Mark,et al.  Clinical prediction models: are we building better mousetraps? , 2003, Journal of the American College of Cardiology.

[62]  Peter J Pronovost,et al.  Rapid response teams--walk, don't run. , 2006, JAMA.

[63]  M. Odell,et al.  Nurses' role in detecting deterioration in ward patients: systematic literature review. , 2009, Journal of advanced nursing.

[64]  George Hripcsak,et al.  Exploiting time in electronic health record correlations , 2011, J. Am. Medical Informatics Assoc..