Development and validation of an automated delirium risk assessment system (Auto-DelRAS) implemented in the electronic health record system.

BACKGROUND A key component of the delirium management is prevention and early detection. OBJECTIVE To develop an automated delirium risk assessment system (Auto-DelRAS) that automatically alerts health care providers of an intensive care unit (ICU) patient's delirium risk based only on data collected in an electronic health record (EHR) system, and to evaluate the clinical validity of this system. DESIGN Cohort and system development designs were used. SETTING Medical and surgical ICUs in two university hospitals in Seoul, Korea. PARTICIPANTS A total of 3284 patients for the development of Auto-DelRAS, 325 for external validation, 694 for validation after clinical applications. METHODS The 4211 data items were extracted from the EHR system and delirium was measured using CAM-ICU (Confusion Assessment Method for Intensive Care Unit). The potential predictors were selected and a logistic regression model was established to create a delirium risk scoring algorithm to construct the Auto-DelRAS. The Auto-DelRAS was evaluated at three months and one year after its application to clinical practice to establish the predictive validity of the system. RESULTS Eleven predictors were finally included in the logistic regression model. The results of the Auto-DelRAS risk assessment were shown as high/moderate/low risk on a Kardex screen. The predictive validity, analyzed after the clinical application of Auto-DelRAS after one year, showed a sensitivity of 0.88, specificity of 0.72, positive predictive value of 0.53, negative predictive value of 0.94, and a Youden index of 0.59. CONCLUSIONS A relatively high level of predictive validity was maintained with the Auto-DelRAS system, even one year after it was applied to clinical practice.

[1]  Eun-Jung Kim,et al.  The Experience of Delirium Care and Clinical Feasibility of the CAM-ICU in a Korean ICU , 2013, Clinical nursing research.

[2]  Naeem Siddiqi,et al.  Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring , 2005 .

[3]  A. Hamdan-Mansour,et al.  Knowledge and nursing practice of critical care nurses caring for patients with delirium in intensive care units in Jordan. , 2010, Journal of continuing education in nursing.

[4]  Stanislav V Kasl,et al.  Days of delirium are associated with 1-year mortality in an older intensive care unit population. , 2009, American journal of respiratory and critical care medicine.

[5]  P. Jorens,et al.  Recalibration of the delirium prediction model for ICU patients (PRE-DELIRIC): a multinational observational study , 2014, Intensive Care Medicine.

[6]  A. Slooter,et al.  Comparison of delirium assessment tools in a mixed intensive care unit* , 2009, Critical care medicine.

[7]  Theodore Speroff,et al.  Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit. , 2004, JAMA.

[8]  S. Hirst,et al.  Factors that contribute to underrecognition of delirium by registered nurses in acute care settings: a scoping review of the literature to explain this phenomenon. , 2015, Journal of clinical nursing.

[9]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[10]  Acute confusion/delirium. , 2009 .

[11]  S K Inouye,et al.  A Predictive Model for Delirium in Hospitalized Elderly Medical Patients Based on Admission Characteristics , 1993, Annals of Internal Medicine.

[12]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[13]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[14]  M. Shaughnessy,et al.  Delirium is a serious and under-recognized problem: why assessment of mental status should be the sixth vital sign. , 2007, Journal of the American Medical Directors Association.

[15]  Giel Nijpels,et al.  Effects of multidisciplinary integrated care on quality of care in residential care facilities for elderly people: a cluster randomized trial , 2011, Canadian Medical Association Journal.

[16]  R. Boot.  Delirium: a review of the nurses role in the intensive care unit. , 2012, Intensive & critical care nursing.

[17]  D. Gifford,et al.  Detection of Delirium in the Intensive Care Unit: Comparison of Confusion Assessment Method for the Intensive Care Unit with Confusion Assessment Method Ratings , 2005, Journal of the American Geriatrics Society.

[18]  E. Mukaetova-Ladinska,et al.  A Clinical Update on Delirium: From Early Recognition to Effective Management , 2011, Nursing research and practice.

[19]  T. van Achterberg,et al.  Delirium in critically ill patients: Impact on long-term health-related quality of life and cognitive functioning* , 2012, Critical care medicine.

[20]  C. Spies,et al.  Managing ICU delirium , 2011, Current opinion in critical care.

[21]  Lucila Ohno-Machado,et al.  Comparison of multiple prediction models for ambulation following spinal cord injury , 1998, AMIA.

[22]  G. Bernard,et al.  Delirium as a predictor of long-term cognitive impairment in survivors of critical illness , 2010, Critical care medicine.

[23]  T. Murphy,et al.  Characteristics associated with delirium in older patients in a medical intensive care unit. , 2007, Archives of internal medicine.

[24]  A. Casey,et al.  Effective communication: Principle of Nursing Practice E. , 2011, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[25]  A. Slooter,et al.  A Systematic Review of Risk Factors for Delirium in the ICU , 2016 .

[26]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[27]  J. Hofhuis,et al.  UvA-DARE ( Digital Academic Repository ) Occurrence of delirium is severely underestimated in the ICU during daily care , 2009 .

[28]  K. Wernecke,et al.  Different assessment tools for intensive care unit delirium: Which score to use?* , 2010, Critical care medicine.

[29]  M. Kuiper,et al.  Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study , 2012, BMJ : British Medical Journal.

[30]  J. Devlin,et al.  Antipsychotics for the Prevention and Treatment of Delirium in the Intensive Care Unit: What Is Their Role? , 2011, Harvard review of psychiatry.

[31]  M. Greiner,et al.  Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. , 2000, Preventive veterinary medicine.

[32]  E. Kimchi,et al.  Delirium in elderly people – Authors'reply , 2014, The Lancet.

[33]  G. Bernard,et al.  Costs associated with delirium in mechanically ventilated patients* , 2004, Critical care medicine.

[34]  L. Kappelle,et al.  An early prediction of delirium in the acute phase after stroke , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[35]  G. Bernard,et al.  Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). , 2001, JAMA.

[36]  Inda,et al.  A multicomponent intervention to prevent delirium in hospitalized older patients. , 1999, The New England journal of medicine.

[37]  J. Devlin,et al.  Assessment of delirium in the intensive care unit: nursing practices and perceptions. , 2008, American journal of critical care : an official publication, American Association of Critical-Care Nurses.

[38]  E. McLafferty,et al.  Nurses' perceptions of indwelling urinary catheters in older people. , 2007, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[39]  S. Levy,et al.  Information systems that support effective clinical decision making. , 2012, Nursing management.