Using hierarchical dynamic Bayesian networks to investigate dynamics of organ failure in patients in the Intensive Care Unit

In intensive care medicine close monitoring of organ failure status is important for the prognosis of patients and for choices regarding ICU management. Major challenges in analyzing the multitude of data pertaining to the functioning of the organ systems over time are to extract meaningful clinical patterns and to provide predictions for the future course of diseases. With their explicit states and probabilistic state transitions, Markov models seem to fit this purpose well. In complex domains such as intensive care a choice is often made between a simple model that is estimated from the data, or a more complex model in which the parameters are provided by domain experts. Our primary aim is to combine these approaches and develop a set of complex Markov models based on clinical data. In this paper we describe the design choices underlying the models, which enable them to identify temporal patterns, predict outcomes, and test clinical hypotheses. Our models are characterized by the choice of the dynamic hierarchical Bayesian network structure and the use of logistic regression equations in estimating the transition probabilities. We demonstrate the induction, inference, evaluation, and use of these models in practice in a case-study of patients with severe sepsis admitted to four Dutch ICUs.

[1]  J R Beck,et al.  Markov Models in Medical Decision Making , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  J. Holmes,et al.  Working notes of the workshop on Intelligent Data Analysis in Medicine and Pharmacology (IDAMAPO-2005) , 2005 .

[3]  Alberto Riva,et al.  Learning temporal probabilistic causal models from longitudinal data , 1996, Artif. Intell. Medicine.

[4]  E. Draper,et al.  Prognosis in Acute Organ‐System Failure , 1985, Annals of surgery.

[5]  Asha Seth Kapadia,et al.  Predicting duration of stay in a pediatric intensive care unit: A Markovian approach , 2000, Eur. J. Oper. Res..

[6]  Eric Horvitz,et al.  Dynamic Network Models for Forecasting , 1992, UAI.

[7]  Mehmet Kayaalp,et al.  Learning dynamic bayesian network structures from data , 2003 .

[8]  H. Keselman,et al.  Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables , 1992 .

[9]  Gilles Clermont,et al.  Dynamic microsimulation to model multiple outcomes in cohorts of critically ill patients , 2004, Intensive Care Medicine.

[10]  Uffe Kjærulff,et al.  dHugin: a computational system for dynamic time-sliced Bayesian networks , 1995 .

[11]  Steen Andreassen,et al.  Using probabilistic and decision-theoretic methods in treatment and prognosis modeling , 1999, Artif. Intell. Medicine.

[12]  Peter J. F. Lucas,et al.  A probabilistic and decision-theoretic approach to the management of infectious disease at the ICU , 2000, Artif. Intell. Medicine.

[13]  C. Sprung,et al.  Sepsis in European intensive care units: Results of the SOAP study* , 2006, Critical care medicine.

[14]  Peter J. F. Lucas,et al.  A dynamic Bayesian network for diagnosing ventilator-associated pneumonia in ICU patients , 2009, Expert Syst. Appl..

[15]  David J. Spiegelhalter,et al.  Bayesian Networks Applied to Therapy Monitoring , 1991, UAI.

[16]  S. Pauker,et al.  The Markov Process in Medical Prognosis , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  Peter J. F. Lucas,et al.  Using Temporal Context-Specific Independence Information in the Exploratory Analysis of Disease Processes , 2007, AIME.

[18]  R. Auckenthaler,et al.  Bedside prediction of mortality from bacteremic sepsis. A dynamic analysis of ICU patients. , 1996, American journal of respiratory and critical care medicine.

[19]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[20]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study , 1993 .

[21]  G. Clermont,et al.  Epidemiology of severe sepsis in the United States: Analysis of incidence, outcome, and associated costs of care , 2001, Critical care medicine.

[22]  Yuval Shahar Dimension of Time in Illness: An Objective View , 2000, Annals of Internal Medicine.

[23]  Corinne Alberti,et al.  The Logistic Organ Dysfunction system. A new way to assess organ dysfunction in the intensive care unit. ICU Scoring Group. , 1996, JAMA.

[24]  Gregory M. Provan,et al.  Dynamic Network Construction and Updating Techniques for the Diagnosis of Acute Abdominal Pain , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  A. Agresti Categorical data analysis , 1993 .

[26]  W. Knaus,et al.  Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. , 1992, Chest.

[27]  Herwig Gerlach,et al.  Between prediction, education, and quality control: simulation models in critical care , 2007, Critical care.

[28]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[29]  C. Sprung,et al.  Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on "sepsis-related problems" of the European Society of Intensive Care Medicine. , 1998, Critical care medicine.

[30]  Paul Dagum,et al.  Forecasting Sleep Apnea with Dynamic Network Models , 1993, UAI.

[31]  S Lemeshow,et al.  The Logistic Organ Dysfunction system. A new way to assess organ dysfunction in the intensive care unit. ICU Scoring Group. , 1996, JAMA.

[32]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[33]  Nicolette de Keizer,et al.  Model Formulation: Defining and Improving Data Quality in Medical Registries: A Literature Review, Case Study, and Generic Framework , 2002, J. Am. Medical Informatics Assoc..

[34]  Corinne Alberti,et al.  Influence of systemic inflammatory response syndrome and sepsis on outcome of critically ill infected patients. , 2003, American journal of respiratory and critical care medicine.

[35]  E. Hanisch,et al.  Markov cohort simulation study reveals evidence for sex-based risk difference in intensive care unit patients. , 2000, American journal of surgery.

[36]  C. Sprung,et al.  The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study , 1999, Intensive Care Medicine.

[37]  Michael Luby,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks is NP-Hard , 1993, Artif. Intell..

[38]  Peter Bauer,et al.  Sepsis mortality prediction based on predisposition, infection and response , 2008, Intensive Care Medicine.

[39]  Mitchell M. Levy,et al.  Surviving Sepsis Campaign guidelines for management of severe sepsis and septic shock , 2004, Critical care medicine.

[40]  Jean-Charles Preiser,et al.  Intensive care unit acquired infection and organ failure , 2008, Intensive Care Medicine.

[41]  R. Martin Chavez,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Nir Friedman,et al.  Learning Bayesian Networks with Local Structure , 1996, UAI.

[43]  Timothy W. Evans,et al.  Organ dysfunction during sepsis , 2006, Intensive Care Medicine.

[44]  J. Vincent,et al.  Serial evaluation of the SOFA score to predict outcome in critically ill patients. , 2001, JAMA.

[45]  E. Anderson Hudson et al. , 1977 .

[46]  D. Mannino,et al.  The epidemiology of sepsis in the United States from 1979 through 2000. , 2003, The New England journal of medicine.

[47]  P Wright,et al.  Changing pattern of organ dysfunction in early human sepsis is related to mortality , 2000, Critical care medicine.

[48]  Milton C. Weinstein,et al.  Cost-Effectiveness Analysis of Hypertension Guidelines in South Africa: Absolute Risk Versus Blood Pressure Level , 2005, Circulation.

[49]  Silvana Quaglini,et al.  Deciding when to intervene: a Markov decision process approach , 2000, Int. J. Medical Informatics.

[50]  S. Vosylius,et al.  Sequential organ failure assessment score as the determinant of outcome for patients with severe sepsis. , 2004, Croatian medical journal.

[51]  U. Janssens,et al.  The early bird catches the worm. , 2005, Critical care medicine.

[52]  J Ean,et al.  Efficacy and safety of recombinant human activated protein C for severe sepsis. , 2001, The New England journal of medicine.

[53]  James A Russell,et al.  Early changes in organ function predict eventual survival in severe sepsis* , 2005, Critical care medicine.

[54]  Gilles Clermont,et al.  Predicting with Variables Constructed from Temporal Sequences , 2001, AISTATS.

[55]  Dominik Aronsky,et al.  Crowding delays treatment and lengthens emergency department length of stay, even among high-acuity patients. , 2009, Annals of emergency medicine.

[56]  Tudor Toma,et al.  Discovery and inclusion of SOFA score episodes in mortality prediction , 2007, J. Biomed. Informatics.

[57]  Juan Eloy Ruiz-Castro,et al.  A Multivariate Model to Measure the Effect of Treatments in Survival to Breast Cancer , 1998 .

[58]  C Combescure,et al.  The analysis of asthma control under a Markov assumption with use of covariates , 2003, Statistics in medicine.

[59]  Wenyaw Chan,et al.  Predicting the length of stay of patients admitted for intensive care using a first step analysis , 2006, Health Services and Outcomes Research Methodology.

[60]  J.-L. Vincent,et al.  Evaluation of organ failure: we are making progress , 2000, Intensive Care Medicine.

[61]  E Ackerman Simulation of micropopulations in epidemiology: tutorial 1. Simulation: an introduction. A series of tutorials illustrated by coronary heart disease models. , 1994, International journal of bio-medical computing.

[62]  Stanley Lemeshow,et al.  The Logistic Organ Dysfunction System , 1997 .

[63]  Yuval Shahar,et al.  A Framework for Knowledge-Based Temporal Abstraction , 1997, Artif. Intell..

[64]  Mark S Roberts,et al.  Use of dynamic microsimulation to predict disease progression in patients with pneumonia-related sepsis , 2007, Critical care.