Prognostic Bayesian networks: I: Rationale, learning procedure, and clinical use

Prognostic models are tools to predict the future outcome of disease and disease treatment, one of the fundamental tasks in clinical medicine. This article presents the prognostic Bayesian network (PBN) as a new type of prognostic model that builds on the Bayesian network methodology, and implements a dynamic, process-oriented view on prognosis. A PBN describes the mutual relationships between variables that come into play during subsequent stages of a care process and a clinical outcome. A dedicated procedure for inducing these networks from clinical data is presented. In this procedure, the network is composed of a collection of local supervised learning models that are recursively learned from the data. The procedure optimizes performance of the network's primary task, outcome prediction, and handles the fact that patients may drop out of the process in earlier stages. Furthermore, the article describes how PBNs can be applied to solve a number of information problems that are related to medical prognosis.

[1]  Evert de Jonge,et al.  Prognostic Bayesian networks: II: An application in the domain of cardiac surgery , 2007, J. Biomed. Informatics.

[2]  Paul Dagum,et al.  Time series prediction using belief network models , 1995, Int. J. Hum. Comput. Stud..

[3]  Nir Friedman,et al.  Learning Belief Networks in the Presence of Missing Values and Hidden Variables , 1997, ICML.

[4]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[5]  Steen Andreassen,et al.  MUNIN - A Causal Probabilistic Network for Interpretation of Electromyographic Findings , 1987, IJCAI.

[6]  David Maxwell Chickering,et al.  A Bayesian Approach to Learning Bayesian Networks with Local Structure , 1997, UAI.

[7]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[8]  D. Heckerman,et al.  ,81. Introduction , 2022 .

[9]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[10]  W J Long,et al.  Development of a knowledge base for diagnostic reasoning in cardiology. , 1992, Computers and biomedical research, an international journal.

[11]  Mehmet Kayaalp,et al.  Learning dynamic bayesian network structures from data , 2003 .

[12]  Sunil J Rao,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2003 .

[13]  D. Nilsson,et al.  An efficient algorithm for finding the M most probable configurationsin probabilistic expert systems , 1998, Stat. Comput..

[14]  Nir Friedman,et al.  Learning Bayesian Networks with Local Structure , 1996, UAI.

[15]  David J. Spiegelhalter,et al.  Cytotoxic Chemotherapy Monitoring Using Stochastic Simulation on Graphical Models , 1991, AIME.

[16]  Constantin F. Aliferis,et al.  Identifying Markov blankets with decision tree induction , 2003, Third IEEE International Conference on Data Mining.

[17]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[18]  Simchen Elisheva,et al.  Sequential logistic models for 30 days mortality after CABG: Pre-operative, intra-operative and post-operative experience – The Israeli CABG study (ISCAB) , 2000, European Journal of Epidemiology.

[19]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[20]  R. Salamon,et al.  Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. , 1999, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[21]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[22]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[23]  C. Metz.  Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[24]  Silja Renooij,et al.  Probabilities for a probabilistic network: a case study in oesophageal cancer , 2002, Artif. Intell. Medicine.

[25]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[26]  Nir Friedman,et al.  Bayesian Network Classification with Continuous Attributes: Getting the Best of Both Discretization and Parametric Fitting , 1998, ICML.

[27]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[28]  S. Lemeshow,et al.  European system for cardiac operative risk evaluation (EuroSCORE). , 1999, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[29]  L. Iezzoni.  Risk Adjustment for Measuring Healthcare Outcomes , 1994 .

[30]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[31]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[32]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[33]  S. Pauker,et al.  The Markov Process in Medical Prognosis , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[34]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[35]  Manuel Laguna,et al.  Tabu Search , 1997 .

[36]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[37]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[38]  Nir Friedman,et al.  Discretizing Continuous Attributes While Learning Bayesian Networks , 1996, ICML.

[39]  J. Wyatt,et al.  Commentary: Prognostic models: clinically useful or quickly forgotten? , 1995 .

[40]  Pedro Larrañaga,et al.  Predicting survival in malignant skin melanoma using Bayesian networks automatically induced by genetic algorithms. An empirical comparison between different approaches , 1998, Artif. Intell. Medicine.

[41]  Peter J. F. Lucas,et al.  Bayesian networks in biomedicine and health-care , 2004, Artif. Intell. Medicine.

[42]  S. Nashef,et al.  Eurp-pean system for cardiac operative risk evaluation (Euro SCORE) , 1999 .

[43]  Steen Andreassen,et al.  Using probabilistic and decision-theoretic methods in treatment and prognosis modeling , 1999, Artif. Intell. Medicine.

[44]  Peter J. F. Lucas,et al.  A probabilistic and decision-theoretic approach to the management of infectious disease at the ICU , 2000, Artif. Intell. Medicine.

[45]  Pedro M. Domingos,et al.  Learning Bayesian network classifiers by maximizing conditional likelihood , 2004, ICML.

[46]  D. Heckerman,et al.  Toward Normative Expert Systems: Part I The Pathfinder Project , 1992, Methods of Information in Medicine.

[47]  A. Abu-Hanna,et al.  Prognostic Models in Medicine , 2001, Methods of Information in Medicine.

[48]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[49]  Wray L. Buntine.  A Guide to the Literature on Learning Probabilistic Networks from Data , 1996, IEEE Trans. Knowl. Data Eng..

[50]  José A. Gámez,et al.  Partial abductive inference in Bayesian belief networks - an evolutionary computation approach by using problem-specific genetic operators , 2002, IEEE Trans. Evol. Comput..

[51]  David A. Bell,et al.  Learning Bayesian networks from data: An information-theory based approach , 2002, Artif. Intell..

[52]  P. Lucas,et al.  Computer-based Decision Support in the Management of Primary Gastric non-Hodgkin Lymphoma , 1998, Methods of Information in Medicine.

[53]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[54]  G C Sakellaropoulos,et al.  Development of a Bayesian Network for the Prognosis of Head Injuries using Graphical Model Selection Techniques , 1999, Methods of Information in Medicine.

[55]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..