Probabilistic Modelling with Bayesian Networks

This chapter introduces a probabilistic approach to modelling in physiology and medicine: the quantities of interest are modeled as random variables and the focus is on the probabilistic dependencies between these variables. As primary tool in this modelling framework, we present Bayesian networks (BNs), which map the dependencies between a set of random variables to a directed acyclic graph, both increasing human readability and simplifying the representation of the joint probability distribution of the set of variables. The chapter first describes the theoretical foundations of BNs, including a brief review of probability and graph theory, a formal definition of BNs and details on discrete, continuous, and dynamic BNs. Then, a selection of algorithms for inference, conditional probability learning, and structure learning is presented. Finally, several examples of BN applications in biomedicine are reviewed.

[1]  S. Wright.  The Method of Path Coefficients , 1934 .

[2]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[3]  Fabio Stella,et al.  A continuous time Bayesian network model for cardiogenic heart failure , 2012 .

[4]  Robert G. Cowell,et al.  Local Propagation in Conditional Gaussian Bayesian Networks , 2005, J. Mach. Learn. Res..

[5]  A. Hyman,et al.  Genome-scale RNAi profiling of cell division in human tissue culture cells , 2007, Nature Cell Biology.

[6]  Klaus Schughart,et al.  Dynamic gene network reconstruction from gene expression data in mice after influenza A (H1N1) infection , 2011, Journal of Clinical Bioinformatics.

[7]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[8]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[9]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[10]  S Andreassen,et al.  The EMG diagnosis--an interpretation based on partial information. , 1999, Medical engineering & physics.

[11]  Riccardo Bellazzi,et al.  Bayesian approaches to reverse engineer cellular systems: a simulation study on nonlinear Gaussian networks , 2007, BMC Bioinformatics.

[12]  Philippe Leray,et al.  Probabilistic graphical models for genetic association studies , 2012, Briefings Bioinform..

[13]  Fabio Stella,et al.  Continuous time Bayesian network classifiers , 2012, J. Biomed. Informatics.

[14]  Yu Fan,et al.  Learning Continuous-Time Social Network Dynamics , 2009, UAI.

[15]  Rainer Spang,et al.  Inferring cellular networks – a review , 2007, BMC Bioinformatics.

[16]  Daphne Koller,et al.  Expectation Propagation for Continuous Time Bayesian Networks , 2005, UAI.

[17]  Angelo Nuzzo,et al.  Phenotype forecasting with SNPs data through gene-based Bayesian networks , 2009, BMC Bioinformatics.

[18]  S. Andreassen,et al.  Dynamic updating in DIAS-NIDDM and DIAS causal probabilistic networks , 1999, IEEE Transactions on Biomedical Engineering.

[19]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[20]  Marek J. Druzdzel,et al.  SMILE: Structural Modeling, Inference, and Learning Engine and GeNIE: A Development Environment for Graphical Decision-Theoretic Models , 1999, AAAI/IAAI.

[21]  Paola Sebastiani,et al.  Genetic dissection and prognostic modeling of overt stroke in sickle cell anemia , 2005, Nature Genetics.

[22]  Anders L. Madsen,et al.  The Hugin Tool for Learning Bayesian Networks , 2003, ECSQARU.

[23]  Ole K. Hejlesen,et al.  DiasNet - a diabetes advisory system for communication and education via the internet , 2001, Int. J. Medical Informatics.

[24]  Claudio Cobelli,et al.  Bag of Naïve Bayes: biomarker selection and classification from genome-wide SNP data , 2012, BMC Bioinformatics.

[25]  E. Carson,et al.  A probabilistic approach to glucose prediction and insulin dose adjustment: description of metabolic model and pilot evaluation study. , 1994, Computer methods and programs in biomedicine.

[26]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[27]  R A Miller,et al.  A History of the INTERNIST-1 and Quick Medical Reference (QMR) Computer-Assisted Diagnosis Projects, with Lessons Learned , 2010, Yearbook of Medical Informatics.

[28]  Giovanni Sparacino,et al.  Bayesian Identification of a Population Compartmental Model of C-Peptide Kinetics , 2000, Annals of Biomedical Engineering.

[29]  Kuo-Chu Chang,et al.  Weighing and Integrating Evidence for Stochastic Simulation in Bayesian Networks , 2013, UAI.

[30]  Michael I. Jordan,et al.  Variational Probabilistic Inference and the QMR-DT Network , 2011, J. Artif. Intell. Res..

[31]  Jing Xu,et al.  Importance Sampling for Continuous Time Bayesian Networks , 2010, J. Mach. Learn. Res..

[32]  C. Ball,et al.  Identification of genes periodically expressed in the human cell cycle and their expression in tumors. , 2002, Molecular biology of the cell.

[33]  Yu Zhang,et al.  A novel bayesian graphical model for genome‐wide multi‐SNP association mapping , 2012, Genetic epidemiology.

[34]  S Andreassen,et al.  Evaluation of the diagnostic performance of the expert EMG assistant MUNIN. , 1996, Electroencephalography and clinical neurophysiology.

[35]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[36]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[37]  Michael Luby,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks is NP-Hard , 1993, Artif. Intell..

[38]  Adnan Darwiche,et al.  Recursive conditioning , 2001, Artif. Intell..

[39]  S. Miyano,et al.  Finding Optimal Bayesian Network Given a Super-Structure , 2008 .

[40]  Nir Friedman,et al.  Inferring Cellular Networks Using Probabilistic Graphical Models , 2004, Science.

[41]  Silvana Badaloni,et al.  Bayesian Network structure learning: Hybridizing complete search with independence tests , 2015, AI Commun..

[42]  Jung-Fu Cheng,et al.  Turbo Decoding as an Instance of Pearl's "Belief Propagation" Algorithm , 1998, IEEE J. Sel. Areas Commun..

[43]  Eugene Charniak,et al.  Bayesian Networks without Tears , 1991, AI Mag..

[44]  Qiang Ji,et al.  Efficient Structure Learning of Bayesian Networks using Constraints , 2011, J. Mach. Learn. Res..

[45]  Riccardo Bellazzi,et al.  Inferring cell cycle feedback regulation from gene expression data , 2011, J. Biomed. Informatics.

[46]  Giuseppe De Nicolao,et al.  Bayesian Function Learning Using MCMC Methods , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Mark E. Borsuk,et al.  Using Bayesian networks to discover relations between genes, environment, and disease , 2013, BioData Mining.

[48]  S. Andreassen,et al.  Diagnostic function of the microhuman prototype of the expert system--MUNIN. , 1992, Electroencephalography and clinical neurophysiology.

[49]  David Kerr,et al.  Impaired absorption and omission of insulin: a novel method of detection using the diabetes advisory system computer model. , 2001, Diabetes technology & therapeutics.

[50]  Nir Friedman,et al.  Gibbs Sampling in Factorized Continuous-Time Markov Processes , 2008, UAI.

[51]  S. Andreassen,et al.  Use of the DIAS model to predict unrecognised hypoglycaemia in patients with insulin-dependent diabetes. , 1996, Computer methods and programs in biomedicine.

[52]  Steffen L. Lauritzen,et al.  Bayesian updating in causal probabilistic networks by local computations , 1990 .

[53]  S. Andreassen,et al.  DIAS-NIDDM--a model-based decision support system for insulin dose adjustment in insulin-treated subjects with NIDDM. , 1998, Computer methods and programs in biomedicine.

[54]  Wray L. Buntine.  Operations for Learning with Graphical Models , 1994, J. Artif. Intell. Res..

[55]  Judea Pearl,et al.  Equivalence and Synthesis of Causal Models , 1990, UAI.

[56]  Gregory F. Cooper,et al.  An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network , 1991, Computers and biomedical research, an international journal.

[57]  Adnan Darwiche,et al.  Inference in belief networks: A procedural guide , 1996, Int. J. Approx. Reason..

[58]  E. Dougherty,et al.  Genomic Signal Processing and Statistics , 2005 .

[59]  Aurélien Mazurie,et al.  Gene networks inference using dynamic Bayesian networks , 2003, ECCB.

[60]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[61]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[62]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[63]  Daphne Koller,et al.  Continuous Time Bayesian Networks , 2012, UAI.

[64]  David Maxwell Chickering,et al.  A Transformational Characterization of Equivalent Bayesian Network Structures , 1995, UAI.