Learning the structure of dynamic Bayesian networks from time series and steady state measurements

Dynamic Bayesian networks (DBN) are a class of graphical models that has become a standard tool for modeling various stochastic time-varying phenomena. In many applications, the primary goal is to infer the network structure from measurement data. Several efficient learning methods have been introduced for the inference of DBNs from time series measurements. Sometimes, however, it is either impossible or impractical to collect time series data, in which case, a common practice is to model the non-time series observations using static Bayesian networks (BN). Such an approach is obviously sub-optimal if the goal is to gain insight into the underlying dynamical model. Here, we introduce Bayesian methods for the inference of DBNs from steady state measurements. We also consider learning the structure of DBNs from a combination of time series and steady state measurements. We introduce two different methods: one that is based on an approximation and another one that provides exact computation. Simulation results demonstrate that dynamic network structures can be learned to an extent from steady state measurements alone and that inference from a combination of steady state and time series data has the potential to improve learning performance relative to the inference from time series data alone.

[1]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[2]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[3]  Daniel Nikovski,et al.  Learning Stationary Temporal Probabilistic Networks , 1998 .

[4]  Amy Nicole Langville,et al.  Updating Markov Chains with an Eye on Google's PageRank , 2005, SIAM J. Matrix Anal. Appl..

[5]  K. Sachs,et al.  Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data , 2005, Science.

[6]  D. Geiger,et al.  A characterization of the Dirichlet distribution through global and local parameter independence , 1997 .

[7]  Marco Grzegorczyk,et al.  Comparative evaluation of reverse engineering gene regulatory networks with relevance networks, graphical gaussian models and bayesian networks , 2006, Bioinform..

[8]  Chao Yang,et al.  ARPACK users' guide - solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods , 1998, Software, environments, tools.

[9]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[10]  Nir Friedman,et al.  Being Bayesian about Network Structure , 2000, UAI.

[11]  Michael I. Jordan,et al.  Probabilistic Networks and Expert Systems , 1999 .

[12]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[13]  Dirk Husmeier,et al.  Introduction to Learning Bayesian Networks from Data , 2005 .

[14]  P. Bühlmann,et al.  Sparse graphical Gaussian modeling of the isoprenoid gene network in Arabidopsis thaliana , 2004, Genome Biology.

[15]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[16]  Tommi S. Jaakkola,et al.  Combining Location and Expression Data for Principled Discovery of Genetic Regulatory Network Models , 2001, Pacific Symposium on Biocomputing.

[17]  Ilya Shmulevich,et al.  Relationships between probabilistic Boolean networks and dynamic Bayesian networks as models of gene regulatory networks , 2006, Signal Process..

[18]  Dirk Husmeier,et al.  Sensitivity and specificity of inferring genetic regulatory interactions from microarray experiments with dynamic Bayesian networks , 2003, Bioinform..

[19]  Satoru Miyano,et al.  Bayesian Network and Nonparametric Heteroscedastic Regression for Nonlinear Modeling of Genetic Network , 2003, J. Bioinform. Comput. Biol..

[20]  C. Robert,et al.  Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method , 2000 .

[21]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[22]  Nir Friedman,et al.  Inferring subnetworks from perturbed expression profiles , 2001, ISMB.

[23]  K NgMichael,et al.  An approximation method for solving the steady-state probability distribution of probabilistic Boolean networks , 2007 .

[24]  Nir Friedman,et al.  Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks , 2004, Machine Learning.

[25]  Martin A. Nowak,et al.  Inferring Cellular Networks Using Probabilistic Graphical Models , 2004 .

[26]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[27]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[28]  Lorenz Wernisch,et al.  Reconstruction of gene networks using Bayesian learning and manipulation experiments , 2004, Bioinform..

[29]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .

[30]  Alexander J. Hartemink,et al.  Informative Structure Priors: Joint Learning of Dynamic Regulatory Networks from Multiple Types of Data , 2004, Pacific Symposium on Biocomputing.

[31]  Kevin P. Murphy,et al.  Learning the Structure of Dynamic Probabilistic Networks , 1998, UAI.

[32]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[33]  Michael K. Ng,et al.  An approximation method for solving the steady-state probability distribution of probabilistic Boolean networks , 2007, Bioinform..

[34]  Claudia Tarantola,et al.  Efficient Model Determination for Discrete Graphical Models , 2000 .

[35]  Tommi S. Jaakkola,et al.  Using Graphical Models and Genomic Expression Data to Statistically Validate Models of Genetic Regulatory Networks , 2000, Pacific Symposium on Biocomputing.

[36]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[37]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[38]  Paolo Giudici,et al.  Nonparametric Convergence Assessment for MCMC Model Selection , 2003 .

[39]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[40]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[41]  P. Dellaportas,et al.  Markov chain Monte Carlo model determination for hierarchical and graphical log-linear models , 1999 .

[42]  Petar M. Djuric,et al.  Model selection by MCMC computation , 2001, Signal Process..

[43]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[44]  Korbinian Strimmer,et al.  An empirical Bayes approach to inferring large-scale gene association networks , 2005, Bioinform..

[45]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[46]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[47]  Michael I. Jordan Learning in Graphical Models , 1999, NATO ASI Series.

[48]  J. York,et al.  Bayesian Graphical Models for Discrete Data , 1995 .

[49]  Stephen J. Roberts,et al.  Probabilistic Modeling in Bioinformatics and Medical Informatics , 2010 .

[50]  M. West,et al.  Sparse graphical models for exploring gene expression data , 2004 .

[51]  Christian P. Robert,et al.  Monte Carlo Statistical Methods (Springer Texts in Statistics) , 2005 .