Learning the Structure of Dynamic Bayesian Network with Hybrid Data and Domain Knowledges

Dynamic Bayesian Networks (DBNs) is a powerful graphical model for representing temporal stochastic processes. Learning the structure of DBNs is the fundamental step for parameter learning, inference, application etc. In some cases, such as computational systems biology, learning the structure of DBNs facing the two challenges (1) experimental settings only capture few time series and steady state measurements. (2) the knowledge about DBNs is uncertainty, rare and even with conflict. The paper considers the time series data, steady state and domain knowledge simultaneously, presents a novel algorithm for learning the structure of DBNs. Compare with single source learning, empirical experiment shows that learning with hybrid data and domain knowledges improved the accuracy and effectiveness of the DBNs structure learning.

[1]  David Maxwell Chickering,et al.  Learning Bayesian Networks is , 1994 .

[2]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[3]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[4]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[5]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[6]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[7]  Qiang Shen,et al.  Learning Bayesian networks: approaches and issues , 2011, The Knowledge Engineering Review.

[8]  Ilya Shmulevich,et al.  Learning the structure of dynamic Bayesian networks from time series and steady state measurements , 2008, Machine Learning.

[9]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[10]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[11]  David Maxwell Chickering,et al.  Large-Sample Learning of Bayesian Networks is NP-Hard , 2002, J. Mach. Learn. Res..

[12]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[13]  David A. Bell,et al.  Learning Bayesian networks from data: An information-theory based approach , 2002, Artif. Intell..