Labeled DBN Learning with Community Structure Knowledge

Learning interactions between dynamical processes is a widespread but difficult problem in ecological or human sciences. Unlike in other domains (bioinformatics, for example), data is often scarce, but expert knowledge is available. We consider the case where knowledge is about a limited number of interactions that drive the processes dynamics, and on a community structure in the interaction network. We propose an original framework, based on Dynamic Bayesian Networks with labeled-edge structure and parsimonious parameterization, and a Stochastic Block Model prior, to integrate this knowledge. Then we propose a restoration-estimation algorithm, based on 0-1 Linear Programing, that improves network learning when these two types of expert knowledge are available. The approach is illustrated on a problem of ecological interaction network learning.

[1]  T. Williams,et al.  Causes and consequences of marine mammal population declines in southwest Alaska: a food-web perspective , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  Peter J. F. Lucas,et al.  Bayesian network modelling through qualitative patterns , 2005, Artif. Intell..

[3]  Christine M. Anderson-Cook,et al.  Bayesian Networks with Prior Knowledge for Malware Phylogenetics , 2016, AAAI Workshop: Artificial Intelligence for Cyber Security.

[4]  T. E. Harris.  Contact Interactions on a Lattice , 1974 .

[5]  Tom M. Mitchell,et al.  Bayesian Network Learning with Parameter Constraints , 2006, J. Mach. Learn. Res..

[6]  David Heckerman,et al.  Causal independence for probability assessment and inference using Bayesian networks , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[7]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[8]  Colin M Beale,et al.  Revealing ecological networks using Bayesian network inference algorithms. , 2010, Ecology.

[9]  Qiang Ji,et al.  Efficient Structure Learning of Bayesian Networks using Constraints , 2011, J. Mach. Learn. Res..

[10]  Linda C. van der Gaag,et al.  Learning Bayesian network parameters under order constraints , 2006, Int. J. Approx. Reason..

[11]  David Maxwell Chickering,et al.  Learning Bayesian Networks is NP-Complete , 2016, AISTATS.

[12]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[13]  Jure Leskovec,et al.  Inferring networks of diffusion and influence , 2010, KDD.

[14]  Alain Franc,et al.  Metapopulation dynamics as a contact process on a graph , 2004 .

[15]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[16]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[17]  Norbert Dojer,et al.  Learning Bayesian Networks Does Not Have to Be NP-Hard , 2006, MFCS.

[18]  Janne H. Korhonen,et al.  Tractable Bayesian Network Structure Learning with Bounded Vertex Cover Number , 2015, NIPS.

[19]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[20]  Xuan Vinh Nguyen,et al.  Gene regulatory network modeling via global optimization of high-order dynamic Bayesian network , 2012, BMC Bioinformatics.

[21]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[22]  Jens Lagergren,et al.  Learning Bounded Tree-width Bayesian Networks using Integer Linear Programming , 2014, AISTATS.

[23]  Michael P. Wellman.  Fundamental Concepts of Qualitative Probabilistic Networks , 1990, Artif. Intell..

[24]  James Cussens,et al.  Bayesian network learning with cutting planes , 2011, UAI.

[25]  Paul P. Wang,et al.  Advances to Bayesian network inference for generating causal networks from observational biological data , 2004, Bioinform..

[26]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[27]  Marcel Salathé,et al.  Dynamics and Control of Diseases in Networks with Community Structure , 2010, PLoS Comput. Biol..

[28]  Christophe Ambroise,et al.  Inferring sparse Gaussian graphical models with latent structure , 2008, 0810.3177.

[29]  Mark E. J. Newman,et al.  Structure and inference in annotated networks , 2015, Nature Communications.