Discrete Exponential Bayesian Networks Structure Learning for Density Estimation

Our work aims at developing or expliciting bridges between Bayesian Networks and Natural Exponential Families, by proposing discrete exponential Bayesian networks as a generalization of usual discrete ones. In this paper, we illustrate the use of discrete exponential Bayesian networks for Bayesian structure learning and density estimation. Our goal is to empirically determine in which contexts these models can be a good alternative to usual Bayesian networks for density estimation.

[1]  Steffen L. Lauritzen,et al.  Stable local computation with conditional Gaussian distributions , 2001, Stat. Comput..

[2]  Dan Geiger,et al.  Graphical Models and Exponential Families , 1998, UAI.

[3]  Philippe Leray,et al.  BNT STRUCTURE LEARNING PACKAGE : Documentation and Experiments , 2004 .

[4]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[5]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[6]  Afif Masmoudi,et al.  Discrete Exponential Bayesian Networks: An Extension of Bayesian Networks to Discrete Natural Exponential Families , 2011, 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence.

[7]  Matthew J. Beal,et al.  The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures , 2003 .

[8]  O. Barndorff-Nielsen.  Information and Exponential Families in Statistical Theory , 1980 .

[9]  D. Geiger,et al.  Stratified exponential families: Graphical models and model selection , 2001 .

[10]  J. F. C. Kingman,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[11]  Guido Consonni,et al.  Conjugate Priors for Exponential Families Having Quadratic Variance Functions , 1992 .

[12]  David Heckerman,et al.  Learning Bayesian Networks: Search Methods and Experimental Results , 1995 .

[13]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.