CONVERGENCE OF ITERATIVE ALGORITHMS FOR LEARNING BAYESIAN NETWORKS

The formalism of the bayesian networks has been employed in the development of many intelligent systems. This work considers applicatins which demand the utilization of online learning methods, more specifically methods for online parameter learning. Online learning methods update the bayesian network parameters as new data samples/observations are collected. In this context, it is import to consider the convergence of the learning method in relation to the empirical distribution of the data. Given that this work  proposes a experimental protocol to quantify the convergence/divergence of models generated by online learning procedures. An application example it is also presented.

[1]  Pieter Abbeel,et al.  Learning Factor Graphs in Polynomial Time and Sample Complexity , 2006, J. Mach. Learn. Res..

[2]  Eric Bauer,et al.  Update Rules for Parameter Estimation in Bayesian Networks , 1997, UAI.

[3]  Fabio Gagliardi Cozman,et al.  Adaptive Online Learning of Bayesian Network Parameters , 2001 .

[4]  H. Löe,et al.  PERIODONTAL DISEASE IN PREGNANCY. I. PREVALENCE AND SEVERITY. , 1963, Acta odontologica Scandinavica.

[5]  Paul J. Krause,et al.  Learning probabilistic networks , 1999, The Knowledge Engineering Review.

[6]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[7]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[8]  Isaac Levi,et al.  The Enterprise Of Knowledge , 1980 .

[9]  Mark Chignell,et al.  Expert Systems For Experts , 1988 .

[10]  Raymond J. Mooney,et al.  Theory Refinement of Bayesian Networks with Hidden Variables , 1998, ICML.

[11]  Nevin Lianwen Zhang,et al.  Exploiting Causal Independence in Bayesian Network Inference , 1996, J. Artif. Intell. Res..

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  Sanjoy Dasgupta,et al.  The Sample Complexity of Learning Fixed-Structure Bayesian Networks , 1997, Machine Learning.

[14]  Gregory Provan,et al.  Tradeoffs in Knowledge-Based Construction of Probabilistic Models , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[15]  Richard E. Neapolitan,et al.  Probabilistic reasoning in expert systems - theory and algorithms , 2012 .

[16]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .