Efficient and effective Bayesian network local structure learning

In this paper, we propose a more efficient Bayesian network structure learning algorithm under the framework of score based local learning (SLL). Our algorithm significantly improves computational efficiency by restricting the neighbors of each variable to a small subset of candidates and storing necessary information to uncover the spouses, at the same time guaranteeing to find the optimal neighbor set in the same sense as SLL. The algorithm is theoretically sound in the sense that it is optimal in the limit of large sample size. Empirical results testify its improved speed without loss of quality in the learned structures.

[1]  Daphne Koller,et al.  Toward Optimal Feature Selection , 1996, ICML.

[2]  S. Kuikka,et al.  Uncertainties of climatic change impacts in finnish watersheds: A bayesian network analysis of expert knowledge , 1997 .

[3]  Nir Friedman,et al.  Learning Bayesian Network Structure from Massive Datasets: The "Sparse Candidate" Algorithm , 1999, UAI.

[4]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[5]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[6]  Constantin F. Aliferis,et al.  HITON: A Novel Markov Blanket Algorithm for Optimal Variable Selection , 2003, AMIA.

[7]  Constantin F. Aliferis,et al.  Time and sample efficient discovery of Markov blankets and direct causal relations , 2003, KDD '03.

[8]  Daphne Koller,et al.  Ordering-Based Search: A Simple and Effective Algorithm for Learning Bayesian Networks , 2005, UAI.

[9]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[10]  Constantin F. Aliferis,et al.  Generating Realistic Large Bayesian Networks by Tiling , 2006, FLAIRS.

[11]  Tomi Silander,et al.  A Simple Approach for Finding the Globally Optimal Bayesian Network Structure , 2006, UAI.

[12]  Shaohua Tan,et al.  Emergent and spontaneous computation of factor relationships from a large factor set , 2008 .

[13]  Mikko Koivisto,et al.  Exact Structure Discovery in Bayesian Networks with Less Space , 2009, UAI.

[14]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[15]  Constantin F. Aliferis,et al.  Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation , 2010, J. Mach. Learn. Res..

[16]  Bingwu Liu,et al.  Continuous variable based Bayesian network structure learning from financial factors , 2012, 2012 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr).

[17]  Teppo Niinimaki,et al.  Local Structure Discovery in Bayesian Networks , 2012, UAI.