A graph partitioning approach for Bayesian Network structure learning

Structure learning of Bayesian Network is one of important topics in machine learning and widely applied in expert system. The traditional algorithms for structure learning are usually focused on the entire nodes in BN. It is difficult to learn the structure efficiently from the huge amounts of data. In reality, BN as a special inference network and the community also exists in BN. To achieve this goal, we propose Graph Partitioning Approach for BN Structure Learning. Firstly, we get the skeleton of BN by conditional dependence test. Secondly, skeleton is divided into some communities. Thirdly, the structure of every community is learned and the edges between communities are determined by BIC (Bayesian Information Criterion) score function. Numerical experiments on the standard network show that our proposed algorithm can greatly reduce the time cost of structure learning and have more accuracy.

[1]  Juan Zhou,et al.  Learning effective brain connectivity with dynamic Bayesian networks , 2007, NeuroImage.

[2]  Constantin F. Aliferis,et al.  A Comparison of Novel and State-of-the-Art Polynomial Bayesian Network Learning Algorithms , 2005, AAAI.

[3]  Qiang Zhao,et al.  Decomposition of structural learning about directed acyclic graphs , 2006, Artif. Intell..

[4]  Qinkun Xiao,et al.  Bayesian network learning based on relationship prediction PSO and its application in agricultural expert system , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[5]  Bruce D'Ambrosio,et al.  Monitoring and diagnosis of a multistage manufacturing process using Bayesian networks , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[6]  Jose Miguel Puerta,et al.  Ant colony optimization for learning Bayesian networks , 2002, Int. J. Approx. Reason..

[7]  Martin J. McKeown,et al.  Dynamic Bayesian network modeling of fMRI: A comparison of group-analysis methods , 2008, NeuroImage.

[8]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[10]  Jing Li,et al.  A Sparse Structure Learning Algorithm for Gaussian Bayesian Network Identification from High-Dimensional Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Nir Friedman,et al.  Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks , 2004, Machine Learning.

[12]  Valentin Ziegler,et al.  Approximation algorithms for restricted Bayesian network structures , 2008, Inf. Process. Lett..

[13]  Chi-Hyuck Jun,et al.  Learning Bayesian network structure using Markov blanket decomposition , 2012, Pattern Recognit. Lett..

[14]  James A. Stori,et al.  A Bayesian network approach to root cause diagnosis of process variations , 2005 .

[15]  Thierry Dutoit,et al.  A probabilistic framework for dialog simulation and optimal strategy learning , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  Zhi Geng,et al.  Structural Learning of Chain Graphs via Decomposition. , 2008, Journal of machine learning research : JMLR.

[17]  Andrei S. Rodin,et al.  Mining genetic epidemiology data with Bayesian networks I: Bayesian networks and example application (plasma apoE levels) , 2005, Bioinform..

[18]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[19]  Weiru Liu,et al.  Learning belief networks from data: an information theory based approach , 1997, CIKM '97.