Hybrid Optimization Algorithm for Bayesian Network Structure Learning

Since the beginning of the 21st century, research on artificial intelligence has made great progress. Bayesian networks have gradually become one of the hotspots and important achievements in artificial intelligence research. Establishing an effective Bayesian network structure is the foundation and core of the learning and application of Bayesian networks. In Bayesian network structure learning, the traditional method of utilizing expert knowledge to construct the network structure is gradually replaced by the data learning structure method. However, as a result of the large amount of possible network structures, the search space is too large. The method of Bayesian network learning through training data usually has the problems of low precision or high complexity, which make the structure of learning differ greatly from that of reality, which has a great influence on the reasoning and practical application of Bayesian networks. In order to solve this problem, a hybrid optimization artificial bee colony algorithm is discretized and applied to structure learning. A hybrid optimization technique for the Bayesian network structure learning method is proposed. Experimental simulation results show that the proposed hybrid optimization structure learning algorithm has better structure and better convergence.

[1]  David Maxwell Chickering,et al.  Learning Equivalence Classes of Bayesian Network Structures , 1996, UAI.

[2]  I ScottKirkpatrick Optimization by Simulated Annealing: Quantitative Studies , 1984 .

[3]  Thomas A. Runkler,et al.  Using a Local Discovery Ant Algorithm for Bayesian Network Structure Learning , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Xingang Shi,et al.  基于有向无环图的互联网域内节能路由算法 (Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph) , 2018, 计算机科学.

[5]  Jirí Andel,et al.  Estimating the dimension of a linear model , 1981, Kybernetika.

[6]  Peter van Beek,et al.  Metaheuristics for Score-and-Search Bayesian Network Structure Learning , 2017, Canadian Conference on AI.

[7]  Arun Venkataramani,et al.  DTN routing as a resource allocation problem , 2007, SIGCOMM '07.

[8]  Luis M. de Campos,et al.  A Scoring Function for Learning Bayesian Networks based on Mutual Information and Conditional Independence Tests , 2006, J. Mach. Learn. Res..

[9]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[10]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[11]  Musa A. Mammadov,et al.  Structure learning of Bayesian Networks using global optimization with applications in data classification , 2015, Optim. Lett..

[12]  H. Akaike A new look at the statistical model identification , 1974 .

[13]  Pedro Larrañaga,et al.  Structure Learning of Bayesian Networks by Genetic Algorithms: A Performance Analysis of Control Parameters , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[15]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[16]  Ronan M. T. Fleming,et al.  Quantitative prediction of cellular metabolism with constraint-based models: the COBRA Toolbox v2.0 , 2007, Nature Protocols.

[17]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[18]  Quan-Ke Pan,et al.  Metaheuristics for Common Due Date Total Earliness and Tardiness Single Machine Scheduling Problem , 2009 .

[19]  R. W. Robinson Counting unlabeled acyclic digraphs , 1977 .

[20]  Mohammad Reza Meybodi,et al.  BNC-PSO: structure learning of Bayesian networks by Particle Swarm Optimization , 2016, Inf. Sci..

[21]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.