An improved structure learning algorithm of Bayesian Network based on the hesitant fuzzy information flow

Abstract The Bayesian Network (BN) is one of the most effective theoretical models in the fields of uncertain reasoning. With the nonlinear evolution of events and the complexity of practical problems, there will be massive data with uncertainty, bringing more challenges to the application of the BN. In this paper, by combining the advantages of the hesitant fuzzy set (HFS) in depicting uncertain information and the advantages of information flow (IF) in the causal analysis of nonlinear systems, an improved Particle Swarm Optimization (PSO) algorithm for the structure learning of the BN based on the hesitant fuzzy information flow (HFIF) is proposed. First, a new physical notion called HFIF is defined to depict the causal relationship between two intensive hesitant fuzzy variable sequences. Then the global causal analysis based on HFIF is conducted. By constructing an unconstrained optimization model, the initial structure and the optimized search space with the most significant causality are obtained, based on which, the approximate optimal structure by the PSO algorithm and the directions of the arcs by HFIF are determined at the same time. A specific implementation process of the structure learning based on the improved PSO algorithm under hesitant fuzzy environment is also presented. Moreover, the proposed algorithm is applied to the structure learning of ASIA network and BOBLO network. Comparisons between the proposed algorithm and traditional algorithms are conducted to demonstrate the effectiveness and advantages of the proposed algorithm in structure learning under hesitant fuzzy environment.

[1]  Chunnian Liu,et al.  An artificial bee colony algorithm for learning Bayesian networks , 2012, Soft Computing.

[2]  Sirish L. Shah,et al.  Direct Causality Detection via the Transfer Entropy Approach , 2013, IEEE Transactions on Control Systems Technology.

[3]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[4]  V. Torra,et al.  A framework for linguistic logic programming , 2010 .

[5]  X San Liang,et al.  Information flow within stochastic dynamical systems. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Mohammad Najafzadeh,et al.  NF-GMDH-Based self-organized systems to predict bridge pier scour depth under debris flow effects , 2017 .

[7]  Zeshui Xu,et al.  Novel correlation coefficients between hesitant fuzzy sets and their application in decision making , 2015, Knowl. Based Syst..

[8]  Erik M. Bollt,et al.  Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings , 2014, 1504.03769.

[9]  Jun Liu,et al.  Hesitant Cloud Model and Its Application in the Risk Assessment of “The Twenty-First Century Maritime Silk Road” , 2016 .

[10]  Asif Ekbal,et al.  Feature selection for entity extraction from multiple biomedical corpora: A PSO-based approach , 2018, Soft Comput..

[11]  Zeshui Xu,et al.  Kernel C-Means Clustering Algorithms for Hesitant Fuzzy Information in Decision Making , 2017, International Journal of Fuzzy Systems.

[12]  Zeshui Xu,et al.  Hesitant fuzzy information aggregation in decision making , 2011, Int. J. Approx. Reason..

[13]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[14]  Maomi Ueno,et al.  Advanced Methodologies for Bayesian Networks , 2015, Lecture Notes in Computer Science.

[15]  Chengzu Bai,et al.  Forecasting the Tropical Cyclone Genesis over the Northwest Pacific through Identifying the Causal Factors in Cyclone–Climate Interactions , 2017 .

[16]  X. Liang,et al.  Unraveling the cause-effect relation between time series. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[18]  Fatemeh Afsari,et al.  Hesitant fuzzy decision tree approach for highly imbalanced data classification , 2017, Appl. Soft Comput..

[19]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[20]  Sirish L. Shah,et al.  Transfer Zero-Entropy and Its Application for Capturing Cause and Effect Relationship Between Variables , 2015, IEEE Transactions on Control Systems Technology.

[21]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[22]  Mohammad Kazem Ebrahimpour,et al.  Ensemble of feature selection methods: A hesitant fuzzy sets approach , 2017, Appl. Soft Comput..

[23]  Mohammad Reza Meybodi,et al.  BNC-PSO: structure learning of Bayesian networks by Particle Swarm Optimization , 2016, Inf. Sci..

[24]  Najeh Ben Guedria,et al.  Improved accelerated PSO algorithm for mechanical engineering optimization problems , 2016, Appl. Soft Comput..

[25]  Fred Glover,et al.  Tabu Search: A Tutorial , 1990 .

[26]  Zeshui Xu,et al.  Measures of Probabilistic Interval-Valued Intuitionistic Hesitant Fuzzy Sets and the Application in Reducing Excessive Medical Examinations , 2018, IEEE Transactions on Fuzzy Systems.

[27]  David Maxwell Chickering,et al.  Learning Bayesian Networks is NP-Complete , 2016, AISTATS.

[28]  Kyung-Soo Han,et al.  A fuzzy medical diagnosis based on quantiles of diagnostic measures , 2016, J. Intell. Fuzzy Syst..

[29]  Na Chen,et al.  Correlation coefficients of hesitant fuzzy sets and their applications to clustering analysis , 2013 .

[30]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[31]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[32]  X. Liang,et al.  Normalizing the causality between time series. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Yasunori Mitani,et al.  Intelligent Frequency Control in an AC Microgrid: Online PSO-Based Fuzzy Tuning Approach , 2012, IEEE Transactions on Smart Grid.

[34]  Yi-Zeng Hsieh,et al.  A PSO-based rule extractor for medical diagnosis , 2014, J. Biomed. Informatics.

[35]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[36]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[37]  Jose Miguel Puerta,et al.  Ant colony optimization for learning Bayesian networks , 2002, Int. J. Approx. Reason..

[38]  Thomas A. Runkler,et al.  Using a Local Discovery Ant Algorithm for Bayesian Network Structure Learning , 2009, IEEE Transactions on Evolutionary Computation.

[39]  Diego Macias,et al.  On the causal structure between CO2 and global temperature , 2016, Scientific Reports.

[40]  Tong Wang,et al.  A heuristic method for learning Bayesian networks using discrete particle swarm optimization , 2010, Knowledge and Information Systems.

[41]  David Heckerman,et al.  Learning Bayesian Networks: Search Methods and Experimental Results , 1995 .

[42]  Chao Zhang,et al.  A Dual Hesitant Fuzzy Multigranulation Rough Set over Two-Universe Model for Medical Diagnoses , 2015, Comput. Math. Methods Medicine.

[43]  Nick Cercone,et al.  Bayesian network modeling for evolutionary genetic structures , 2010, Comput. Math. Appl..