Strategies for improving the modeling and interpretability of Bayesian networks

One of the main factors for the knowledge discovery success is related to the comprehensibility of the patterns discovered by applying data mining techniques. Amongst which we can point out the Bayesian networks as one of the most prominent when considering the easiness of knowledge interpretation achieved. Bayesian networks, however, present limitations and disadvantages regarding their use and applicability. This paper presents an extension for the improvement of Bayesian networks, treating aspects such as performance, as well as interpretability and use of their results; incorporating genetic algorithms in the model, multivariate regression for structure learning and temporal aspects using Markov chains.

[1]  Myron Hlynka,et al.  Queueing Networks and Markov Chains (Modeling and Performance Evaluation With Computer Science Applications) , 2007, Technometrics.

[2]  J. Rice.  Mathematical Statistics and Data Analysis , 1988 .

[3]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[4]  Jie Cheng,et al.  Learning Bayesian Networks from Data: An Efficient Approach Based on Information Theory , 1999 .

[5]  Randall S. Sexton,et al.  Knowledge discovery using a neural network simultaneous optimization algorithm on a real world classification problem , 2006, Eur. J. Oper. Res..

[6]  Sachin Shetty,et al.  Structure learning of Bayesian networks using a semantic genetic algorithm-based approach , 2005, ITRE 2005. 3rd International Conference on Information Technology: Research and Education, 2005..

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Nicandro Cruz Ramírez,et al.  Building bayesian networks from data: a constraint-based approach , 2001 .

[9]  Reinhard Viertl,et al.  On Fuzzy Bayesian Inference , 2016 .

[10]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[11]  H. Handa,et al.  Estimation of Bayesian network algorithm with GA searching for better network structure , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[12]  Gang Li,et al.  Evolutionary structure learning algorithm for Bayesian network and Penalized Mutual Information metric , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[13]  Zhengxin Chen,et al.  Data Mining and Uncertain Reasoning: An Integrated Approach , 2001 .

[14]  Chris H. Q. Ding,et al.  Structure search and stability enhancement of Bayesian networks , 2003, Third IEEE International Conference on Data Mining.

[15]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[16]  H. Akaike.  A new look at the statistical model identification , 1974 .

[17]  M.M. Morales,et al.  A method based on genetic algorithms and fuzzy logic to induce Bayesian networks , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[18]  David Maxwell Chickering,et al.  Large-Sample Learning of Bayesian Networks is NP-Hard , 2002, J. Mach. Learn. Res..

[19]  J. Hair.  Multivariate data analysis , 1972 .

[20]  Pedro Larrañaga,et al.  Structure Learning of Bayesian Networks by Genetic Algorithms: A Performance Analysis of Control Parameters , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[22]  Richard Scheines,et al.  TETRAD II: Tools for Discovery , 1994 .

[23]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[24]  Gunter Bolch,et al.  Queueing Networks and Markov Chains - Modeling and Performance Evaluation with Computer Science Applications, Second Edition , 1998 .

[25]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[26]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[27]  José A. Gámez,et al.  Partial abductive inference in Bayesian belief networks - an evolutionary computation approach by using problem-specific genetic operators , 2002, IEEE Trans. Evol. Comput..

[28]  Rolph E. Anderson,et al.  Multivariate data analysis (4th ed.): with readings , 1995 .

[29]  Edward H. Herskovits,et al.  Computer-based probabilistic-network construction , 1992 .

[30]  D. Rubinfeld,et al.  Econometric models and economic forecasts , 2002 .

[31]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[32]  Gregory Piatetsky-Shapiro,et al.  Advances in Knowledge Discovery and Data Mining , 2004, Lecture Notes in Computer Science.

[33]  Nicandro Cruz-Ramírez,et al.  Bayes-N: An Algorithm for Learning Bayesian Networks from Data Using Local Measures of Information Gain Applied to Classification Problems , 2004, MICAI.

[34]  Jingjing Lu,et al.  Comparing naive Bayes, decision trees, and SVM with AUC and accuracy , 2003, Third IEEE International Conference on Data Mining.

[35]  Keshav P. Dahal,et al.  Evolutionary hybrid approaches for generation scheduling in power systems , 2007, Eur. J. Oper. Res..

[36]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[37]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[38]  R. Cranley,et al.  Multivariate Analysis—Methods and Applications , 1985 .

[39]  Xiao-Lin Li,et al.  Learning Bayesian networks structures based on extending evolutionary programming , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[40]  Robert S. Pindyck,et al.  A computer handbook using Eviews by Hiroyuki Kawakatsu to accompany econometric models and economic forecasts , 1998 .