A self-adaptive Bayesian network classifier by means of genetic optimization

In the design of conventional Bayes network classifiers (e.g. Naive Bayes Classifier, Tree Augment Naive Bayes classifier), the network classifier structures are always fixed. Such network structures are very difficult to reflect the relationships among nodes (attributes). In this paper, we propose a self-adaptive Bayesian Network classifier based on genetic optimization. Genetic optimization is exploited here to realize the Self-adaptiveness, which means the network structure can be gradually optimized when constructing Bayesian network classifier. Experimental results show that the proposed method leads to a high classification accuracy than Naive Bayes classifier, Tree Augment Naive Bayes classifier, and KNN classifier on some benchmarks.

[1]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[2]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[3]  Franz Pernkopf,et al.  Efficient Heuristics for Discriminative Structure Learning of Bayesian Network Classifiers , 2010, J. Mach. Learn. Res..

[4]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[5]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[6]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[7]  Bin Shen,et al.  Discriminative parameter learning of general Bayesian network classifiers , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[8]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[9]  Qiang Shen,et al.  Learning Bayesian networks: approaches and issues , 2011, The Knowledge Engineering Review.

[10]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[11]  Shunkai Fu,et al.  Efficient learning of general Bayesian network Classifier by Local and Adaptive Search , 2014, 2014 International Conference on Data Science and Advanced Analytics (DSAA).

[12]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[13]  David Maxwell Chickering,et al.  Large-Sample Learning of Bayesian Networks is NP-Hard , 2002, J. Mach. Learn. Res..

[14]  Weiru Liu,et al.  Learning belief networks from data: an information theory based approach , 1997, CIKM '97.

[15]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .