An immune-inspired approach to Bayesian networks

Bayesian networks learning from data has attracted a great deal of research. The usual approaches to accomplishing this task combine two elements. The first one is a heuristic search procedure to generate candidate solutions and the other element is a scoring metric to evaluate each obtained solution based on the likelihood of the network, that can be interpreted as a probability of observing the data set under a given network model. In this paper, we propose the use of an artificial immune system as the search procedure for obtaining high quality Bayesian networks, motivated by the multimodal search capability of these algorithms combined with the dynamical control of the population size and diversity along the search. We demonstrate the applicability of the proposal on two benchmarks and promising results were obtained.

[1]  David Maxwell Chickering,et al.  Learning Bayesian Networks is NP-Complete , 2016, AISTATS.

[2]  David Maxwell Chickering,et al.  Large-Sample Learning of Bayesian Networks is NP-Hard , 2002, J. Mach. Learn. Res..

[3]  J. Rissanen.  Stochastic Complexity and Modeling , 1986 .

[4]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[5]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[6]  Nir Friedman,et al.  The Bayesian Structural EM Algorithm , 1998, UAI.

[7]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[8]  Mikko Koivisto,et al.  Exact Bayesian Structure Discovery in Bayesian Networks , 2004, J. Mach. Learn. Res..

[9]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[10]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[11]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[12]  D. Dasgupta.  Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[13]  Jonathan Timmis,et al.  Artificial immune systems - a new computational intelligence paradigm , 2002 .

[14]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[15]  G L Ada,et al.  The clonal-selection theory. , 1987, Scientific American.

[16]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[17]  Fernando José Von Zuben,et al.  Copt-aiNet and the Gene Ordering Problem , 2003, WOB.

[18]  Wray L. Buntine.  A Guide to the Literature on Learning Probabilistic Networks from Data , 1996, IEEE Trans. Knowl. Data Eng..

[19]  Jerne Nk.  Towards a network theory of the immune system. , 1974 .

[20]  Michael P. Wellman,et al.  Real-world applications of Bayesian networks , 1995, CACM.