A genetic algorithm for task distribution

A genetic algorithm is presented to assemble tasks to clusters which are performed by neural network modules. Simulations on letter recognition are compared to those obtained by a monolithic network and by a modular architecture with randomly composed clusters. The proposed method proves superior in terms of final convergence speed, generalization and completeness of solutions.

[1]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[2]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[3]  Frank J. Smieja,et al.  The pandemonium system of reflective agents , 1996, IEEE Trans. Neural Networks.

[4]  Hajime Kita,et al.  A multi-sieving neural network architecture that decomposes learning tasks automatically , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[5]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[6]  Sung-Bae Cho,et al.  Fuzzy aggregation of modular neural networks with ordered weighted averaging operators , 1995, Int. J. Approx. Reason..

[7]  Bart L. M. Happel,et al.  Design and evolution of modular neural network architectures , 1994, Neural Networks.

[8]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[9]  Fengchun Peng,et al.  Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Applic , 1996 .

[10]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[11]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[12]  Byoung-Tak Zhang,et al.  Neural networks that teach themselves through genetic discovery of novel examples , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[13]  L. A. Cox.  Combining the probability judgements of experts: statistical and artificial intelligence approaches , 1993 .