An improved radial basis function neural network based on a cooperative coevolutionary algorithm for handwritten digits recognition

Co-evolutionary algorithms are a class of adaptive search meta-heuristics inspired from the mechanism of reciprocal benefits between species in nature. The present work proposes a cooperative co-evolutionary algorithm to improve the performance of a radial basis function neural network (RBFNN) when it is applied to recognition of handwritten Arabic digits. This work is in fact a combination of ten RBFNNs where each of them is considered as an expert classifier in distinguishing one digit from the others; each RBFNN classifier adapts its input features and its structure including the number of centres and their positions based on a symbiotic approach. The set of characteristic features and RBF centres have been considered as dissimilar species where each of them can benefit from the other, imitating in a simplified way the symbiotic interaction of species in nature. Co-evolution is founded on saving the best weights and centres that give the maximum improvement on the sum of squared error of each RBFNN after a number of learning iterations. The results quality has been estimated and compared to other experiments. Results on extracted handwritten digits from the MNIST database show that the co-evolutionary approach is the best.

[1]  Rudolf Paul Wiegand,et al.  An analysis of cooperative coevolutionary algorithms , 2004 .

[2]  John Cartlidge,et al.  Rules of engagement : competitive coevolutionary dynamics in computational systems , 2004 .

[3]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..

[4]  P. Gaur.  Neural networks in data mining , 2018 .

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[7]  Paulien Hogeweg,et al.  Evolutionary Consequences of Coevolving Targets , 1997, Evolutionary Computation.

[8]  K.W.E. Cheng,et al.  Genetic Algorithm-Based RBF Neural Network Load Forecasting Model , 2007, 2007 IEEE Power Engineering Society General Meeting.

[9]  Daniel H. Janzen.  When is it co-evolution , 1980 .

[10]  Ernesto Costa,et al.  SAPPO: A Simple, Adaptable, Predator Prey Optimiser , 2003, EPIA.

[11]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[12]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[13]  J. Urgen Branke.  Evolutionary Algorithms for Neural Network Design and Training , 1995 .

[14]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[15]  Hod Lipson,et al.  Co-Evolutionary Methods in System Design and Analysis , 2005 .