Artificial neural network synthesis by means of artificial bee colony (ABC) algorithm

Artificial bee colony (ABC) algorithm has been used in several optimization problems, including the optimization of synaptic weights from an Artificial Neural Network (ANN). However, this is not enough to generate a robust ANN. For that reason, some authors have proposed methodologies based on so-called metaheuristics that automatically allow designing an ANN, taking into account not only the optimization of the synaptic weights as well as the ANN's architecture, and the transfer function of each neuron. However, those methodologies do not generate a reduced design (synthesis) of the ANN. In this paper, we present an ABC based methodology, that maximizes its accuracy and minimizes the number of connections of an ANN by evolving at the same time the synaptic weights, the ANN's architecture and the transfer functions of each neuron. The methodology is tested with several pattern recognition problems.

[1]  Dervis Karaboga,et al.  A survey: algorithms simulating bee swarm intelligence , 2009, Artificial Intelligence Review.

[2]  V. Tereshko,et al.  Collective Decision-Making in Honey Bee Foraging Dynamics , 2005 .

[3]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[4]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[5]  Duc Truong Pham,et al.  OPTIMIZATION OF THE WEIGHTS OF MULTI-LAYERED PERCEPTIONS USING THE BEES ALGORITHM , 2006 .

[6]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[7]  D. Karaboga,et al.  Artificial Bee Colony (ABC) Algorithm on Training Artificial Neural Networks , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[10]  Erkan Besdok,et al.  A Comparison of RBF Neural Network Training Algorithms for Inertial Sensor Based Terrain Classification , 2009, Sensors.

[11]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[12]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks , 2007, MDAI.

[13]  Juan Humberto Sossa Azuela,et al.  Design of artificial neural networks using a modified Particle Swarm Optimization algorithm , 2009, 2009 International Joint Conference on Neural Networks.

[14]  Juan Humberto Sossa Azuela,et al.  Design of Artificial Neural Networks Using Differential Evolution Algorithm , 2010, ICONIP.

[15]  O. Kisi,et al.  Neural networks with artificial bee colony algorithm for modeling daily reference evapotranspiration , 2011, Irrigation Science.

[16]  Derviş Karaboğa,et al.  NEURAL NETWORKS TRAINING BY ARTIFICIAL BEE COLONY ALGORITHM ON PATTERN CLASSIFICATION , 2009 .

[17]  D.T. Pham,et al.  Optimising Neural Networks for Identification of Wood Defects Using the Bees Algorithm , 2006, 2006 4th IEEE International Conference on Industrial Informatics.