Design of Artificial Neural Networks Using Differential Evolution Algorithm

The design of an Artificial Neural Network (ANN) is a difficult task for it depends on the human experience. Moreover it needs a process of testing and error to select which kind of a transfer function and which algorithm should be used to adjusting the synaptic weights in order to solve a specific problem. In the last years, bio-inspired algorithms have shown their power in different nonlinear optimization problems. Due to their efficiency and adaptability, in this paper we explore a new methodology to automatically design an ANN based on the Differential Evolution (DE) algorithm. The proposed method is capable to find the topology, the synaptic weights and the transfer functions to solve a given pattern classification problems.

[1]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  James A. Anderson,et al.  An Introduction To Neural Networks , 1998 .

[4]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[5]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Lifeng Xi,et al.  An Improved Particle Swarm Optimization for Evolving Feedforward Artificial Neural Networks , 2007, Neural Processing Letters.

[8]  Tamás D. Gedeon,et al.  A comparison: Fuzzy signatures and Choquet Integral , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[9]  Kiyotaka Izumi,et al.  A particle-swarm-optimized fuzzy-neural network for voice-controlled robot systems , 2005, IEEE Transactions on Industrial Electronics.

[10]  Liang Zhao,et al.  PSO-based single multiplicative neuron model for time series prediction , 2009, Expert Syst. Appl..

[11]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[12]  Zhiwei Wang,et al.  Particle swarm optimization and neural network application for QSAR , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[13]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[14]  H. M. Abdul,et al.  Neural Networks Training Based on Differential Evolution Algorithm Compared with Other Architectures for Weather Forecasting34 , 2009 .

[15]  Ge Xiurun,et al.  An improved PSO-based ANN with simulated annealing technique , 2005, Neurocomputing.

[16]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[17]  Kwok-wing Chau,et al.  Application of a PSO-based neural network in analysis of outcomes of construction claims , 2007 .

[18]  Juan Humberto Sossa Azuela,et al.  Design of artificial neural networks using a modified Particle Swarm Optimization algorithm , 2009, 2009 International Joint Conference on Neural Networks.

[19]  Ning Gui-Ying,et al.  A Modified Differential Evolution Algorithm for Optimization Neural Network , 2007 .