The optimal combination: Grammatical swarm, particle swarm optimization and neural networks

Social behaviour is mainly based on swarm colonies, in which each individual shares its knowledge about the environment with other individuals to get optimal solutions. Such co-operative model differs from competitive models in the way that individuals die and are born by combining information of alive ones. This paper presents the particle swarm optimization with differential evolution algorithm in order to train a neural network instead the classic back propagation algorithm. The performance of a neural network for particular problems is critically dependant on the choice of the processing elements, the net architecture and the learning algorithm. This work is focused in the development of methods for the evolutionary design of artificial neural networks. This paper focuses in optimizing the topology and structure of connectivity for these networks.

[1]  John R. Koza,et al.  Genetic Programming IV: Routine Human-Competitive Machine Intelligence , 2003 .

[2]  Gehao Sheng,et al.  A new study in maintenance for transmission lines based on independent component analysis , 2008 .

[3]  M. J. D. Powell,et al.  A tolerant algorithm for linearly constrained optimization calculations , 1989, Math. Program..

[4]  Zoran D. Jelicic,et al.  A theoretical and empirical analysis of convergence related particle swarm optimization , 2009 .

[5]  Peter M. A. Sloot.  The cross-disciplinary road to true computational science , 2010, J. Comput. Sci..

[6]  K. Parsopoulos,et al.  Stretching technique for obtaining global minimizers through Particle Swarm Optimization , 2001 .

[7]  José García-Nieto,et al.  Noiseless functions black-box optimization: evaluation of a hybrid particle swarm with differential operators , 2009, GECCO '09.

[8]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[9]  Wang Zhixin,et al.  Cooperative-PSO-based PID neural network integral control strategy and simulation research with asynchronous motor controller design , 2009 .

[10]  Rainer Storn,et al.  Minimizing the real functions of the ICEC'96 contest by differential evolution , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[11]  Xiaowei Xu,et al.  Social computational systems , 2011, Journal of Computer Science.

[12]  T Jayabarathi,et al.  Hybrid Differential Evolution and Particle Swarm Optimization Based Solutions to Short Term Hydro Thermal Scheduling , 2007 .

[13]  Anthony Brabazon,et al.  Grammatical Swarm: The generation of programs by social programming , 2006, Natural Computing.

[14]  Maarten Keijzer,et al.  Crossover in Grammatical Evolution , 2003, Genetic Programming and Evolvable Machines.

[15]  Tim Hendtlass.  A particle swarm algorithm for high dimensional, multi-optima problem spaces , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[16]  Isaac E. Lagaris,et al.  Program Summary , 1986, PMLA/Publications of the Modern Language Association of America.

[17]  Conor Ryan,et al.  Grammatical evolution , 2001, IEEE Trans. Evol. Comput..

[18]  Sergio Hernández,et al.  An electoral preferences model based on self-organizing maps , 2011, J. Comput. Sci..

[19]  Anthony Brabazon,et al.  Grammatical Swarm , 2004, GECCO.

[20]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[21]  Bassem Jarboui,et al.  A Hybrid Particle Swarm Optimization Algorithm for the Redundancy Allocation Problem , 2010, J. Comput. Sci..

[22]  BoWu,et al.  A new study in maintenance for transmission lines , 2008 .

[23]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[24]  Gary Yen,et al.  Hierarchical Genetic Algorithm for Near-Optimal Feedforward Neural Network Design , 2002, Int. J. Neural Syst..

[25]  Ajith Abraham,et al.  Hybrid differential evolution - Particle Swarm Optimization algorithm for solving global optimization problems , 2008, 2008 Third International Conference on Digital Information Management.

[26]  Haiying Dong,et al.  Transformer fault diagnosis based on reasoning integration of rough set and fuzzy set and Bayesian optimal classifier , 2009 .

[27]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[28]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[29]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 2. The New Algorithm , 1970 .

[30]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[31]  Conor Ryan,et al.  Grammatical evolution , 2007, GECCO '07.

[32]  Juan Julián Merelo Guervós,et al.  Evolving RBF neural networks for time-series forecasting with EvRBF , 2004, Inf. Sci..