Optimization of feedforward neural network by Multiple Particle Collision Algorithm

Optimization of neural network topology, weights and neuron activation functions for given data set and problem is not an easy task. In this article, a technique for automatic configuration of parameters topology for feedforward artificial neural networks (ANN) is presented. The determination of optimal parameters is formulated as an optimization problem, solved with the use of meta-heuristic Multiple Particle Collision Algorithm (MPCA). The self-configuring networks are applied to predict the mesoscale climate for the precipitation field. The results obtained from the neural network using the method of data reduction by the Theory of Rough Sets and the self-configuring network by MPCA were compared.

[1]  Fernando M. Ramos,et al.  Metaheuristics for the feedforward artificial neural network (ANN) architecture optimization problem , 2011, Neural Computing and Applications.

[2]  Wagner F. Sacco,et al.  A New Stochastic Optimization Algorithm based on a Particle Collision Metaheuristic , 2005 .

[3]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[4]  Geoffrey E. Hinton.  Connectionist Learning Procedures , 1989, Artif. Intell..

[5]  Jan Komorowski,et al.  Modelling prognostic power of cardiac tests using rough sets , 1999, Artif. Intell. Medicine.

[6]  M. Stone.  Cross-validation:a review 2 , 1978 .

[7]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..

[8]  Cláudio M. N. A. Pereira,et al.  Two stochastic optimization algorithms applied to nuclear reactor core design , 2006 .

[9]  Andrzej Skowron,et al.  Rough-Fuzzy Hybridization: A New Trend in Decision Making , 1999 .

[10]  Chaohua Dai,et al.  Seeker optimization algorithm for tuning the structure and parameters of neural networks , 2011, Neurocomputing.

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[13]  Andrzej Skowron,et al.  Rough Sets: A Tutorial , 1998 .

[14]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[15]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[16]  Fevrier Valdez,et al.  Modular Neural Networks architecture optimization with a new nature inspired method using a fuzzy combination of Particle Swarm Optimization and Genetic Algorithms , 2014, Information Sciences.

[17]  Haroldo Fraga de Campos,et al.  A new multi-particle collision algorithm for optimization in a high performance environment , 2008 .

[18]  Celso Marcelo Franklin Lapa,et al.  A Metropolis Algorithm applied to a Nuclear Power Plant Auxiliary Feedwater System surveillance tests policy optimization , 2008 .

[19]  Zhihong Man,et al.  A new robust training algorithm for a class of single-hidden layer feedforward neural networks , 2011, Neurocomputing.