Evolving RBF neural networks for rainfall prediction using hybrid particle swarm optimization and genetic algorithm

Abstract In this paper, an effective hybrid optimization strategy by incorporating the adaptive optimization of particle swarm optimization (PSO) into genetic algorithm (GA), namely HPSOGA, is used for determining the parameters of radial basis function neural networks (number of neurons, their respective centers and radii) automatically. While this task depends upon operator׳s experience with trial and error due to lack of prior knowledge, or based on gradient algorithms which are highly dependent on initial values. In this paper, hybrid evolutionary algorithms are used to automatically build a radial basis function neural networks (RBF-NN) that solves a specified problem, related to rainfall forecasting in this case. In HPSOGA, individuals in a new generation are created through three approaches to improve the global optimization performance, which are elitist strategy, PSO strategy and GA strategy. The upper-half of the best-performing individuals in a population are regarded as elites, whereas the half of the worst-performing individuals are regarded as a swarm. The group constituted by the elites are enhanced by selection, crossover and mutation operation on these enhanced elites. HPSOGA is applied to RBF-NN design for rainfall prediction. The performance of HPSOGA is compared to pure GA in these basis function neural networks design problems, showing that the hybrid strategy is of more effective global exploration ability and to avoid premature convergence. Our findings reveal that the hybrid optimization strategy proposed here may be used as a promising alternative forecasting tool for higher forecasting accuracy and better generalization ability.

[1]  Héctor Pomares,et al.  A deterministic model selection scheme for incremental RBFNN construction in time series forecasting , 2010, Neural Computing and Applications.

[2]  James Kennedy The Particle Swarm as Collaborative Sampling of the Search Space , 2007, Adv. Complex Syst..

[3]  Marco Tomassini,et al.  Evolutionary Algorithms , 1995, Towards Evolvable Hardware.

[4]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[5]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[6]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[7]  LiShutao,et al.  Gene selection using hybrid particle swarm optimization and genetic algorithm , 2008, SOCO 2008.

[8]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[9]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Long Jin,et al.  A Hybrid Support Vector Regression Approach for Rainfall Forecasting Using Particle Swarm Optimization and Projection Pursuit Technology , 2010, Int. J. Comput. Intell. Appl..

[11]  Héctor Pomares,et al.  An enhanced clustering function approximation technique for a radial basis function neural network , 2012, Math. Comput. Model..

[12]  W. Light Some Aspects of Radial Basis Function Approximation , 1992 .

[13]  Jiansheng Wu,et al.  Prediction of Rainfall Time Series Using Modular RBF Neural Network Model Coupled with SSA and PLS , 2012, ACIIDS.

[14]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[15]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[16]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[17]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[18]  Ginés Rubio,et al.  Applying multiobjective RBFNNs optimization and feature selection to a mineral reduction problem , 2010, Expert Syst. Appl..

[19]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[20]  Shutao Li,et al.  Gene selection using hybrid particle swarm optimization and genetic algorithm , 2008, Soft Comput..

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  Hong Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks , 1993, IEEE Trans. Neural Networks.

[23]  Reinhard Teschl,et al.  Improving weather radar estimates of rainfall using feed-forward neural networks , 2007, Neural Networks.

[24]  Enrico Zio,et al.  A particle swarm‐optimized support vector machine for reliability prediction , 2012, Qual. Reliab. Eng. Int..

[25]  Long Jin,et al.  Modeling Meteorological Prediction Using Particle Swarm Optimization and Neural Network Ensemble , 2006, ISNN.

[26]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[27]  Mohsen Nasseri,et al.  Optimized scenario for rainfall forecasting using genetic algorithm coupled with artificial neural network , 2008, Expert Syst. Appl..

[28]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[29]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[30]  Ashu Jain,et al.  Hybrid neural network models for hydrologic time series forecasting , 2007, Appl. Soft Comput..

[31]  Driss Ouazar,et al.  Evolving neural network using real coded genetic algorithm for daily rainfall-runoff forecasting , 2009, Expert Syst. Appl..

[32]  Ivica Kostanic,et al.  Principles of Neurocomputing for Science and Engineering , 2000 .

[33]  Wei-Chiang Hong,et al.  Rainfall forecasting by technological machine learning models , 2008, Appl. Math. Comput..

[34]  Xin Yao,et al.  Evolutionary computation : theory and applications , 1999 .