Modeling Meteorological Prediction Using Particle Swarm Optimization and Neural Network Ensemble

In this paper a novel optimization approach is presented. Network architecture and connection weights of neural networks (NN) are evolved by a particle swarm optimization (PSO) method, and then the appropriate network architecture and connection weights are fed into back-propagation (BP) networks. The ensemble strategy is carried out by simple averaging. The applied example is built with monthly mean rainfall of the whole area in Guangxi, China. The results show that the proposed approach can effectively improves convergence speed and generalization ability of NN.

[1]  J. Kennedy,et al.  Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  W. Hsieh.  Nonlinear Canonical Correlation Analysis of the Tropical Pacific Climate Variability Using a Neural Network Approach , 2001 .

[3]  Nathan Intrator,et al.  Classification of seismic signals by integrating ensembles of neural networks , 1998, IEEE Trans. Signal Process..

[4]  Qin,et al.  Study on the Overfitting of the Artificial Neural Network Forecasting Model , 2004 .

[5]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[6]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Harry Wechsler,et al.  Face recognition using hybrid classifier systems , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[8]  Miao Qilong,et al.  Study on ann-based multi-step prediction model of short-term climatic variation , 2000 .

[9]  Anders Krogh,et al.  Learning with ensembles: How overfitting can be useful , 1995, NIPS.

[10]  Zhi-Hua Zhou,et al.  Spiculated Lesion Detection in Digital Mammogram Based on Artificial Neural Network Ensemble , 2005, ISNN.

[11]  G. Theraulaz,et al.  Inspiration for optimization from social insect behaviour , 2000, Nature.

[12]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[13]  R. Vautard,et al.  Singular-spectrum analysis: a toolkit for short, noisy chaotic signals , 1992 .

[14]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jianchang Mao,et al.  A case study on bagging, boosting and basic ensembles of neural networks for OCR , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[16]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[17]  B. Fiedler,et al.  Forecasting Warm-Season Burnoff of Low Clouds at the San Francisco International Airport Using Linear Regression and a Neural Network , 2002 .