A Self-Adaptive Approach for Particle Swarm Optimization Applied to Wind Speed Forecasting

Operational research has made meaningful contributions to practical forecasting in organizations. An area of substantial activity has been in nonlinear modeling. Based on Particle Swarm Optimization, we discuss a nonlinear method where a self-adaptive approach, named as Particle Swarm Optimization with aging and weakening factors, was applied to training a Focused Time Delay Neural Network. Three freely available benchmark datasets were used to demonstrate the features of the proposed approach compared to the Backpropagation algorithm, Differential Evolution and the Particle Swarm Optimization method when applied for training the artificial neural network. Even acknowledging that the effort in comparing methods across multiple empirical datasets is certainly substantial, the proposed algorithm was used to produce 30 min, 1, 3 and 6 h ahead predictions of wind speed at one site in Brazil. The use of the proposed algorithm goes further than only training the artificial neural network, but also searching the best number of hidden neurons and number of lags. The results have shown that the modified Particle Swarm Optimization algorithm obtained better results in all predictions horizons, and the use of it has remarkably reduced the training time.

[1]  Halife Kodaz,et al.  A novel parallel multi-swarm algorithm based on comprehensive learning particle swarm optimization , 2015, Eng. Appl. Artif. Intell..

[2]  Muhammad Bashar Anwar,et al.  Wind speed and solar irradiance forecasting techniques for enhanced renewable energy integration with the grid: a review , 2016 .

[3]  Nor Ashidi Mat Isa,et al.  Particle swarm optimization with increasing topology connectivity , 2014, Eng. Appl. Artif. Intell..

[4]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  Hui Liu,et al.  Wind speed forecasting approach using secondary decomposition algorithm and Elman neural networks , 2015 .

[6]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  Yongbo Wang,et al.  A hybrid differential evolution and particle swarm optimization algorithm for numerical kinematics solution of remote maintenance manipulators , 2017 .

[8]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[9]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[10]  Wei-Chang Yeh,et al.  New Parameter-Free Simplified Swarm Optimization for Artificial Neural Network Training and its Application in the Prediction of Time Series , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[11]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[12]  Leonid A. Gavrilov,et al.  Evolutionary Theories of Aging and Longevity , 2002, TheScientificWorldJournal.

[13]  Harish Garg,et al.  A hybrid PSO-GA algorithm for constrained optimization problems , 2016, Appl. Math. Comput..

[14]  Juan Humberto Sossa Azuela,et al.  Dendrite Morphological Neural Networks trained by Differential Evolution , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[15]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[16]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[17]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[18]  S. Shamsuddin,et al.  Fusion Global-Local-Topology Particle Swarm Optimization for Global Optimization Problems , 2014 .

[19]  Adel M. Alimi,et al.  The multi-objective hybridization of particle swarm optimization and fuzzy ant colony optimization , 2014, J. Intell. Fuzzy Syst..

[20]  T. C. Goldsmith,et al.  The Evolution Of Aging , 2003 .

[21]  August Weismann,et al.  Ueber die Dauer des Lebens , 2008 .

[22]  Licheng Jiao,et al.  A coevolutionary technique based on multi-swarm particle swarm optimization for dynamic multi-objective optimization , 2017, Eur. J. Oper. Res..

[23]  Gregor Giebel,et al.  The State-Of-The-Art in Short-Term Prediction of Wind Power. A Literature Overview , 2003 .

[24]  Yudong Zhang,et al.  A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications , 2015 .

[25]  K. Taylor Summarizing multiple aspects of model performance in a single diagram , 2001 .

[26]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[27]  Yang Mao,et al.  A review of wind power forecasting & prediction , 2016, 2016 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS).

[28]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[29]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[30]  T. C. Goldsmith,et al.  Aging as an evolved characteristic - Weismann's theory reconsidered. , 2004, Medical hypotheses.

[31]  Jian Zhang,et al.  A Novel Short-Term Wind Speed Prediction Based on MFEC , 2016, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[32]  Hübner,et al.  Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser. , 1989, Physical review. A, General physics.

[33]  Li-Chiu Chang,et al.  Reinforced Two-Step-Ahead Weight Adjustment Technique for Online Training of Recurrent Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[34]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[35]  Hamzah Arof,et al.  Minimum-features-based ANN-PSO approach for islanding detection in distribution system , 2016 .