ELMAN Neural Network with Modified Grey Wolf Optimizer for Enhanced Wind Speed Forecasting

The scope of this paper is to forecast wind speed. Wind speed, temperature, wind direction, relative humidity, precipitation of water content and air pressure are the main factors make the wind speed forecasting as a complex problem and neural network performance is mainly influenced by proper hidden layer neuron units. This paper proposes new criteria for appropriate hidden layer neuron unit’s determination and attempts a novel hybrid method in order to achieve enhanced wind speed forecasting. This paper proposes the following two main innovative contributions 1) both either over fitting or under fitting issues are avoided by means of the proposed new criteria based hidden layer neuron unit’s estimation. 2) ELMAN neural network is optimized through Modified Grey Wolf Optimizer (MGWO). The proposed hybrid method (ELMAN-MGWO) performance, effectiveness is confirmed by means of the comparison between Grey Wolf Optimizer (GWO), Adaptive Gbest-guided Gravitational Search Algorithm (GGSA), Artificial Bee Colony (ABC), Ant Colony Optimization (ACO), Cuckoo Search (CS), Particle Swarm Optimization (PSO), Evolution Strategy (ES), Genetic Algorithm (GA) algorithms, meanwhile proposed new criteria effectiveness and precise are verified comparison with other existing selection criteria. Three real-time wind data sets are utilized in order to analysis the performance of the proposed approach. Simulation results demonstrate that the proposed hybrid method (ELMAN-MGWO) achieve the mean square error AVG ± STD of 4.1379e-11 ± 1.0567e-15, 6.3073e-11 ± 3.5708e-15 and 7.5840e-11 ± 1.1613e-14 respectively for evaluation on three real-time data sets. Hence, the proposed hybrid method is superior, precise, enhance wind speed forecasting than that of other existing methods and robust.

[1]  Ingo Rechenberg,et al.  Evolutionsstrategie '94 , 1994, Werkstatt Bionik und Evolutionstechnik.

[2]  Hao Yu,et al.  Selection of Proper Neural Network Sizes and Architectures—A Comparative Study , 2012, IEEE Transactions on Industrial Informatics.

[3]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[4]  Masahiko Arai,et al.  Bounds on the number of hidden units in binary-valued three-layer neural networks , 1993, Neural Networks.

[5]  David W. Corne,et al.  Short term wind speed forecasting with evolved neural networks , 2013, GECCO.

[6]  S. N. Deepa,et al.  A novel criterion to select hidden neuron numbers in improved back propagation networks for wind speed forecasting , 2016, Applied Intelligence.

[7]  Christian Blum,et al.  An ant colony optimization algorithm for continuous optimization: application to feed-forward neural network training , 2007, Neural Computing and Applications.

[8]  S. N. Deepa,et al.  Performance Investigation of Six Artificial Neural Networks for Different Time Scale Wind Speed Forecasting in Three Wind Farms of Coimbatore Region , 2016 .

[9]  Katsunari Shibata,et al.  Effect of number of hidden neurons on learning in large-scale layered neural networks , 2009, 2009 ICCAS-SICE.

[10]  Yixian Yang,et al.  Bounds on the number of hidden neurons in three-layer binary neural networks , 2003, Neural Networks.

[11]  Jianzhou Wang,et al.  Forecasting wind speed using empirical mode decomposition and Elman neural network , 2014, Appl. Soft Comput..

[12]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[13]  Guo Qian,et al.  Forecasting the Rural Per Capita Living Consumption Based on Matlab BP Neural Network , 2013 .

[14]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[15]  F. W. Kellaway,et al.  Advanced Engineering Mathematics , 1969, The Mathematical Gazette.

[16]  Guang-Bin Huang,et al.  Neuron selection for RBF neural network classifier based on data structure preserving criterion , 2005, IEEE Transactions on Neural Networks.

[17]  T.W.S. Chow,et al.  The estimation theory and optimization algorithm for the number of hidden units in the higher-order feedforward neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[18]  Osamu Fujita,et al.  Statistical estimation of the number of hidden units for feedforward neural networks , 1998, Neural Networks.

[19]  Shuxiang Xu,et al.  A novel approach for determining the optimal number of hidden layer neurons for FNN’s and its application in data mining , 2008 .

[20]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[21]  Liu Hongmei,et al.  Fault Diagnosis Based on Improved Elman Neural Network for a Hydraulic Servo System , 2006, 2006 IEEE Conference on Robotics, Automation and Mechatronics.

[22]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[23]  Faa-Jeng Lin,et al.  FPGA-based Elman neural network control system for linear ultrasonic motor. , 2009, IEEE transactions on ultrasonics, ferroelectrics, and frequency control.

[24]  Jinchuan Ke,et al.  Empirical Analysis of Optimal Hidden Neurons in Neural Network Modeling for Stock Prediction , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[25]  Chengxiong Mao,et al.  Wind speed prediction based on the Elman recursion neural networks , 2010, Proceedings of the 2010 International Conference on Modelling, Identification and Control.

[26]  Xiang Li,et al.  Chaotifying linear Elman networks , 2002, IEEE Trans. Neural Networks.

[27]  Shin'ichi Tamura,et al.  Capabilities of a four-layered feedforward neural network: four layers versus three , 1997, IEEE Trans. Neural Networks.

[28]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[29]  I. Kanellopoulos,et al.  Strategies and best practice for neural network image classification , 1997 .

[30]  Zaccheus O. Olaofe,et al.  A 5-day wind speed & power forecasts using a layer recurrent neural network (LRNN) , 2014 .

[31]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[32]  K. Gnana Sheela,et al.  Review on Methods to Fix Number of Hidden Neurons in Neural Networks , 2013 .

[33]  Qing Cao,et al.  Forecasting wind speed with recurrent neural networks , 2012, Eur. J. Oper. Res..

[34]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[35]  Yin Dong-yan.  Short-term wind speed forecasting using Elman neural network based on rough set theory and principal components analysis , 2014 .

[36]  Stephan Trenn,et al.  Multilayer Perceptrons: Approximation Order and Necessary Number of Hidden Units , 2008, IEEE Transactions on Neural Networks.