Locally recurrent neural networks for wind speed prediction using spatial correlation

This paper deals with the wind speed prediction in wind farms, using spatial information from remote measurement stations. Owing to the temporal complexity of the problem, we employ local recurrent neural networks with internal dynamics, as advanced forecast models. To improve the prediction performance, the training task is accomplished using on-line learning algorithms based on the recursive prediction error (RPE) approach. A global RPE (GRPE) learning scheme is first developed where all adjustable weights are simultaneously updated. In the following, through weight grouping we devise a simplified method, the decoupled RPE (DRPE), with reduced computational demands. The partial derivatives required by the learning algorithms are derived using the adjoint model approach, adapted to the architecture of the networks being used. The efficiency of the proposed approach is tested on a real-world wind farm problem, where multi-step ahead wind speed estimates from 15min to 3h are sought. Extensive simulation results demonstrate that our models exhibit superior performance compared to other network types suggested in the literature. Furthermore, it is shown that the suggested learning algorithms outperform three gradient descent algorithms, in training of the recurrent forecast models.

[1]  Rasit Köker,et al.  Design and performance of an intelligent predictive controller for a six-degree-of-freedom robot using the Elman network , 2006, Inf. Sci..

[2]  Michael T. Manry,et al.  An efficient hidden layer training method for the multilayer perceptron , 2006, Neurocomputing.

[3]  S.m. Chan,et al.  Operations Requirements of Utilites With Wind Power Generation , 1983, IEEE Transactions on Power Apparatus and Systems.

[4]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[5]  Sung-Kwun Oh,et al.  Genetically optimized fuzzy polynomial neural networks , 2006, IEEE Transactions on Fuzzy Systems.

[6]  Seok-Beom Roh,et al.  Genetically optimized fuzzy polynomial neural networks with fuzzy set-based polynomial neurons , 2006, Inf. Sci..

[7]  Ioannis B. Theocharis,et al.  Locally recurrent neural networks for long-term wind speed and power prediction , 2006, Neurocomputing.

[8]  Ah Chung Tsoi,et al.  Locally recurrent globally feedforward networks: a critical review of architectures , 1994, IEEE Trans. Neural Networks.

[9]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[10]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[11]  R. Corotis,et al.  Variance Analysis of Wind Characteristics for Energy Conversion , 1977 .

[12]  Giovanni Soda,et al.  Local Feedback Multilayered Networks , 1992, Neural Computation.

[13]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[14]  J.B. Theocharis,et al.  Locally recurrent neural networks optimal filtering algorithms: application to wind speed prediction using spatial correlation , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[15]  Ah Chung Tsoi,et al.  FIR and IIR Synapses, a New Neural Network Architecture for Time Series Modeling , 1991, Neural Computation.

[16]  Ronald J. Williams,et al.  Training recurrent networks using the extended Kalman filter , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[17]  P. S. Dokopoulos,et al.  Wind speed and power forecasting based on spatial correlation models , 1999 .

[18]  Min Han,et al.  Prediction of chaotic time series based on the recurrent predictor neural network , 2004, IEEE Transactions on Signal Processing.

[19]  Wen Yu,et al.  Nonlinear system identification using discrete-time recurrent neural networks with stable learning algorithms , 2004, Inf. Sci..

[20]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[21]  F. Martín,et al.  A Simple Method for Spatial Interpolation of the Wind in Complex Terrain , 1995 .

[22]  Ioannis B. Theocharis,et al.  A locally recurrent fuzzy neural network with application to the wind speed prediction using spatial correlation , 2007, Neurocomputing.

[23]  M. Yoshimura,et al.  Operations Requirements of Utilities with Wind Power Generation , 1983, IEEE Power Engineering Review.

[24]  U. R. Prasad,et al.  Back propagation through adjoints for the identification of nonlinear dynamic systems using recurrent neural models , 1994, IEEE Trans. Neural Networks.

[25]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[26]  Joachim Luther,et al.  Power fluctuations in spatially dispersed wind turbine systems , 1993 .

[27]  A. A. Chen,et al.  Stochastic simulation and forecasting of hourly average wind speed sequences in Jamaica , 1991 .

[28]  Sung-Kwun Oh,et al.  Self-organizing polynomial neural networks based on polynomial and fuzzy polynomial neurons: analysis and design , 2004, Fuzzy Sets Syst..

[29]  Eric A. Wan,et al.  Diagrammatic Derivation of Gradient Algorithms for Neural Networks , 1996, Neural Computation.

[30]  Danilo P. Mandic,et al.  On the choice of parameters of the cost function in nested modular RNN's , 2000, IEEE Trans. Neural Networks Learn. Syst..

[31]  J.B. Theocharis,et al.  Long-term wind speed and power forecasting using local recurrent neural network models , 2006, IEEE Transactions on Energy Conversion.

[32]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[33]  M. Lotfalian,et al.  Simulation and Assessment of Wind Array Power Variations Based on Simultaneous Wind Speed Measurements , 1984, IEEE Transactions on Power Apparatus and Systems.

[34]  J.B. Theocharis,et al.  A fuzzy model for wind speed prediction and power generation in wind parks using spatial correlation , 2004, IEEE Transactions on Energy Conversion.

[35]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[36]  Zhao Lu,et al.  Adaptive feedback linearization control of chaotic systems via recurrent high-order neural networks , 2006, Inf. Sci..

[37]  Bhaskar D. Rao,et al.  On-line learning algorithms for locally recurrent neural networks , 1999, IEEE Trans. Neural Networks.

[38]  Eric A. Wan,et al.  Temporal backpropagation for FIR neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[39]  Sung-Kwun Oh,et al.  The design of self-organizing neural networks based on PNs and FPNs with the aid of genetic optimization and extended GMDH method , 2006, Int. J. Approx. Reason..

[40]  Heidar Ali Talebi,et al.  A stable neural network-based observer with application to flexible-joint manipulators , 2006, IEEE Transactions on Neural Networks.

[41]  Chih-Min Lin,et al.  Recurrent-neural-network-based adaptive-backstepping control for induction servomotors , 2005, IEEE Transactions on Industrial Electronics.

[42]  Jeen-Shing Wang,et al.  A fully automated recurrent neural network for unknown dynamic system identification and control , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.