Entropy and Correntropy Against Minimum Square Error in Offline and Online Three-Day Ahead Wind Power Forecasting

This paper reports new results in adopting entropy concepts to the training of neural networks to perform wind power prediction as a function of wind characteristics (speed and direction) in wind parks connected to a power grid. Renyi's entropy is combined with a Parzen windows estimation of the error pdf to form the basis of two criteria (minimum entropy and maximum correntropy) under which neural networks are trained. The results are favorably compared in online and offline training with the traditional minimum square error (MSE) criterion. Real case examples for two distinct wind parks are presented.

[1]  F. Massey.  The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[2]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[3]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[4]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[5]  Thibault Langlois,et al.  Parameter adaptation in stochastic optimization , 1999 .

[6]  J. Príncipe,et al.  Information-Theoretic Learning Using Renyi's Quadratic Entropy , 1999 .

[7]  José Carlos Príncipe,et al.  An introduction to information theoretic learning , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[8]  Lars Landberg,et al.  Short-term prediction of the power production from wind farms , 1999 .

[9]  Christian Igel,et al.  Improving the Rprop Learning Algorithm , 2000 .

[10]  M. Lange,et al.  Previento-A Wind Power Prediction System with an Innovative Upscaling Algorithm , 2001 .

[11]  Deniz Erdogmus,et al.  An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems , 2002, IEEE Trans. Signal Process..

[12]  Deniz Erdoğmuş.  INFORMATION THEORETIC LEARNING: RENYI'S ENTROPY AND ITS APPLICATIONS TO ADAPTIVE SYSTEM TRAINING , 2002 .

[13]  Deniz Erdogmus,et al.  Generalized information potential criterion for adaptive system training , 2002, IEEE Trans. Neural Networks.

[14]  Christian Igel,et al.  Empirical evaluation of the improved Rprop learning algorithms , 2003, Neurocomputing.

[15]  J. Usaola,et al.  Benefits for Wind Energy in Electricity Markets from Using Short Term Wind Power Prediction Tools; A Simulation Study , 2004 .

[16]  Pierre Pinson,et al.  Standardizing the Performance Evaluation of Short-Term Wind Power Prediction Models , 2005 .

[17]  J.B. Theocharis,et al.  A fuzzy model for wind speed prediction and power generation in wind parks using spatial correlation , 2004, IEEE Transactions on Energy Conversion.

[18]  John Bjørnar Bremnes,et al.  Probabilistic wind power forecasts using local quantile regression , 2004 .

[19]  José Carlos Príncipe,et al.  Advanced search algorithms for information-theoretic learning with kernel-based estimators , 2004, IEEE Transactions on Neural Networks.

[20]  Deniz Erdoğmuş,et al.  COMPARISON OF ENTROPY AND MEAN SQUARE ERROR CRITERIA IN ADAPTIVE SYSTEM TRAINING USING HIGHER ORDER STATISTICS , 2004 .

[21]  R. Zavadil,et al.  The Role of Wind Forecasting in Grid Operations & Reliability , 2005, 2005 IEEE/PES Transmission & Distribution Conference & Exposition: Asia and Pacific.

[22]  A. Fabbri,et al.  Assessment of the cost associated with wind generation prediction errors in a liberalized electricity market , 2005, IEEE Transactions on Power Systems.

[23]  M. Lange.  On the Uncertainty of Wind Power Predictions—Analysis of the Forecast Accuracy and Statistical Distribution of Errors , 2005 .

[24]  P. P. Pokharel,et al.  Error Entropy, Correntropy and M-Estimation , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[25]  Ismael Sánchez,et al.  Short-term prediction of wind energy production , 2006 .

[26]  E. El-Saadany,et al.  Grey predictor for wind energy conversion systems output power prediction , 2006, IEEE Transactions on Power Systems.

[27]  Vladimiro Miranda,et al.  Training a FIS with EPSO under an Entropy Criterion for Wind Power prediction , 2006, 2006 International Conference on Probabilistic Methods Applied to Power Systems.

[28]  Georges Kariniotakis,et al.  Probabilistic short-term wind power forecasting based on kernel density estimators , 2007 .

[29]  Henrik Madsen,et al.  Robust estimation of time-varying coefficient functions - Application to the modeling of wind power production , 2007 .

[30]  N.D. Hatziargyriou,et al.  An Advanced Statistical Method for Wind Power Forecasting , 2007, IEEE Transactions on Power Systems.

[31]  H. Madsen,et al.  Improvement and automation of tools for short term wind power forecasting , 2007 .

[32]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[33]  Ioannis B. Theocharis,et al.  Locally recurrent neural networks for wind speed prediction using spatial correlation , 2007, Inf. Sci..

[34]  Henrik Madsen,et al.  A review on the young history of the wind power short-term prediction , 2008 .

[35]  Henrik Madsen,et al.  Local linear regression with adaptive orthogonal fitting for the wind power application , 2008, Stat. Comput..

[36]  A. Llombart,et al.  Statistical Analysis of Wind Power Forecast Error , 2008, IEEE Transactions on Power Systems.

[37]  V. Miranda,et al.  Wind Power Forecasting with Entropy-Based Criteria Algorithms , 2008, Proceedings of the 10th International Conference on Probablistic Methods Applied to Power Systems.