Refined Diebold-Mariano Test Methods for the Evaluation of Wind Power Forecasting Models

The scientific evaluation methodology for the forecast accuracy of wind power forecasting models is an important issue in the domain of wind power forecasting. However, traditional forecast evaluation criteria, such as Mean Squared Error (MSE) and Mean Absolute Error (MAE), have limitations in application to some degree. In this paper, a modern evaluation criterion, the Diebold-Mariano (DM) test, is introduced. The DM test can discriminate the significant differences of forecasting accuracy between different models based on the scheme of quantitative analysis. Furthermore, the augmented DM test with rolling windows approach is proposed to give a more strict forecasting evaluation. By extending the loss function to an asymmetric structure, the asymmetric DM test is proposed. Case study indicates that the evaluation criteria based on DM test can relieve the influence of random sample disturbance. Moreover, the proposed augmented DM test can provide more evidence when the cost of changing models is expensive, and the proposed asymmetric DM test can add in the asymmetric factor, and provide practical evaluation of wind power forecasting models. It is concluded that the two refined DM tests can provide reference to the comprehensive evaluation for wind power forecasting models.

[1]  Heping Liu,et al.  Comprehensive evaluation of ARMA–GARCH(-M) approaches for modeling the mean and volatility of wind speed , 2011 .

[2]  G. Galanisa,et al.  Improvements in wind speed forecasts for wind power prediction purposes using Kalman filtering , 2006 .

[3]  R. Buizza,et al.  Wind Power Density Forecasting Using Ensemble Predictions and Time Series Models , 2009, IEEE Transactions on Energy Conversion.

[4]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[5]  N. Wermuth,et al.  Nonlinear Time Series: Nonparametric and Parametric Methods , 2005 .

[6]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[7]  Quetzalcoatl Hernandez-Escobedo,et al.  Is the wind a periodical phenomenon? The case of Mexico , 2011 .

[8]  M. Lange,et al.  Physical Approach to Short-Term Wind Power Prediction , 2005 .

[9]  Fangxing Li,et al.  Short term load forecasting using regime-switching GARCH models , 2011, 2011 IEEE Power and Energy Society General Meeting.

[10]  Maria Grazia De Giorgi,et al.  Error analysis of short term wind power prediction models , 2011 .

[11]  Quetzalcoatl Hernandez-Escobedo,et al.  The wind power of Mexico , 2010 .

[12]  Q. Hernández-Escobedo,et al.  Wind energy resource in Northern Mexico , 2014 .

[13]  Ruey S. Tsay,et al.  An Introduction to Analysis of Financial Data with R , 2012 .

[14]  P. S. Dokopoulos,et al.  Wind speed and power forecasting based on spatial correlation models , 1999 .

[15]  Consolación Gil,et al.  Scientific production of renewable energies worldwide: An overview , 2013 .

[16]  Fangxing Li,et al.  GARCH in mean type models for wind power forecasting , 2013, 2013 IEEE Power & Energy Society General Meeting.

[17]  Xiao Yang,et al.  WIND SPEED AND GENERATED POWER FORECASTING IN WIND FARM , 2005 .

[18]  J. Torres,et al.  Forecast of hourly average wind speed with ARMA models in Navarre (Spain) , 2005 .

[19]  Hui Liu,et al.  Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks , 2013 .

[20]  Jianxue Wang,et al.  Review on probabilistic forecasting of wind power generation , 2014 .

[21]  Lu Zongxiang.  A Comprehensive Error Evaluation Method for Short-term Wind Power Prediction , 2011 .