Using the ensemble Kalman filter for electricity load forecasting and analysis

This paper proposes a novel framework for modeling electricity loads; it can be used for both forecasting and analysis. The framework combines the EnKF (ensemble Kalman filter) technique with shrinkage/multiple regression methods. First, SSMs (state-space models) are used to model the load structure, and then the EnKF is used for the estimation. Next, shrinkage/multiple linear regression methods are used to further enhance accuracy. The EnKF allows for the modeling of nonlinear systems in the SSMs, and this gives it great flexibility and detailed analytical information, such as the temperature response rate. We show that the forecasting accuracy of the proposed models is significantly better than that of the current state-of-the-art models, and this method also provides detailed analytical information.

[1]  G. Kitagawa,et al.  A Smoothness Priors–State Space Modeling of Time Series with Trend and Seasonality , 1984 .

[2]  Takeshi Haida.  Study on Daily Electric Load Curve Forecasting Method based on Regression Type Hourly Load Modeling with Yearly Load Trends, Day-types and Insolations , 2009 .

[3]  Bruce A. McElhoe,et al.  An Assessment of the Navigation and Course Corrections for a Manned Flyby of Mars or Venus , 1966, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Seongwon Seo,et al.  Decomposition and statistical analysis for regional electricity demand forecasting , 2012 .

[5]  Kazuhiko Kakamu,et al.  Forecasting electricity demand in Japan: A Bayesian spatial autoregressive ARMA approach , 2010, Comput. Stat. Data Anal..

[6]  Abdul Hanan Abdullah,et al.  Short-term load forecasting using a hybrid model with a refined exponentially weighted fuzzy time series and an improved harmony search , 2014 .

[7]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[8]  Víctor Gómez,et al.  Estimating Potential Output, Core Inflation, and the NAIRU as Latent Variables , 2006 .

[9]  R. Ramanathan,et al.  Short-run forecasts of electricity loads and peaks , 1997 .

[10]  Juan R. Trapero,et al.  Mid-term hourly electricity forecasting based on a multi-rate approach , 2010 .

[11]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[12]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[13]  G. Evensen.  Sampling strategies and square root analysis schemes for the EnKF , 2004 .

[14]  Mathieu David,et al.  Nonlinear Models for Short-time Load Forecasting , 2012 .

[15]  Kadir Kavaklioglu.  Robust electricity consumption modeling of Turkey using Singular Value Decomposition , 2014 .

[16]  Jeffrey L. Anderson.  An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[17]  A. Arabali,et al.  A hybrid short-term load forecasting with a new input selection framework , 2015 .

[18]  J. Friedman.  A VARIABLE SPAN SMOOTHER , 1984 .

[19]  Siem Jan Koopman,et al.  Structural Time Series Models , 2005 .

[20]  P. McSharry,et al.  Short-Term Load Forecasting Methods: An Evaluation Based on European Data , 2007, IEEE Transactions on Power Systems.

[21]  Rahmat-Allah Hooshmand,et al.  Short term electric load forecasting by wavelet transform and grey model improved by PSO (particle swarm optimization) algorithm , 2014 .

[22]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[23]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[24]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[25]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[26]  S. Koopman,et al.  An Hourly Periodic State Space Model for Modelling French National Electricity Load , 2007 .

[27]  Tomoyuki Higuchi,et al.  Maximum likelihood estimation of error covariances in ensemble‐based filters and its application to a coupled atmosphere–ocean model , 2010 .

[28]  M. Clark,et al.  Snow Data Assimilation via an Ensemble Kalman Filter , 2006 .

[29]  G. Kitagawa.  Smoothness priors analysis of time series , 1996 .

[30]  Alireza Khotanzad,et al.  ANNSTLF-Artificial Neural Network Short-Term Load Forecaster- generation three , 1998 .

[31]  R. Buizza,et al.  Using weather ensemble predictions in electricity demand forecasting , 2003 .

[32]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[33]  A. Harvey,et al.  Forecasting Hourly Electricity Demand Using Time-Varying Splines , 1993 .

[34]  Tao Hong,et al.  Short Term Electric Load Forecasting , 2012 .

[35]  Andrew Harvey,et al.  10 Structural time series models , 1993 .

[36]  J. W. Taylor,et al.  Short-Term Load Forecasting With Exponentially Weighted Methods , 2012, IEEE Transactions on Power Systems.

[37]  Emil Pelikán,et al.  An ensemble Kalman filter for short‐term forecasting of tropospheric ozone concentrations , 2005 .

[38]  Jonas Ardö,et al.  Assimilation of land surface temperature into the land surface model JULES with an ensemble Kalman filter , 2010 .

[39]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[40]  Nathan Charlton,et al.  A refined parametric model for short term load forecasting , 2014 .

[41]  Matthew C. Roberts,et al.  Modeling short-run electricity demand with long-term growth rates and consumer price elasticity in commercial and industrial sectors , 2012 .

[42]  A. Andrews,et al.  A square root formulation of the Kalman covariance equations. , 1968 .

[43]  Ionel M. Navon,et al.  The linearization and adjoint of radiation transfer processes in the NMC spectral model part I: Solar radiative transfer , 1996 .

[44]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[45]  Chia-Nan Ko,et al.  Short-term load forecasting using SVR (support vector regression)-based radial basis function neural network with dual extended Kalman filter , 2013 .

[46]  S. Mitter,et al.  Factorization methods for discrete sequential estimation [Book reviews] , 1979, IEEE Transactions on Automatic Control.