Probabilistic Forecasting of Battery Energy Storage State-of-Charge under Primary Frequency Control

Multi-service market optimization of battery energy storage system (BESS) requires assessing the forecasting uncertainty arising from coupled resources and processes. For the primary frequency control (PFC), which is one of the highest-value applications of BESS, this uncertainty is linked to the changes of BESS state-of-charge (SOC) under stochastic frequency variations. In order to quantify this uncertainty, this paper aims to exploit one of the recent achievements in the field of deep learning, i.e. multi-attention recurrent neural network (MARNN), for BESS SOC forecasting under PFC. Furthermore, we extend the MARNN model for probabilistic forecasting with a hybrid approach combining Mixture Density Networks and Monte Carlo dropout that incorporate the uncertainties of the data noise and the model parameters in the form of prediction interval (PI). The performance of the model is studied on BESS SOC datasets that are simulated based on real frequency measurements from three European synchronous areas in Great Britain, Continental Europe, and Northern Europe and validated by three PI evaluation indexes. Compared with the state-of-the-art quantile regression algorithms, the proposed hybrid model performed well with respect to the coverage probability of PIs for the different regulatory environments of the PFC.

[1]  Johanna L. Mathieu,et al.  Scheduling distributed energy storage units to provide multiple services under forecast error , 2015 .

[2]  Saeid Nahavandi,et al.  Constructing Optimal Prediction Intervals by Using Neural Networks and Bootstrap Method , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Arto Kaarna,et al.  Multi-Timescale Forecasting of Battery Energy Storage State-of-Charge under Frequency Containment Reserve for Normal Operation , 2019, 2019 16th International Conference on the European Energy Market (EEM).

[4]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[5]  Raymond H. Byrne,et al.  Energy Management and Optimization Methods for Grid Energy Storage Systems , 2018, IEEE Access.

[6]  Remus Teodorescu,et al.  Selection and Performance-Degradation Modeling of LiMO$_{2}$/Li$_{4}$Ti$_{5}$O $_{12}$ and LiFePO $_{4}$/C Battery Cells as Suitable Energy Storage Systems for Grid Integration With Wind Power Plants: An Example for the Primary Frequency Regulation Service , 2014, IEEE Transactions on Sustainable Energy.

[7]  Reza Kheirollahi,et al.  Point and interval forecasting of real-time and day-ahead electricity prices by a novel hybrid approach , 2017 .

[8]  Nicolai Meinshausen,et al.  Quantile Regression Forests , 2006, J. Mach. Learn. Res..

[9]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[10]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[11]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[12]  Thomas Mercier Storage-Based Frequency Control and Grid-Frequency Deviations Forecasting , 2016 .

[13]  Songfeng Zheng,et al.  Boosting Based Conditional Quantile Estimation for Regression and Binary Classification , 2010, MICAI.

[14]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[15]  Pierre Pinson,et al.  Very Short-Term Nonparametric Probabilistic Forecasting of Renewable Energy Generation— With Application to Solar Energy , 2016, IEEE Transactions on Power Systems.

[16]  Taher Niknam,et al.  Probabilistic Load Forecasting Using an Improved Wavelet Neural Network Trained by Generalized Extreme Learning Machine , 2018, IEEE Transactions on Smart Grid.

[17]  Tao Hong,et al.  Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting , 2019, International Journal of Forecasting.

[18]  Zhi Zhou,et al.  A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast , 2019, IEEE Transactions on Power Systems.

[19]  Mohammad Yusri Hassan,et al.  Probabilistic wind power forecasting using weather ensemble models , 2018, 2018 IEEE/IAS 54th Industrial and Commercial Power Systems Technical Conference (I&CPS).

[20]  Kit Po Wong,et al.  A Hybrid Approach for Probabilistic Forecasting of Electricity Price , 2014, IEEE Transactions on Smart Grid.

[21]  David D. Cox,et al.  Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms , 2013, SciPy.

[22]  Tao Hong,et al.  Probabilistic electric load forecasting: A tutorial review , 2016 .

[23]  Mario Paolone,et al.  Control of Battery Storage Systems for the Simultaneous Provision of Multiple Services , 2018, IEEE Transactions on Smart Grid.

[24]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[25]  Joakim Widén,et al.  Review on probabilistic forecasting of photovoltaic power production and electricity consumption , 2018 .

[26]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[27]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[28]  Jo Bovy,et al.  Deep learning of multi-element abundances from high-resolution spectroscopic data , 2018, Monthly Notices of the Royal Astronomical Society.

[29]  Andreas Jossen,et al.  Lithium-Ion Battery Storage for the Grid—A Review of Stationary Battery Storage System Design Tailored for Applications in Modern Power Grids , 2017 .

[30]  Hamidreza Zareipour,et al.  Operation Scheduling of Battery Storage Systems in Joint Energy and Ancillary Services Markets , 2017, IEEE Transactions on Sustainable Energy.

[31]  Mazin T. Muhssin,et al.  Frequency control of future power systems: reviewing and evaluating challenges and new control methods , 2018, Journal of Modern Power Systems and Clean Energy.

[32]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[33]  Jean-François Toubeau,et al.  Deep Learning-Based Multivariate Probabilistic Forecasting for Short-Term Scheduling in Power Markets , 2019, IEEE Transactions on Power Systems.

[34]  S. Srihari Mixture Density Networks , 1994 .

[35]  Ed H. Chi,et al.  AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks , 2019, ICLR.

[36]  Thomas Erge,et al.  Fast Frequency Response with BESS: A Comparative Analysis of Germany, Great Britain and Sweden , 2018, 2018 15th International Conference on the European Energy Market (EEM).

[37]  Jianzhong Wu,et al.  Primary Frequency Response From Electric Vehicles in the Great Britain Power System , 2013, IEEE Transactions on Smart Grid.

[38]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[39]  Goran Andersson,et al.  Impact of Low Rotational Inertia on Power System Stability and Operation , 2013, 1312.6435.

[40]  John Tran,et al.  cuDNN: Efficient Primitives for Deep Learning , 2014, ArXiv.

[41]  Rob J Hyndman,et al.  Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond , 2016 .

[42]  Goran Strbac,et al.  A MILP model for optimising multi-service portfolios of distributed energy storage , 2015 .

[43]  Tao Hong,et al.  Probabilistic Load Forecasting via Quantile Regression Averaging on Sister Forecasts , 2017, IEEE Transactions on Smart Grid.

[44]  James W. Taylor A Quantile Regression Neural Network Approach to Estimating the Conditional Density of Multiperiod Returns , 2000 .

[45]  Jianxue Wang,et al.  Review on probabilistic forecasting of wind power generation , 2014 .

[46]  Di Wang,et al.  Using Battery Storage for Peak Shaving and Frequency Regulation: Joint Optimization for Superlinear Gains , 2017, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[47]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[48]  R. Koenker,et al.  Regression Quantiles , 2007 .

[49]  B. Nykvist,et al.  Rapidly falling costs of battery packs for electric vehicles , 2015 .

[50]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[51]  Qi Wang,et al.  Prediction Model of the Power System Frequency Using a Cross-Entropy Ensemble Algorithm , 2017, Entropy.

[52]  Zoubin Ghahramani,et al.  A Theoretically Grounded Application of Dropout in Recurrent Neural Networks , 2015, NIPS.

[53]  Aleksei Romanenko,et al.  Hyper-parameter Optimization of Multi-attention Recurrent Neural Network for Battery State-of-Charge Forecasting , 2019, EPIA.

[54]  Hoay Beng Gooi,et al.  Penetration Rate and Effectiveness Studies of Aggregated BESS for Frequency Regulation , 2016, IEEE Transactions on Smart Grid.

[55]  Ha Thi Nguyen Frequency Characterization and Control for Future Low Inertia Systems , 2018 .

[56]  R. Weron,et al.  Recent advances in electricity price forecasting: A review of probabilistic forecasting , 2016 .