Hyper-parameter Optimization of Multi-attention Recurrent Neural Network for Battery State-of-Charge Forecasting

In the past years, a rapid deployment of battery energy storage systems for diverse smart grid services has been seen in electric power systems. However, a cost-effective and multi-objective application of these services necessitates a utilization of forecasting methods for a development of efficient capacity allocation and risk management strategies over the uncertainty of battery state-of-charge. The aim of this paper is to assess the tuning efficiency of multi-attention recurrent neural network for multi-step forecasting of battery state-of-charge under provision of primary frequency control. In particular, this paper describes hyper-parameter optimization of the network with a tree-structured parzen estimator and compares such optimization performance with random and manual search on a simulated battery state-of-charge dataset. The experimental results demonstrate that the tree-structured parzen estimator enables 0.6% and 1.5% score improvement for the dataset compared with the random and manual search, respectively.

[1]  Mazin T. Muhssin,et al.  Frequency control of future power systems: reviewing and evaluating challenges and new control methods , 2018, Journal of Modern Power Systems and Clean Energy.

[2]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[3]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[4]  Aslam Muhammad,et al.  Deep Learning Application in Power System with a Case Study on Solar Irradiation Forecasting , 2019, 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[5]  Amit Kumar,et al.  Analyzing Effect of System Inertia on Grid Frequency Forecasting Usnig Two Stage Neuro-Fuzzy System , 2018 .

[6]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[7]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[8]  Jean-François Toubeau,et al.  Deep Learning-Based Multivariate Probabilistic Forecasting for Short-Term Scheduling in Power Markets , 2019, IEEE Transactions on Power Systems.

[9]  Danting Dong,et al.  Wind Power Prediction Based on Recurrent Neural Network with Long Short-Term Memory Units , 2018, 2018 International Conference on Renewable Energy and Power Engineering (REPE).

[10]  Andreas Jossen,et al.  Lithium-Ion Battery Storage for the Grid—A Review of Stationary Battery Storage System Design Tailored for Applications in Modern Power Grids , 2017 .

[11]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[12]  Juha Haakana,et al.  Methodology to Define a BESS Operating Strategy for the End-Customer in the Changing Business Environment , 2018, 2018 15th International Conference on the European Energy Market (EEM).

[13]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[14]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[15]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[16]  Andreas Jossen,et al.  Evaluation of grid-level adaptability for stationary battery energy storage system applications in Europe , 2016 .