Adaptive load forecasting using reinforcement learning with database technology

ABSTRACT Load forecasting is an essential operation in the power utility industry. However, a common challenge is faced for adjusting forecasting models to fit the need for substations’ load prediction as well as minimizing expenditure in IT resources for repurposing these forecasting models to bigger datasets. The goal of this paper is to propose a novel solution that is responsive to these demands through the integration of reinforcement learning with load forecasting on existing database technology. To deal with the varying accuracy of the forecasting models on different substations’ loads, the proposed solution compares and uses the best models and recalibrate them iteratively by comparing the model’s prediction against the actual load data. As shown in empirical analysis, the solution interacts with the environment and performs the optimum forecasting routine intuitively.

[1]  Seongwon Seo,et al.  Decomposition and statistical analysis for regional electricity demand forecasting , 2012 .

[2]  L. Pazvakawambwa,et al.  Forecasting methods and applications. , 2013 .

[3]  Nrusimham Ammu,et al.  Big Data Challenges , 2013 .

[4]  S. Fan,et al.  Short-term load forecasting based on an adaptive hybrid method , 2006, IEEE Transactions on Power Systems.

[5]  Krishna Kunchithapadam,et al.  Oracle database filesystem , 2011, SIGMOD '11.

[6]  Abdelhamid Mellouk,et al.  Advances in Reinforcement Learning , 2011 .

[7]  Martin Bach Expert Consolidation in Oracle Database 12c , 2013, Apress.

[8]  Helen Sun,et al.  Oracle Big Data Handbook , 2003 .

[9]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[10]  F. Rahimi,et al.  Transactive Energy Techniques: Closing the Gap between Wholesale and Retail Markets , 2012 .

[11]  Csaba Szepesvári,et al.  Algorithms for Reinforcement Learning , 2010, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[12]  Rafał Weron,et al.  Modeling and Forecasting Electricity Loads , 2013 .

[13]  Rob J. Hyndman,et al.  Forecasting with Exponential Smoothing , 2008 .

[14]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[15]  Alexandre Alves,et al.  Getting Started with Oracle Event Processing 11g , 2013 .

[16]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[17]  George K. Karagiannidis,et al.  Big Data Analytics for Dynamic Energy Management in Smart Grids , 2015, Big Data Res..

[18]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[19]  Evangelos Spiliotis,et al.  Statistical and Machine Learning forecasting methods: Concerns and ways forward , 2018, PloS one.

[20]  M. El-Hawary,et al.  Advances in Electric Power and Energy Systems: Load and Price Forecasting , 2017 .

[21]  Darl Kuhn Pro Oracle Database 12c Administration , 2013, Apress.

[22]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[23]  Yannig Goude,et al.  Modeling and Forecasting Daily Electricity Load Curves: A Hybrid Approach , 2013, 1611.08632.

[24]  Rob J Hyndman,et al.  Forecasting Time Series With Complex Seasonal Patterns Using Exponential Smoothing , 2011 .

[25]  Mark Hornick,et al.  Using R to Unlock the Value of Big Data: Big Data Analytics with Oracle R Enterprise and Oracle R Connector for Hadoop , 2013 .

[26]  Rob J Hyndman,et al.  Forecasting with Exponential Smoothing: The State Space Approach , 2008 .

[27]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[28]  Steven C. Wheelwright,et al.  Forecasting: Methods and Applications, 3rd Ed , 1997 .

[29]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[30]  Zuohua Ding,et al.  A software cybernetics approach to self-tuning performance of on-line transaction processing systems , 2017, J. Syst. Softw..