Comparison and Evaluation of Methods for a Predict+Optimize Problem in Renewable Energy

—Algorithms that involve both forecasting and opti- mization are at the core of solutions to many difficult real-world problems, such as in supply chains (inventory optimization), traf- fic, and in the transition towards carbon-free energy generation in battery/load/production scheduling in sustainable energy systems. Typically, in these scenarios we want to solve an optimization problem that depends on unknown future values, which therefore need to be forecast. As both forecasting and optimization are difficult problems in their own right, relatively few research has been done in this area. This paper presents the findings of the “IEEE-CIS Technical Challenge on Predict+Optimize for Renewable Energy Scheduling,” held in 2021. We present a comparison and evaluation of the seven highest-ranked solutions in the competition, to provide researchers with a benchmark problem and to establish the state of the art for this benchmark, with the aim to foster and facilitate research in this area. The competition used data from the Monash Microgrid, as well as weather data and energy market data. It then focused on two main challenges: forecasting renewable energy production and demand, and obtaining an optimal schedule for the activities

[1]  Richard Bean,et al.  How to predict and optimise with asymmetric error metrics , 2022, ArXiv.

[2]  Akylas C. Stratigakos,et al.  Prescriptive Trees for Integrated Forecasting and Optimization Applied in Trading of Renewable Energy , 2022, IEEE Transactions on Power Systems.

[3]  Richard Bean Forecasting and Optimizing a Microgrid for the IEEE-CIS Technical Challenge , 2022, 2022 32nd Australasian Universities Power Engineering Conference (AUPEC).

[4]  S. A. Pourmousavi,et al.  Optimal activity and battery scheduling algorithm using load and solar generation forecasts , 2022, 2022 32nd Australasian Universities Power Engineering Conference (AUPEC).

[5]  Lei Wu,et al.  Feature-Driven Economic Improvement for Network-Constrained Unit Commitment: A Closed-Loop Predict-and-Optimize Framework , 2022, IEEE Transactions on Power Systems.

[6]  Nils Einecke,et al.  An Efficient Approach for Peak-Load-Aware Scheduling of Energy-Intensive Tasks in the Context of a Public IEEE Challenge , 2022, Energies.

[7]  K. T. Tan,et al.  Online Optimal Power Scheduling of a Microgrid via Imitation Learning , 2022, IEEE Transactions on Smart Grid.

[8]  T. Coosemans,et al.  Evolutionary Scheduling of University Activities Based on Consumption Forecasts to Minimise Electricity Costs , 2022, 2022 IEEE Congress on Evolutionary Computation (CEC).

[9]  Yuri Burda,et al.  Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets , 2022, ArXiv.

[10]  R. García-Flores,et al.  Benders decomposition for a reverse logistics network design problem in the dairy industry , 2021, Annals of Operations Research.

[11]  Vicky H. Mak-Hau,et al.  The multiphase course timetabling problem , 2021, Eur. J. Oper. Res..

[12]  Gabriela Hug,et al.  Cost-Oriented Load Forecasting , 2021, Electric Power Systems Research.

[13]  Akylas C. Stratigakos,et al.  A Value-Oriented Price Forecasting Approach to Optimize Trading of Renewable Generation , 2021, 2021 IEEE Madrid PowerTech.

[14]  Geoffrey I. Webb,et al.  Monash Time Series Forecasting Archive , 2021, NeurIPS Datasets and Benchmarks.

[15]  Ferdinando Fioretto,et al.  End-to-End Constrained Optimization Learning: A Survey , 2021, IJCAI.

[16]  Hadi Charkhgard,et al.  The Utilization of Shared Energy Storage in Energy Systems: A Comprehensive Review , 2021, IEEE Transactions on Smart Grid.

[17]  Okyay Kaynak,et al.  Spatiotemporal Behind-the-Meter Load and PV Power Forecasting via Deep Graph Dictionary Learning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Anuradha Bhamidipaty,et al.  A Transformer-based Framework for Multivariate Time Series Representation Learning , 2020, KDD.

[19]  Zuyi Li,et al.  A Task-Based Day-Ahead Load Forecasting Model for Stochastic Economic Dispatch , 2020, IEEE Transactions on Power Systems.

[20]  Kotagiri Ramamohanarao,et al.  Dynamic Programming for Predict+Optimise , 2020, AAAI.

[21]  Tomonobu Senjyu,et al.  Performance Evaluation of Probabilistic Methods Based on Bootstrap and Quantile Regression to Quantify PV Power Point Forecast Uncertainty , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Grzegorz Dudek,et al.  A Hybrid Residual Dilated LSTM end Exponential Smoothing Model for Mid-Term Electric Load Forecasting , 2020, ArXiv.

[23]  Adam N. Elmachtoub,et al.  Decision Trees for Decision-Making under the Predict-then-Optimize Framework , 2020, ICML.

[24]  Hongbin Sun,et al.  Distribution-Free Probability Density Forecast Through Deep Neural Networks , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Tias Guns,et al.  Smart Predict-and-Optimize for Hard Combinatorial Optimization Problems , 2019, AAAI.

[26]  Salvador Pineda,et al.  Feature-Driven Improvement of Renewable Energy Forecasting and Trading , 2019, IEEE Transactions on Power Systems.

[27]  Georges Kariniotakis,et al.  An Integrated Approach for Value-Oriented Energy Forecasting and Data-Driven Decision-Making Application to Renewable Energy Trading , 2019, IEEE Transactions on Smart Grid.

[28]  Yoshua Bengio,et al.  Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon , 2018, Eur. J. Oper. Res..

[29]  David Pisinger,et al.  Large Neighborhood Search , 2018, Handbook of Metaheuristics.

[30]  Hsiao-Dong Chiang,et al.  Toward Cost-Oriented Forecasting of Wind Power Generation , 2018, IEEE Transactions on Smart Grid.

[31]  Thomas R. Stidsen,et al.  A fix-and-optimize matheuristic for university timetabling , 2018, J. Heuristics.

[32]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[33]  Adam N. Elmachtoub,et al.  Smart "Predict, then Optimize" , 2017, Manag. Sci..

[34]  Priya L. Donti,et al.  Task-based End-to-end Model Learning in Stochastic Optimization , 2017, NIPS.

[35]  Greet Vanden Berghe,et al.  Multi-machine energy-aware scheduling , 2017, EURO J. Comput. Optim..

[36]  Enrico Zio,et al.  Two Machine Learning Approaches for Short-Term Wind Speed Time-Series Prediction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Angel A. Juan,et al.  A review of simheuristics: Extending metaheuristics to deal with stochastic combinatorial optimization problems , 2015 .

[38]  Elisabeth Köbis,et al.  On Robust Optimization , 2015, J. Optim. Theory Appl..

[39]  Juan Pablo Vielma,et al.  Mixed Integer Linear Programming Formulation Techniques , 2015, SIAM Rev..

[40]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Rob J Hyndman,et al.  The value of feedback in forecasting competitions , 2011 .

[42]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[43]  Mario Vanhoucke,et al.  An evaluation of the adequacy of project network generators with systematically sampled networks , 2008, Eur. J. Oper. Res..

[44]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[45]  G. Reklaitis,et al.  A simulation based optimization approach to supply chain management under demand uncertainty , 2004, Comput. Chem. Eng..

[46]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[47]  Rainer Kolisch,et al.  PSPLIB - A project scheduling problem library: OR Software - ORSEP Operations Research Software Exchange Program , 1997 .

[48]  Rolf H. Möhring,et al.  Scheduling project networks with resource constraints and time windows , 1988 .

[49]  S. A. Pourmousavi,et al.  IRMAC: Interpretable Refined Motifs and Binary Classification for Rooftops PV Owners , 2021, ArXiv.

[50]  Babak Abbasi,et al.  Proactive transshipment in the blood supply chain: A stochastic programming approach , 2019 .

[51]  Irma J. Terpenning,et al.  STL : A Seasonal-Trend Decomposition Procedure Based on Loess , 1990 .

[52]  Frank Bowman,et al.  School Mathematics , 1968, Nature.