Quadratic approximate dynamic programming for scheduling water resources: a case study

We address the problem of scheduling water re-sources in a power system via approximate dynamic programming. To this goal, we model a finite horizon economic dispatch problem with convex stage cost and affine dynamics, and consider a quadratic approximation of the value functions. Evaluating the achieved policy entails solving a quadratic program at each time step, while value function fitting can be cast as a semidefinite program. We test our proposed algorithm on a simplified version of the Uruguayan power system, achieving a four percent cost reduction with respect to the myopic policy.

[1]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[2]  Fernando Paganini,et al.  Towards multi-timescale energy provisioning using Stochastic Dual Dynamic Programming , 2018, 2018 IEEE 9th Power, Instrumentation and Measurement Meeting (EPIM).

[3]  Stephen P. Boyd,et al.  Quadratic approximate dynamic programming for input‐affine systems , 2014 .

[4]  John W. Labadie,et al.  Optimal Operation of Multireservoir Systems: State-of-the-Art Review , 2004 .

[5]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[6]  Vitor L. de Matos,et al.  Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion , 2012, Eur. J. Oper. Res..

[7]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for the Lagged Asset Acquisition Problem , 2009, Math. Oper. Res..

[8]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[9]  Anton van den Hengel,et al.  Semidefinite Programming , 2014, Computer Vision, A Reference Guide.

[10]  Deepti Rani,et al.  Simulation–Optimization Modeling: A Survey and Potential Application in Reservoir Systems Operation , 2010 .

[11]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[12]  Robert H. Shumway,et al.  Time series analysis and its applications : with R examples , 2017 .

[13]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[14]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[15]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for Concave, Scalar Storage Problems With Vector-Valued Controls , 2013, IEEE Transactions on Automatic Control.

[16]  Stephen P. Boyd,et al.  Stochastic Control With Affine Dynamics and Extended Quadratic Costs , 2018, IEEE Transactions on Automatic Control.