A unified state-space and scenario tree framework for multi-stage stochastic optimization: An application to emission-constrained hydro-thermal scheduling

of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy A UNIFIED STATE-SPACE AND SCENARIO TREE FRAMEWORK FOR MULTI-STAGE STOCHASTIC OPTIMIZATION: AN APPLICATION TO EMISSION-CONSTRAINED HYDRO-THERMAL SCHEDULING By Steffen Rebennack August 2010 Chair: Panagote M. Pardalos Major: Industrial and Systems Engineering In the hydro-thermal scheduling problem, one is interested in determining the optimal operating policy for the use of hydro and thermal resources in order to minimize total expected costs of fulfilling the demand for electricity over a given time horizon. Originally proposed in 1991 by Pereira and Pinto, Stochastic Dual Dynamic Programming (SDDP) remains to date the most efficient algorithm which is able to cope with inflow uncertainty and a detailed representation of a system’s characteristics. In this dissertation, we propose several extensions of the SDDP methodology: We embed the SDDP algorithm into a scenario tree framework, incorporate CO2 emission allowance constraints, and supplement the profit maximization models to account for CO2 emission allowance markets. These extensions allows us to additionally deal with uncertainties related to the evolution of demand and fuel prices. From a practical standpoint, this is an innovation as fuel price and electricity demand uncertainty could not be taken into account efficiently in hydro-thermal power systems so far, and from a technical standpoint, this is a new approach unifying the state-space and scenario tree framework. The importance of such an approach was made evident by the global economic crisis of 2008 when several countries experienced huge variations in demand and faced

[1]  E. Grant Read,et al.  A constructive dual dynamic programing for a reservoir model with correlation , 1999 .

[2]  David Heath,et al.  Coherent multiperiod risk adjusted values and Bellman’s principle , 2007, Ann. Oper. Res..

[3]  Andy Philpott On models for estimating the effect on prices of CO2 charges 1 , 2004 .

[4]  J. Dupacová,et al.  Scenario reduction in stochastic programming: An approach using probability metrics , 2000 .

[5]  Christoph Böhringer,et al.  Applied research in environmental economics , 2005 .

[6]  Warren B. Powell,et al.  A dynamic model for the failure replacement of aging high-voltage transformers , 2010 .

[7]  Werner Römisch,et al.  Stochastic Optimization of Electricity Portfolios: Scenario Tree Modeling and Risk Management , 2010 .

[8]  E. Read,et al.  Hybrid Bottom-Up/Top-Down Modeling of Prices in Deregulated Wholesale Power Markets , 2010 .

[9]  Carlos Batlle,et al.  A simulation model for a competitive generation market , 2000 .

[10]  B. Gorenstin,et al.  Power system expansion planning under uncertainty , 1993 .

[11]  B. Lamond,et al.  Optimizing long-term hydro-power production using Markov decision processes , 1996 .

[12]  Amaury Tilmant,et al.  Dynamic Management of Hydropower-Irrigation Systems , 2010 .

[13]  A. Diniz,et al.  A New Multiperiod Stage Definition for the Multistage Benders Decomposition Approach Applied to Hydrothermal Scheduling , 2009, IEEE Transactions on Power Systems.

[14]  B. F. Sule,et al.  Stochastic dynamic programming models for reservoir operation optimization , 1984 .

[16]  Werner Römisch,et al.  Scenario Reduction Algorithms in Stochastic Programming , 2003, Comput. Optim. Appl..

[17]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[18]  Yurii Nesterov,et al.  New variants of bundle methods , 1995, Math. Program..

[19]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[20]  Pedro J. Restrepo,et al.  Dual dynamic programing: A note on implementation , 1999 .

[21]  Peter M. Verderame,et al.  Integration of Operational Planning and Medium-Term Scheduling for Large-Scale Industrial Batch Plants under Demand and Processing Time Uncertainty , 2010 .

[22]  Zhang Yan,et al.  A review on risk-constrained hydropower scheduling in deregulated power market , 2008 .

[23]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[24]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[25]  A. David Competitive bidding in electricity supply , 1993 .

[26]  N. Growe-Kuska,et al.  Scenario reduction and scenario tree construction for power management problems , 2003, 2003 IEEE Bologna Power Tech Conference Proceedings,.

[27]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[28]  Steffen Rebennack,et al.  Optimal power flow: a bibliographic survey I , 2012, Energy Systems.

[29]  W. Ziemba,et al.  Hedging electricity portfolios via stochastic programming , 2002 .

[30]  Rafael Kelman,et al.  Bid-Based Dispatch of Hydrothermal Systems in Competitive Markets , 2003, Ann. Oper. Res..

[31]  G. C. Oliveira,et al.  Combining analytical models and Monte-Carlo techniques in probabilistic power system analysis , 1992 .

[32]  M. Pereira Optimal stochastic operations scheduling of large hydroelectric systems , 1989 .

[33]  Warrren B Powell,et al.  Convergent Cutting-Plane and Partial-Sampling Algorithm for Multistage Stochastic Linear Programs with Recourse , 1999 .

[34]  R. Schultz,et al.  Two-stage stochastic integer programming : a survey , 1996 .

[35]  S. Minner,et al.  Optimal day-ahead trading and storage of renewable energies—an approximate dynamic programming approach , 2010 .

[36]  Md. Sayeed Salam Solution to Short-term Unit Commitment Problem , 2010 .

[37]  P. Pardalos,et al.  Electricity and CO2 Emissions System Price Modeling , 2009 .

[38]  W. Römisch,et al.  Generation of multivariate scenario trees to model stochasticity in power management , 2005, 2005 IEEE Russia Power Tech.

[39]  Alexander Shapiro,et al.  The empirical behavior of sampling methods for stochastic programming , 2006, Ann. Oper. Res..

[40]  Andrzej Ruszczynski,et al.  On augmented Lagrangian decomposition methods for multistage stochastic programs , 1996, Ann. Oper. Res..

[41]  S. M. Shahidehpour,et al.  A dynamic programming two-stage algorithm for long-term hydrothermal scheduling of multireservoir systems , 1998 .

[42]  Christodoulos A. Floudas,et al.  A new robust optimization approach for scheduling under uncertainty: : I. Bounded uncertainty , 2004, Comput. Chem. Eng..

[43]  Mario V. F. Pereira,et al.  Long-term optimal allocation of hydro generation for a price-maker company in a competitive market: latest developments and a stochastic dual dynamic programming approach , 2010 .

[44]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[45]  A. Gjelsvik,et al.  Long- and Medium-term Operations Planning and Stochastic Modelling in Hydro-dominated Power Systems Based on Stochastic Dual Dynamic Programming , 2010 .

[46]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[47]  M.V.F. Pereira,et al.  Optimization of Fuel Contracts Management and Maintenance Scheduling for Thermal Plants under Price Uncertainty , 2006, 2006 IEEE PES Power Systems Conference and Exposition.

[48]  B. WETSt,et al.  STOCHASTIC PROGRAMS WITH FIXED RECOURSE : THE EQUIVALENT DETERMINISTIC PROGRAM , 2022 .

[49]  A.G. Bakirtzis,et al.  Simulation of Optimal Medium-Term Hydro-Thermal System Operation by Grid Computing , 2009, IEEE Transactions on Power Systems.

[50]  Peter M. Verderame,et al.  Operational Planning of Large-Scale Industrial Batch Plants under Demand Due Date and Amount Uncertainty. I. Robust Optimization Framework , 2009 .

[51]  Cornelius T. Leondes Stochastic digital control system techniques , 1996 .

[52]  M.E.P. Maceira,et al.  TEN YEARS OF APPLICATION OF STOCHASTIC DUAL DYNAMIC PROGRAMMING IN OFFICIAL AND AGENT STUDIES IN BRAZIL - DESCRIPTION OF THE NEWAVE PROGRAM , 2008 .

[53]  D. Mayne A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[54]  Julia L. Higle,et al.  Stochastic Decomposition: An Algorithm for Two-Stage Linear Programs with Recourse , 1991, Math. Oper. Res..

[55]  Victor H. Quintana,et al.  Semidefinite Programming: A Practical Application to Hydro -Thermal Coordination , 2002 .

[56]  George Gross,et al.  Generation Supply Bidding in Perfectly Competitive Electricity Markets , 2000, Comput. Math. Organ. Theory.

[57]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[58]  A. Ellerman,et al.  The European Union Emissions Trading Scheme: Origins, Allocation, and Early Results , 2007, Review of Environmental Economics and Policy.

[59]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[60]  Gerd Infanger,et al.  Cut sharing for multistage stochastic linear programs with interstage dependency , 1996, Math. Program..

[61]  John R. Birge,et al.  The Abridged Nested Decomposition Method for Multistage Stochastic Linear Programs with Relatively Complete Recourse , 2006, Algorithmic Oper. Res..

[62]  Takayuki Shiina,et al.  Stochastic Programming with Integer Variables , 2007, CSC.

[63]  S. Rebennack Handbook of power systems , 2010 .

[64]  Y. Ermoliev Stochastic quasigradient methods and their application to system optimization , 1983 .

[65]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[66]  A. Gjelsvik,et al.  Optimisation of hydropower operation in a liberalised market with focus on price modelling , 2001, 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502).

[67]  Ricardo G. Rubio-Barros,et al.  Energy Carrier Networks: Interactions and Integrated Operational Planning , 2012 .

[68]  Michal Kaut,et al.  A heuristic for generating scenario trees for multistage decision problems , 2001 .

[69]  Thomas J. Overbye,et al.  A comparison of the AC and DC power flow models for LMP calculations , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[70]  Adam Millard-Ball,et al.  Cap-and-Trade , 2009 .

[71]  G. Shrestha,et al.  Medium term power planning with bilateral contracts , 2005, IEEE Transactions on Power Systems.

[72]  Unfccc Kyoto Protocol to the United Nations Framework Convention on Climate Change , 1997 .

[73]  Matthias Finger,et al.  Financial risk modelling in electricity portfolio optimisation , 2009 .

[74]  Panos M. Pardalos,et al.  Optimal storage design for a multi-product plant: A non-convex MINLP formulation , 2011, Comput. Chem. Eng..

[75]  André Turgeon A decomposition method for the long-term scheduling of reservoirs in series , 1981 .

[76]  B. Hobbs,et al.  Chapter 3 Complementarity-Based Equilibrium Modeling for Electric Power Markets , 2003 .

[77]  Christian Küchler,et al.  On Stability of Multistage Stochastic Programs , 2008, SIAM J. Optim..

[78]  E. Read,et al.  Modelling hydro reservoir operation in a deregulated electricity market , 1996 .

[79]  Nathan Buras,et al.  Dynamic Programming in Water Resources Development , 1966 .

[80]  G. Cohen,et al.  Decomposition/coordination algorithms in stochastic optimization , 1990 .

[81]  J. Mulvey,et al.  Making a case for robust optimization models , 1997 .

[82]  Panos M. Pardalos,et al.  Space weather influence on power systems: prediction, risk analysis, and modeling , 2010 .

[83]  Keith W. Hipel,et al.  Forecasting monthly riverflow time series , 1985 .

[84]  Chi-Keung Woo,et al.  Electricity market reform failures: UK, Norway, Alberta and California , 2003 .

[85]  Warren B. Powell,et al.  Learning Algorithms for Separable Approximations of Discrete Stochastic Optimization Problems , 2004, Math. Oper. Res..

[86]  Stein W. Wallace,et al.  Generating Scenario Trees for Multistage Decision Problems , 2001, Manag. Sci..

[87]  Tarjei Kristiansen Financial risk management in the electric power industry using stochastic optimization , 2004 .

[88]  Amaury Tilmant,et al.  A stochastic approach to analyze trade‐offs and risks associated with large‐scale water resources systems , 2007 .

[89]  S. Yakowitz Dynamic programming applications in water resources , 1982 .

[90]  Stefan Seifert,et al.  Strategic Aspects of Co2-Emissions Trading: Theoretical Concepts and Empirical Findings , 2003 .

[91]  Panos M. Pardalos,et al.  Short term portfolio optimization for discrete power plant dispatching , 2009, 2009 IEEE Power & Energy Society General Meeting.

[92]  李幼升,et al.  Ph , 1989 .

[93]  Panos M. Pardalos,et al.  Optimization Models in The Natural Gas Industry , 2010 .

[94]  C. S. Buchanan,et al.  Nested Benders decomposition and dynamic programming for reservoir optimisation , 1999, J. Oper. Res. Soc..

[95]  M.V.F. Pereira,et al.  Stochastic optimization of transmission constrained and large scale hydrothermal systems in a competitive framework , 2003, 2003 IEEE Power Engineering Society General Meeting (IEEE Cat. No.03CH37491).

[96]  Jery R. Stedinger,et al.  SOCRATES: A system for scheduling hydroelectric generation under uncertainty , 1995, Ann. Oper. Res..

[97]  M. Pereira,et al.  Stochastic Optimization of a Multireservoir Hydroelectric System: A Decomposition Approach , 1985 .

[98]  Magnus Hindsberger,et al.  Constructive Dual DP for Reservoir Optimization , 2010 .

[99]  Carlos Batlle,et al.  Fuel prices scenario generation based on a multivariate GARCH model for risk analysis in a wholesale electricity market , 2004 .

[100]  M. Aganagic,et al.  Long-term/mid-term resource optimization of a hydro-dominant power system using interior point method , 1995 .

[101]  Christodoulos A. Floudas,et al.  A new robust optimization approach for scheduling under uncertainty: II. Uncertainty with known probability distribution , 2007, Comput. Chem. Eng..

[102]  J. M. Damázio,et al.  The use of PAR(p) model in the stochastic dual dynamic programming optimization scheme used in the operation planning of the Brazilian hydropower system , 2005, 2004 International Conference on Probabilistic Methods Applied to Power Systems.

[103]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[104]  Reservoir management with risk aversion , 1998 .

[105]  Floyd B. Hanson,et al.  Techniques in Computational Stochastic Dynamic Programming , 1996 .

[106]  Christodoulos A. Floudas,et al.  Operational Planning of Large-Scale Industrial Batch Plants under Demand Due Date and Amount Uncertainty: II. Conditional Value-at-Risk Framework , 2010 .

[107]  S. Granville,et al.  Benchmarking of hydroelectric stochastic risk management models using financial indicators , 2006, 2006 IEEE Power Engineering Society General Meeting.

[108]  Panos M. Pardalos,et al.  Handbook of applied optimization , 2002 .

[109]  W. Römisch Stability of Stochastic Programming Problems , 2003 .

[110]  Birger Mo,et al.  Integrated risk management of hydro power scheduling and contract management , 2001 .

[111]  Jitka Dupacová,et al.  Scenarios for Multistage Stochastic Programs , 2000, Ann. Oper. Res..

[112]  Y. Smeers,et al.  The Gas Transmission Problem Solved by an Extension of the Simplex Algorithm , 2000 .

[113]  Charles E. Blair,et al.  The value function of an integer program , 1982, Math. Program..

[114]  Andrew B. Philpott,et al.  On the convergence of stochastic dual dynamic programming and related methods , 2008, Oper. Res. Lett..

[115]  James Bushnell,et al.  A Mixed Complementarity Model of Hydrothermal Electricity Competition in the Western United States , 2003, Oper. Res..

[116]  Hans-Jürgen Zimmermann,et al.  An application-oriented view of modeling uncertainty , 2000, Eur. J. Oper. Res..

[117]  A. Turgeon Optimal short-term hydro scheduling from the principle of progressive optimality , 1981 .

[118]  Jesús M. Velásquez Bermúdez GDDP: Generalized Dual Dynamic Programming Theory , 2002, Ann. Oper. Res..

[119]  P. Camion Characterization of totally unimodular matrices , 1965 .

[120]  Michael R. Bussieck,et al.  General Algebraic Modeling System (GAMS) , 2004 .

[121]  Jery R. Stedinger,et al.  Reservoir optimization using sampling SDP with ensemble streamflow prediction (ESP) forecasts , 2001 .

[122]  Stein W. Wallace,et al.  Delta-hedging a hydropower plant using stochastic programming , 2009 .

[123]  Werner Römisch,et al.  Scenario tree modeling for multistage stochastic programs , 2009, Math. Program..

[124]  David P. Morton,et al.  An enhanced decomposition algorithm for multistage stochastic hydroelectric scheduling , 1996, Ann. Oper. Res..

[125]  Josef Kallrath,et al.  Modeling Languages in Mathematical Optimization , 2012 .

[126]  Werner Römisch,et al.  Scenario Tree Approximation and Risk Aversion Strategies for Stochastic Optimization of Electricity Production and Trading , 2009 .

[127]  A. Ruszczynski Stochastic Programming Models , 2003 .

[128]  Werner Römisch,et al.  Stochastic Lagrangian Relaxation Applied to Power Scheduling in a Hydro-Thermal System under Uncertainty , 2000, Ann. Oper. Res..

[129]  J. D. Sepibus Scarcity and Allocation of Allowances in the EU Emissions Trading Scheme - A Legal Analysis , 2007 .

[130]  S. Rebennack,et al.  Stochastic Hydro-Thermal Scheduling Under ${\rm CO}_{2}$ Emissions Constraints , 2012, IEEE Transactions on Power Systems.

[131]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[132]  A. Haugstad,et al.  Quota modeling in hydrothermal systems , 2003, 2003 IEEE Bologna Power Tech Conference Proceedings,.

[133]  George B. Dantzig,et al.  Linear Programming Under Uncertainty , 2004, Manag. Sci..

[134]  M. Birkner,et al.  Blow-up of semilinear PDE's at the critical dimension. A probabilistic approach , 2002 .

[135]  John M. Mulvey,et al.  A diagonal quadratic approximation method for large scale linear programs , 1992, Oper. Res. Lett..

[136]  M. Kraus Liberalised Energy Markets — Do We Need Re-Regulation? , 2005 .

[137]  Arkadi Nemirovski,et al.  Robust optimization – methodology and applications , 2002, Math. Program..

[138]  Risto Lahdelma,et al.  CO2 emissions trading planning in combined heat and power production via multi-period stochastic optimization , 2007, Eur. J. Oper. Res..

[139]  N. Buras,et al.  The dynamic programming approach to water‐resources development , 1961 .

[140]  Werner Römisch,et al.  Optimal Power Generation under Uncertainty via Stochastic Programming , 1998 .

[141]  M. J. Hutzler,et al.  Emissions of greenhouse gases in the United States , 1995 .

[142]  Nikolaos V. Sahinidis,et al.  Optimization under uncertainty: state-of-the-art and opportunities , 2004, Comput. Chem. Eng..

[143]  S. Sen Algorithms for Stochastic Mixed-Integer Programming Models , 2005 .

[144]  R. Wets,et al.  Stochastic programming , 1989 .

[145]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.

[146]  D. M. Holthausen,et al.  Hedging and the Competitive Firm under Price Uncertainty , 1979 .

[147]  P. Monzon,et al.  Stability conditions for a stochastic dynamic optimizer for optimal dispatch policies in power systems with hydroelectrical generation , 2008, 2008 IEEE/PES Transmission and Distribution Conference and Exposition: Latin America.

[148]  A. Vries Value at Risk , 2019, Derivatives.

[149]  Rafael Kelman,et al.  Market Power Issues in Bid-Based Hydrothermal Dispatch , 2002, Ann. Oper. Res..

[150]  Larry Chuen-ho Chow Themes in current Asian energy , 2003 .

[151]  Antonio J. Conejo,et al.  A clipping-off interior-point technique for medium-term hydro-thermal coordination , 1999 .

[152]  Andy Philpott,et al.  On the Convergence of Sampling-Based Decomposition Algorithms for Multistage Stochastic Programs , 2005 .

[153]  LONG-TERM CONTRACTING IN A DEREGULATED ELECTRICITY INDUSTRY: SIMULATION RESULTS FROM A HYDRO MANAGEMENT MODEL , 1998 .

[154]  Christian Prins,et al.  Applications of optimisation with Xpress-MP , 2002 .

[155]  Stefan Trück,et al.  Modeling the Price Dynamics of Co2 Emission Allowances , 2009 .

[156]  Sidney Yakowitz,et al.  Algorithms and Computational Techniques in Differential Dynamic Programming , 1989 .

[157]  S. Wallace,et al.  Stochastic Programming Models in Energy , 2003 .

[158]  R. Larson,et al.  A survey of dynamic programming computational procedures , 1967, IEEE Transactions on Automatic Control.

[159]  R. Wets,et al.  L-SHAPED LINEAR PROGRAMS WITH APPLICATIONS TO OPTIMAL CONTROL AND STOCHASTIC PROGRAMMING. , 1969 .

[160]  Alexander Shapiro,et al.  Analysis of stochastic dual dynamic programming method , 2011, Eur. J. Oper. Res..

[161]  John W. Labadie,et al.  Optimal Operation of Multireservoir Systems: State-of-the-Art Review , 2004 .

[162]  P. Pardalos,et al.  Energy Portfolio Optimization for Electric Utilities: Case Study for Germany , 2010 .

[163]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[164]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..