Optimization of hydropower system operation by uniform dynamic programming for dimensionality reduction

As a popular optimization tool for multi-stage sequential decision problems, dynamic programming (DP) has been widely used to handle with hydropower system operation problems. However, the DP computational burden shows an exponential growth with the increasing number of hydroplants, which results in “the curse of dimensionality” and limits its application to resolve large and complex hydropower operation problem. Thus, this paper presents a novel modified DP algorithm called uniform dynamic programming (UDP) to alleviate the dimensionality problem of dynamic programming. In UDP, the uniform design is first used to construct the state variables set of each period by selecting some small but representative discrete state combinations, and then the DP recursive equation is used to find an improved solution for the next computation cycle. The UDP method is tested in the Wu River cascaded hydropower system of southwest China. The results indicate that the proposed UDP algorithm has competitive performance in computational efficiency and convergence speed, which is an effective tool for hydropower operation problem.

[1]  Chuntian Cheng,et al.  Multi-objective quantum-behaved particle swarm optimization for economic environmental hydrothermal energy system scheduling , 2017 .

[2]  Deepti Rani,et al.  Simulation–Optimization Modeling: A Survey and Potential Application in Reservoir Systems Operation , 2010 .

[3]  Yu Li,et al.  Joint Operation of the Multi-Reservoir System of the Three Gorges and the Qingjiang Cascade Reservoirs , 2011 .

[4]  Duan Chen,et al.  Dimension reduction of decision variables for multireservoir operation: A spectral optimization model , 2016 .

[5]  Su-Yun Huang,et al.  Model selection for support vector machines via uniform design , 2007, Comput. Stat. Data Anal..

[6]  Chunxia Dou,et al.  Gradient decent based multi-objective cultural differential evolution for short-term hydrothermal optimal scheduling of economic emission with integrating wind power and photovoltaic power , 2017 .

[7]  Chuntian Cheng,et al.  Coordinated operations of large-scale UHVDC hydropower and conventional hydro energies about regional power grid , 2016 .

[8]  K. Madani.  Hydropower licensing and climate change: Insights from cooperative game theory , 2011 .

[9]  Xiaoli Zhang,et al.  Multi-Core Parallel Particle Swarm Optimization for the Operation of Inter-Basin Water Transfer-Supply Systems , 2016, Water Resources Management.

[10]  Rodolfo Soncini-Sessa,et al.  A dimensionality reduction approach for many-objective Markov Decision Processes: Application to a water reservoir operation problem , 2014, Environ. Model. Softw..

[11]  Marcello Restelli,et al.  Tree‐based reinforcement learning for optimal water reservoir operation , 2010 .

[12]  Jay R. Lund,et al.  Optimal Hedging Rules for Reservoir Flood Operation from Forecast Uncertainties , 2014 .

[13]  K Ang,et al.  A NOTE ON UNIFORM DISTRIBUTION AND EXPERIMENTAL DESIGN , 1981 .

[14]  Christine A. Shoemaker,et al.  Estimating Maximal Annual Energy Given Heterogeneous Hydropower Generating Units with Application to the Three Gorges System , 2013 .

[15]  John W. Labadie,et al.  Dynamic Optimal Unit Commitment and Loading in Hydropower Systems , 2003 .

[16]  Michael Milligan,et al.  Enhancing hydropower modeling in variable generation integration studies , 2014 .

[17]  John W. Labadie,et al.  Optimal Operation of Multireservoir Systems: State-of-the-Art Review , 2004 .

[18]  Peng Lu,et al.  Daily Generation Scheduling of Cascade Hydro Plants Considering Peak Shaving Constraints , 2016 .

[19]  Ximing Cai,et al.  Improved Dynamic Programming for Reservoir Operation Optimization with a Concave Objective Function , 2012 .

[20]  Liu Yuan,et al.  Long-term scheduling of large cascade hydropower stations in Jinsha River, China , 2015 .

[21]  Huifeng Zhang,et al.  Daily hydrothermal scheduling with economic emission using simulated annealing technique based multi-objective cultural differential evolution approach , 2013 .

[22]  J.P.S. Catalão,et al.  Hydro energy systems management in Portugal: Profit-based evaluation of a mixed-integer nonlinear ap , 2011 .

[23]  X. Chang,et al.  Hydropower in China at present and its further development , 2010 .

[24]  Hanqing Yu,et al.  Optimization of the coagulation-flocculation process for pulp mill wastewater treatment using a combination of uniform design and response surface methodology. , 2011, Water research.

[25]  William W.-G. Yeh,et al.  Optimization of Large-Scale Hydrothermal System Operation , 2012 .

[26]  Yalin Chen,et al.  A hybrid particle swarm optimization with small population size to solve the optimal short-term hydro-thermal unit commitment problem , 2016 .

[27]  A. Simpson,et al.  An efficient hybrid approach for multiobjective optimization of water distribution systems , 2014 .

[28]  Christine A. Shoemaker,et al.  Hierarchical multi-reservoir optimization modeling for real-world complexity with application to the Three Gorges system , 2015, Environ. Model. Softw..

[29]  R. Bellman.  The theory of dynamic programming , 1954 .

[30]  Wei Sun,et al.  Factorial Two-Stage Irrigation System Optimization Model , 2016 .

[31]  Chen Lu,et al.  Improved decomposition-coordination and discrete differential dynamic programming for optimization of large-scale hydropower system , 2014 .

[32]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[33]  Yizeng Liang,et al.  Uniform design and its applications in chemistry and chemical engineering , 2001 .

[34]  Ping Sun,et al.  Contrastive analysis of three parallel modes in multi-dimensional dynamic programming and its application in cascade reservoirs operation , 2015 .

[35]  Guohe Huang,et al.  An inexact optimization modeling approach for supporting energy systems planning and air pollution mitigation in Beijing city , 2012 .

[36]  Yuping Wang,et al.  Multiobjective programming using uniform design and genetic algorithm , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[37]  Joao P. S. Catalao,et al.  Scheduling of head-dependent cascaded reservoirs considering discharge ramping constraints and start/stop of units , 2010 .

[38]  Leon S. Lasdon,et al.  Solving nonlinear water management models using a combined genetic algorithm and linear programming approach , 2001 .

[39]  Pan Liu,et al.  Evaluating the marginal utility principle for long-term hydropower scheduling , 2015 .

[40]  Chao Ma,et al.  Short-term optimal operation of Three-gorge and Gezhouba cascade hydropower stations in non-flood season with operation rules from data mining , 2013 .

[41]  Chuntian Cheng,et al.  Short-Term Scheduling for Large-Scale Cascaded Hydropower Systems with Multivibration Zones of High Head , 2012 .

[42]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[43]  Chuntian Cheng,et al.  Parallel Multi-Objective Genetic Algorithm for Short-Term Economic Environmental Hydrothermal Scheduling , 2017 .

[44]  Xiang Li,et al.  A parallel dynamic programming algorithm for multi-reservoir system optimization , 2014 .

[45]  Frank T.-C. Tsai,et al.  Optimization of Large-Scale Hydropower System Operations , 2003 .

[46]  Jingrui Zhang,et al.  A small-population based parallel differential evolution algorithm for short-term hydrothermal scheduling problem considering power flow constraints , 2017 .

[47]  Jay R. Lund,et al.  Estimated impacts of climate warming on California’s high-elevation hydropower , 2010 .

[48]  Chuntian Cheng,et al.  Optimization of peak loads among multiple provincial power grids under a central dispatching authority , 2014 .

[49]  Chuntian Cheng,et al.  Hydropower system operation optimization by discrete differential dynamic programming based on orthogonal experiment design , 2017 .

[50]  Joao P. S. Catalao,et al.  Optimal hydro scheduling and offering strategies considering price uncertainty and risk management , 2012 .

[51]  Sen Wang,et al.  Parallel discrete differential dynamic programming for multireservoir operation , 2014, Environ. Model. Softw..

[52]  Chuntian Cheng,et al.  Short-Term Hydroscheduling with Discrepant Objectives Using Multi-Step Progressive Optimality Algorithm1 , 2012 .