Balancing exploration, uncertainty and computational demands in many objective reservoir optimization

Abstract Reservoir operations are central to our ability to manage river basin systems serving conflicting multi-sectoral demands under increasingly uncertain futures. These challenges motivate the need for new solution strategies capable of effectively and efficiently discovering the multi-sectoral tradeoffs that are inherent to alternative reservoir operation policies. Evolutionary many-objective direct policy search (EMODPS) is gaining importance in this context due to its capability of addressing multiple objectives and its flexibility in incorporating multiple sources of uncertainties. This simulation-optimization framework has high potential for addressing the complexities of water resources management, and it can benefit from current advances in parallel computing and meta-heuristics. This study contributes a diagnostic assessment of state-of-the-art parallel strategies for the auto-adaptive Borg Multi Objective Evolutionary Algorithm (MOEA) to support EMODPS. Our analysis focuses on the Lower Susquehanna River Basin (LSRB) system where multiple sectoral demands from hydropower production, urban water supply, recreation and environmental flows need to be balanced. Using EMODPS with different parallel configurations of the Borg MOEA, we optimize operating policies over different size ensembles of synthetic streamflows and evaporation rates. As we increase the ensemble size, we increase the statistical fidelity of our objective function evaluations at the cost of higher computational demands. This study demonstrates how to overcome the mathematical and computational barriers associated with capturing uncertainties in stochastic multiobjective reservoir control optimization, where parallel algorithmic search serves to reduce the wall-clock time in discovering high quality representations of key operational tradeoffs. Our results show that emerging self-adaptive parallelization schemes exploiting cooperative search populations are crucial. Such strategies provide a promising new set of tools for effectively balancing exploration, uncertainty, and computational demands when using EMODPS.

[1]  Giorgio Guariso,et al.  The Management of Lake Como: A Multiobjective Analysis , 1986 .

[2]  Upmanu Lall,et al.  A nonparametric stochastic approach for multisite disaggregation of annual to daily streamflow , 2010 .

[3]  Andrea Castelletti,et al.  Scalable Multiobjective Control for Large-Scale Water Resources Systems Under Uncertainty , 2018, IEEE Transactions on Control Systems Technology.

[4]  Andrea Castelletti,et al.  Many‐objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management , 2014 .

[5]  Enrique Alba,et al.  Parallel metaheuristics: recent advances and new trends , 2012, Int. Trans. Oper. Res..

[6]  Yacov Y. Haimes,et al.  Sensitivity, responsivity, stability and irreversibility as multiple objectives in civil systems , 1977 .

[7]  Zejun Li,et al.  Assessing the weighted multi-objective adaptive surrogate model optimization to derive large-scale reservoir operating rules with sensitivity analysis , 2017 .

[8]  Abhishek Singh,et al.  Uncertainty‐based multiobjective optimization of groundwater remediation design , 2008 .

[9]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[10]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[11]  Patrick M. Reed,et al.  Evolving many‐objective water management to exploit exascale computing , 2014 .

[12]  Andrea Castelletti,et al.  Integrated and Participatory Water Resources Management. Theory , 2007 .

[13]  George Kuczera,et al.  Robust optimization to secure urban bulk water supply against extreme drought and uncertain climate change , 2015, Environ. Model. Softw..

[14]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[15]  Jery R. Stedinger,et al.  Water Resources Systems Planning And Management , 2006 .

[16]  Demetris Koutsoyiannis,et al.  Evaluation of the parameterization‐simulation‐optimization approach for the control of reservoir systems , 2003 .

[17]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[18]  Daniel P. Sheer,et al.  Science‐based Collaboration: Finding Better Ways to Operate the Conowingo Pond , 2009 .

[19]  Daniel P. Sheer,et al.  Water Supply Planning Simulation Model Using Mixed-Integer Linear Programming “Engine” , 1997 .

[20]  Jan H. Kwakkel,et al.  An exploratory approach for adaptive policymaking by using multi-objective robust optimization , 2014, Simul. Model. Pract. Theory.

[21]  Gregory W. Characklis,et al.  Evaluating the impact of alternative hydro-climate scenarios on transfer agreements: Practical improvement for generating synthetic streamflows , 2013 .

[22]  Victoria Ward Confronting Tipping Points: How Well Can Multi-Objective Evolutionary Algorithms Support The Management Of Environmental Thresholds , 2015 .

[23]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[24]  Joseph R. Kasprzyk,et al.  Evolutionary multiobjective optimization in water resources: The past, present, and future , 2012 .

[25]  Andrea Castelletti,et al.  Curses, Tradeoffs, and Scalable Management: Advancing Evolutionary Multiobjective Direct Policy Search to Improve Water Reservoir Operations , 2016 .

[26]  Andrea Castelletti,et al.  A diagnostic assessment of evolutionary algorithms for multi-objective surface water reservoir control , 2016 .

[27]  Christos Makropoulos,et al.  Surrogate-enhanced evolutionary annealing simplex algorithm for effective and efficient optimization of water resources problems on a budget , 2016, Environ. Model. Softw..

[28]  Andrew G. Barto,et al.  Robot Weightlifting By Direct Policy Search , 2001, IJCAI.

[29]  Patrick M. Reed,et al.  Synthetic Drought Scenario Generation to Support Bottom-Up Water Supply Vulnerability Assessments , 2016 .

[30]  Andrea Castelletti,et al.  Making the most of data: An information selection and assessment framework to improve water systems operations , 2015 .

[31]  David E. Goldberg,et al.  Optimal sampling in a noisy genetic algorithm for risk-based remediation design , 2001 .

[32]  Avi Ostfeld,et al.  State of the Art for Genetic Algorithms and Beyond in Water Resources Planning and Management , 2010 .

[33]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[34]  Andrea Castelletti,et al.  Rival framings: A framework for discovering how problem formulation uncertainties shape risk management trade‐offs in water resources systems , 2017 .

[35]  Joshua D. Knowles,et al.  On metrics for comparing nondominated sets , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[36]  Andrea Castelletti,et al.  A general framework for Dynamic Emulation Modelling in environmental problems , 2012, Environ. Model. Softw..

[37]  Yong Tang,et al.  Parallelization strategies for rapid and robust evolutionary multiobjective optimization in water resources applications , 2007 .

[38]  Daniel P. Loucks,et al.  Reliability, Resiliency, Robustness, and Vulnerability Criteria for Water Resource Systems , 1982 .

[39]  Lawrence A. Crowl How to measure, present, and compare parallel performance , 1994, IEEE Parallel & Distributed Technology: Systems & Applications.

[40]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[41]  Patrick M. Reed,et al.  Large-scale parallelization of the Borg multiobjective evolutionary algorithm to enhance the management of complex environmental systems , 2015, Environ. Model. Softw..

[42]  Joseph R. Kasprzyk,et al.  Many objective robust decision making for complex environmental systems undergoing change , 2012, Environ. Model. Softw..

[43]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[44]  D. H. Marks,et al.  A review and evaluation of multiobjective programing techniques , 1975 .

[45]  Niels Schütze,et al.  Multi-objective optimization of multi-purpose multi-reservoir systems under high reliability constraints , 2016, Environmental Earth Sciences.

[46]  Patrick M. Reed,et al.  Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization , 2012, Evolutionary Computation.

[47]  Avi Ostfeld,et al.  Evolutionary algorithms and other metaheuristics in water resources: Current status, research challenges and future directions , 2014, Environ. Model. Softw..

[48]  Patrick M. Reed,et al.  Scalability Analysis of the Asynchronous, Master-Slave Borg Multiobjective Evolutionary Algorithm , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[49]  Kalyanmoy Deb,et al.  Introducing Robustness in Multi-Objective Optimization , 2006, Evolutionary Computation.

[50]  R. P. Oliveira,et al.  Operating rules for multireservoir systems , 1997 .