How should robustness be defined for water systems planning under change

AbstractWater systems planners have long recognized the need for robust solutions capable of withstanding deviations from the conditions for which they were designed. Robustness analyses have shifted from expected utility to exploratory bottom-up approaches which identify vulnerable scenarios prior to assigning likelihoods. Examples include Robust Decision Making (RDM), Decision Scaling, Info-Gap, and Many-Objective Robust Decision Making (MORDM). We propose a taxonomy of robustness frameworks to compare and contrast these approaches based on their methods of (1) alternative generation, (2) sampling of states of the world, (3) quantification of robustness measures, and (4) sensitivity analysis to identify important uncertainties. Building from the proposed taxonomy, we use a regional urban water supply case study in the Research Triangle region of North Carolina to illustrate the decision-relevant consequences that emerge from each of these choices. Results indicate that the methodological choices in the ...

[1]  Steven C Bankes,et al.  Tools and techniques for developing policies for complex and uncertain systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[2]  P. Reed,et al.  Navigating financial and supply reliability tradeoffs in regional drought management portfolios , 2014 .

[3]  Patrick M. Reed,et al.  Many objective visual analytics: rethinking the design of complex engineered systems , 2013 .

[4]  Warren E. Walker,et al.  Adapt or Perish: A Review of Planning Approaches for Adaptation under Deep Uncertainty , 2013 .

[5]  Eugene Z. Stakhiv,et al.  Managing the nation's water in a changing climate , 1998 .

[6]  B. Roy Decision-aid and decision-making , 1990 .

[7]  D. H. Marks,et al.  Multiobjective screening models and water resource investment , 1973 .

[8]  Benjamin P. Bryant,et al.  Thinking Inside the Box , 2010 .

[9]  Casey Brown,et al.  An alternate approach to assessing climate risks , 2012 .

[10]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[11]  Jan H. Kwakkel,et al.  Exploratory Modeling and Analysis, an approach for model-based foresight under deep uncertainty , 2013 .

[12]  Jon C. Liebman,et al.  Some Simple-Minded Observations on the Role of Optimization in Public Systems Decision-Making , 1976 .

[13]  Katherine E. Lownsbery Quantifying the Impacts of Future Uncertainties on the Apalachicola-Chattahoochee-Flint Basin , 2014 .

[14]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[15]  A. Ostfeld,et al.  Robust optimization for water distribution systems least cost design , 2013 .

[16]  G. Schneller,et al.  Decision making under uncertainty: Starr's Domain criterion , 1983 .

[17]  Kalyanmoy Deb,et al.  Introducing Robustness in Multi-Objective Optimization , 2006, Evolutionary Computation.

[18]  Arthur Maass,et al.  Objectives, Methods, Models. (Book Reviews: Design of Water-Resource Systems. New techniques for relating economic objectives, engineering analysis, and governmental planning) , 1962 .

[19]  Nicholas I. Fisher,et al.  Bump hunting in high-dimensional data , 1999, Stat. Comput..

[20]  Jim W. Hall,et al.  Information gap analysis of flood model uncertainties and regional frequency analysis , 2010 .

[21]  Warren E. Walker,et al.  Adaptive policies, policy analysis, and policy-making , 2001, Eur. J. Oper. Res..

[22]  R. Lempert,et al.  What are robust strategies in the face of uncertain climate threshold responses? , 2012, Climatic Change.

[23]  Andrea Castelletti,et al.  Many‐objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management , 2014 .

[24]  B. Efron,et al.  The Jackknife Estimate of Variance , 1981 .

[25]  A. Messac,et al.  Generating Well-Distributed Sets of Pareto Points for Engineering Design Using Physical Programming , 2002 .

[26]  Bernard Roy,et al.  Problems and methods with multiple objective functions , 1971, Math. Program..

[27]  Stefano Tarantola,et al.  A General Probabilistic Framework for uncertainty and global sensitivity analysis of deterministic models: A hydrological case study , 2014, Environ. Model. Softw..

[28]  S. Postel Entering an era of water scarcity: the challenges ahead. , 2000 .

[29]  H. Maier,et al.  Including adaptation and mitigation responses to climate change in a multiobjective evolutionary algorithm framework for urban water supply systems incorporating GHG emissions , 2014 .

[30]  Myles T. Collins,et al.  Managing the Risk of Uncertain Threshold Responses: Comparison of Robust, Optimum, and Precautionary Approaches , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[31]  J. Harou,et al.  Selecting Portfolios of Water Supply and Demand Management Strategies Under Uncertainty—Contrasting Economic Optimisation and ‘Robust Decision Making’ Approaches , 2013, Water Resources Management.

[32]  João C. N. Clímaco,et al.  A critical reflection on optimal decision , 2004, Eur. J. Oper. Res..

[33]  Joseph R. Kasprzyk,et al.  Water Resources Management: The Myth, the Wicked, and the Future , 2009 .

[34]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[35]  Jan H. Kwakkel,et al.  An exploratory approach for adaptive policymaking by using multi-objective robust optimization , 2014, Simul. Model. Pract. Theory.

[36]  Xavier Blasco Ferragud,et al.  Physical programming for preference driven evolutionary multi-objective optimization , 2014, Appl. Soft Comput..

[37]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[38]  Joseph R. Kasprzyk,et al.  Many objective robust decision making for complex environmental systems undergoing change , 2012, Environ. Model. Softw..

[39]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[40]  Paul Jeffrey,et al.  Linking climate projections to performance: A yield‐based decision scaling assessment of a large urban water resources system , 2014 .

[41]  S. Carpenter,et al.  Decision-making under great uncertainty: environmental management in an era of global change. , 2011, Trends in ecology & evolution.

[42]  Michael T. Griffin,et al.  Evaluating climate change induced water stress: A case study of the Lower Cape Fear basin, NC , 2013 .

[43]  P. Reed,et al.  Managing population and drought risks using many‐objective water portfolio planning under uncertainty , 2009 .

[44]  Yuqiong Liu,et al.  Linking science with environmental decision making: Experiences from an integrated modeling approach to supporting sustainable water resources management , 2008, Environ. Model. Softw..

[45]  Keith W. Hipel,et al.  Decision making in an uncertain world: information-gap modeling in water resources management , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[46]  Casey Brown,et al.  Decision scaling: Linking bottom‐up vulnerability analysis with climate projections in the water sector , 2012 .

[47]  David G. Groves,et al.  A New Analytic Method for Finding Policy-Relevant Scenarios: , 2007 .

[48]  Klaus Keller,et al.  Robust Climate Policies Under Uncertainty: A Comparison of Robust Decision Making and Info‐Gap Methods , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[49]  Casey Brown,et al.  Bottom-up climate risk assessment of infrastructure investment in the Niger River Basin , 2013, Climatic Change.

[50]  Casey M. Brown,et al.  Effect of scenario assumptions on climate change risk estimates in a water resource system , 2014 .

[51]  P. Reed,et al.  Beyond optimality: Multistakeholder robustness tradeoffs for regional water portfolio planning under deep uncertainty , 2014 .

[52]  P. Schoemaker The Expected Utility Model: Its Variants, Purposes, Evidence and Limitations , 1982 .

[53]  Patrick M. Reed,et al.  From maps to movies: High-resolution time-varying sensitivity analysis for spatially distributed watershed models , 2013 .

[54]  Julien J. Harou,et al.  Introduction to the Special Issue on “Adaptation and Resilience of Water Systems to an Uncertain Changing Climate” , 2013, Water Resources Management.

[55]  Yakov Ben-Haim,et al.  Uncertainty, probability and information-gaps , 2004, Reliab. Eng. Syst. Saf..

[56]  Richard N. Langlois,et al.  FRANK KNIGHT ON RISK, UNCERTAINTY, AND THE FIRM: A NEW INTERPRETATION , 1993 .

[57]  Erwin Zehe,et al.  Temporal dynamics of model parameter sensitivity for computationally expensive models with the Fourier amplitude sensitivity test , 2011 .

[58]  Joseph R. Kasprzyk,et al.  Many-objective de Novo water supply portfolio planning under deep uncertainty , 2012, Environ. Model. Softw..

[59]  Seth Bonder,et al.  Feature Article - Changing the Future of Operations Research , 1979, Oper. Res..

[60]  Warren E. Walker,et al.  Dynamic adaptive policy pathways: A method for crafting robust decisions for a deeply uncertain world , 2013 .

[61]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[62]  M. Hulme,et al.  Assessing the robustness of adaptation decisions to climate change uncertainties: A case study on water resources management in the East of England , 2007 .

[63]  Robert J. Lempert,et al.  Comparing Algorithms for Scenario Discovery , 2008 .

[64]  Mark E. Borsuk,et al.  Discovering plausible energy and economic futures under global change using multidimensional scenario discovery , 2013, Environ. Model. Softw..

[65]  J. Stedinger,et al.  Robustness of water resources systems , 1982 .

[66]  T. C. Chamberlin The Method of Multiple Working Hypotheses: With this method the dangers of parental affection for a favorite theory can be circumvented. , 1965, Science.

[67]  William A. Crossley,et al.  Using the Two-Branch Tournament Genetic Algorithm for Multiobjective Design , 1999 .

[68]  Desiree Tullos,et al.  Flexibility in Water Resources Management: Review of Concepts and Development of Assessment Measures for Flood Management Systems , 2014 .

[69]  Martin Reuss,et al.  Is It Time to Resurrect the Harvard Water Program , 2003 .

[70]  Gregory E. Schwarz,et al.  Socioeconomic impacts of climate change on U.S. water supplies , 1999 .

[71]  David G. Groves,et al.  Paleoclimate Scenarios to Inform Decision Making in Water Resource Management: Example from Southern California’s Inland Empire , 2014 .

[72]  Jennifer Nakamura,et al.  Drought in the Southeastern United States: Causes, Variability over the Last Millennium, and the Potential for Future Hydroclimate Change* , 2009 .

[73]  C. Vörösmarty,et al.  Global water resources: vulnerability from climate change and population growth. , 2000, Science.

[74]  Patrick M. Reed,et al.  Time‐varying sensitivity analysis clarifies the effects of watershed model formulation on model behavior , 2013 .

[75]  H. Zeff,et al.  Managing water utility financial risks through third-party index insurance contracts , 2013 .

[76]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[77]  D. H. Marks,et al.  A review and evaluation of multiobjective programing techniques , 1975 .

[78]  Ralph L. Keeney,et al.  Improving the Generation of Decision Objectives , 2010, Decis. Anal..

[79]  David G. Groves,et al.  Developing Key Indicators for Adaptive Water Planning , 2015 .

[80]  Howard S. Wheater,et al.  Assessing the Vulnerability of Water Supply to Changing Streamflow Conditions , 2014 .

[81]  Julien J. Harou,et al.  Robust Decision Making and Info-Gap Decision Theory for water resource system planning , 2013 .

[82]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[83]  R. Wilby,et al.  Scenario-neutral approach to climate change impact studies: Application to flood risk , 2010 .

[84]  E. Hawkins,et al.  The potential to narrow uncertainty in projections of regional precipitation change , 2011 .

[85]  David W. Watkins,et al.  Finding Robust Solutions to Water Resources Problems , 1997 .

[86]  Emanuele Borgonovo,et al.  Global sensitivity measures from given data , 2013, Eur. J. Oper. Res..

[87]  Leonard J. Savage,et al.  The Theory of Statistical Decision , 1951 .

[88]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[89]  John A. Hall,et al.  Improving the contribution of climate model information to decision making: the value and demands of robust decision frameworks , 2013 .

[90]  Ralph L. Keeney,et al.  Generating Objectives: Can Decision Makers Articulate What They Want? , 2008, Manag. Sci..

[91]  David G. Groves,et al.  A General, Analytic Method for Generating Robust Strategies and Narrative Scenarios , 2006, Manag. Sci..

[92]  Charles J. Hitch,et al.  On the Choice of Objectives in Systems Studies , 1960 .

[93]  H. Spencer Banzhaf,et al.  Objective or Multi-Objective? Two Historically Competing Visions for Benefit-Cost Analysis , 2009, Land Economics.

[94]  Richard M. Vogel,et al.  Indicators of Impacts of Global Climate Change on U.S. Water Resources , 1999 .

[95]  Antonio F. Gómez-Skarmeta,et al.  Multi-objective evolutionary computation and fuzzy optimization , 2006, Int. J. Approx. Reason..

[96]  Robert J Lempert,et al.  A new decision sciences for complex systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[97]  Jeroen P. van der Sluijs,et al.  What do I make of your Latinorum? Sensitivity auditing of mathematical modelling. , 2012, 1211.2668.

[98]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[99]  Alexis Tsoukiàs,et al.  From decision theory to decision aiding methodology , 2008, Eur. J. Oper. Res..

[100]  E. Hawkins,et al.  The Potential to Narrow Uncertainty in Regional Climate Predictions , 2009 .

[101]  Yakov Ben-Haim,et al.  Why Risk Analysis is Difficult, and Some Thoughts on How to Proceed , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[102]  Kenneth D. Frederick,et al.  Climate Change and Water Resources , 1997 .

[103]  John F. B. Mitchell,et al.  The next generation of scenarios for climate change research and assessment , 2010, Nature.

[104]  Casey Brown,et al.  Robustness indicators for evaluation under climate change: Application to the upper Great Lakes , 2013 .

[105]  Rebecca A. Kelly,et al.  A formal framework for scenario development in support of environmental decision-making , 2009, Environ. Model. Softw..

[106]  R. Lempert,et al.  Identifying and evaluating robust adaptive policy responses to climate change for water management agencies in the American west , 2010 .

[107]  R. Lempert,et al.  Shaping the Next One Hundred Years: New Methods for Quantitative Long-Term Policy Analysis , 2003 .