Testing the scenario hypothesis: An experimental comparison of scenarios and forecasts for decision support in a complex decision environment

Decision support tools are known to influence and facilitate decisionmaking through the thoughtful construction of the decision environment. However, little research has empirically evaluated the effects of using scenarios and forecasts. In this research, we asked participants to recommend a fisheries management strategy that achieved multiple objectives in the face of significant uncertainty. A decision support tool with one of two conditionsScenario or Forecastencouraged participants to explore a large set of diversified decision options. We found that participants in the two conditions explored the options similarly, but chose differently. Participants in the Scenario Condition chose the strategies that performed well over the full range of uncertainties (robust strategies) significantly more frequently than did those in the Forecast Condition. This difference seems largely to be because participants in the Scenario Condition paid increased attention to worst-case futures. The results offer lessons for designing decision support tools.

[1]  P. Schoemaker.  MULTIPLE SCENARIO DEVELOPMENT: ITS CONCEPTUAL AND BEHAVIORAL FOUNDATION , 1993 .

[2]  C. Clark.  Mathematical Bioeconomics: The Mathematics of Conservation , 2010 .

[3]  David A. Fournier,et al.  A General Theory for Analyzing Catch at Age Data , 1982 .

[4]  Otto Bird.  The Idea of Justice , 1967 .

[5]  Colin Camerer,et al.  Decision processes for low probability events: Policy implications , 1989 .

[6]  Nebojsa Nakicenovic,et al.  Identifying dangers in an uncertain climate , 2001, Nature.

[7]  B. Fischhoff,et al.  Preference for Insuring against Probable Small Losses: Insurance Implications , 1977 .

[8]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[9]  Daniel G. Goldstein,et al.  Beyond nudges: Tools of a choice architecture , 2012 .

[10]  K. Reinhardt.  Shaping The Next One Hundred Years New Methods For Quantitative Long Term Policy Analysis , 2016 .

[11]  R. Hastie,et al.  The common knowledge effect: Information sharing and group judgment. , 1993 .

[12]  S. Schneider.  What is 'dangerous' climate change? , 2001, Nature.

[13]  M. Hulme,et al.  Does climate adaptation policy need probabilities? , 2004 .

[14]  Benjamin P. Bryant,et al.  Thinking Inside the Box , 2010 .

[15]  M. H. Duong,et al.  Integrated Risk and Uncertainty Assessment of Climate Change Response Policies , 2014 .

[16]  Schneider,et al.  All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects. , 1998, Organizational behavior and human decision processes.

[17]  David G. Groves,et al.  Adapting to a Changing Colorado River Making Future Water Deliveries More Reliable Through Robust Management Strategies , 2013 .

[18]  Roger W. Jones,et al.  Foundations for decision making , 2014 .

[19]  Myles T. Collins,et al.  Managing the Risk of Uncertain Threshold Responses: Comparison of Robust, Optimum, and Precautionary Approaches , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[21]  Milner B. Schaefer.  Some aspects of the dynamics of populations important to the management of the commercial marine fisheries , 1991 .

[22]  Robert J. Lempert,et al.  Scenarios that illuminate vulnerabilities and robust responses , 2013, Climatic Change.

[23]  George Wright,et al.  Scenario methodology: New developments in theory and practice: Introduction to the Special Issue , 2013 .

[24]  Stephen M. Johnson,et al.  The affect heuristic in judgments of risks and benefits , 2000 .

[25]  J. Yates,et al.  The Cambridge Handbook of Expertise and Expert Performance: Decision-Making Expertise , 2006 .

[26]  Paul Slovic,et al.  Affect, risk, and decision making. , 2005, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[27]  Jan H. Kwakkel,et al.  Dynamic scenario discovery under deep uncertainty: The future of copper , 2013 .

[28]  Kristine M. Kuhn,et al.  Confidence and Uncertainty in Judgmental Forecasting: Differential Effects of Scenario Presentation , 1996 .

[29]  D. Kahan,et al.  Cultural Cognition and Public Policy , 2005 .

[30]  K. Stanovich.  Rationality and the Reflective Mind , 2010 .

[31]  Lutz E. Schlange.  Scenarios: The art of strategic conversation , 1997 .

[32]  D. Winterfeldt.  Structuring decision problems for decision analysis , 1980 .

[33]  Peter C. Bishop,et al.  The current state of scenario development: an overview of techniques , 2007 .

[34]  Andrew M. Parker,et al.  Published online in Wiley InterScience (www.interscience.wiley.com) DOI: 10.1002/bdm.481 Decision-making Competence: External Validation through an Individual-differences Approach , 2005 .

[35]  Timo Mäntylä,et al.  Option generation in decision making: ideation beyond memory retrieval , 2015, Front. Psychol..

[36]  R. Dunlap,et al.  Measuring Endorsement of the New Ecological Paradigm: A Revised NEP Scale , 2000 .

[37]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[38]  C. Rosenzweig,et al.  Global-Change Scenarios: Their Development and Use , 2007 .

[39]  R. Gifford,et al.  Free-Market Ideology and Environmental Degradation , 2006 .

[40]  David W. Keith,et al.  Improving the way we think about projecting future energy use and emissions of carbon dioxide , 2008 .

[41]  Peter Schwartz,et al.  The Art of the Long View: Planning for the Future in an Uncertain World , 1996 .

[42]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[43]  George Cairns,et al.  Does the intuitive logics method – and its recent enhancements – produce “effective” scenarios? , 2013 .

[44]  H. Kunreuther.  Disaster Insurance Protection: Public Policy Lessons , 1978 .

[45]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[46]  B. Johnson.  Risk Communication: A Mental Models Approach , 2002 .

[47]  B. R. Turris,et al.  A comparison of British Columbia's ITQ fisheries for groundfish trawl and sablefish: similar results from programmes with differing objectives, designs and processes. , 2000 .

[48]  Mark E. Borsuk,et al.  Discovering plausible energy and economic futures under global change using multidimensional scenario discovery , 2013, Environ. Model. Softw..