Uncertainty Forecasts Improve Decision Making Among Nonexperts

The objective of this research was to evaluate the impact of weather uncertainty information on decision making in naturalistic settings. Traditional research often reveals deficits in human decision making under uncertainty as compared with normative models of rational choice. However, little research has addressed the question of whether people in naturalistic settings make better decisions when they have uncertainty information as compared with when they have only a deterministic forecast. Two studies investigated the effect of several types of weather uncertainty information on the quality of decisions to protect roads against icing and on temperature predictions and compared them with a control condition that provided deterministic forecast only. Experiment 1 was a Web-based questionnaire that included a single trial. Experiment 2, conducted in lab, included 120 trials and provided outcome feedback and a reward based on performance. Both studies indicated enhanced performance with uncertainty information. The best kind of uncertainty information tested here was the one that provided the probability at the threshold for the task at hand. We conclude that uncertainty information can be used advantageously, even when it does not result in perfectly rational performance, and that uncertainty can be communicated effectively to nonexpert end users, resulting in improved decision making.

[1]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[2]  Stanley A. Changnon,et al.  Uses and Applications of Climate Forecasts for Power Utilities , 1995 .

[3]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[4]  J. E. Russo,et al.  Decision traps : ten barriers to brilliant decision-making and how to overcome them , 1989 .

[5]  Robert L. Goldstone,et al.  Handbook of cognition , 2005 .

[6]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[7]  Gerd Gigerenzer,et al.  “A 30% Chance of Rain Tomorrow”: How Does the Public Understand Probabilistic Weather Forecasts? , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[8]  Christine L. Jocoy,et al.  Feeling at Risk Matters: Water Managers and the Decision to Use Forecasts , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[9]  Frank C. Day,et al.  The Roulette Wheel: An Aid to Informed Decision Making , 2006, PLoS medicine.

[10]  Anthony Patt.  Understanding uncertainty: forecasting seasonal climate for farmers in Zimbabwe , 2001 .

[11]  J. Baron.  Thinking and deciding, 3rd ed. , 2000 .

[12]  Susan Joslyn,et al.  Strategies in Naturalistic Decision-Making : A cognitive Task Analysis of Naval Weather Forecasting 1 , 2006 .

[13]  Gary E. Bolton,et al.  A Laboratory Study of the Benefits of Including Uncertainty Information in Weather Forecasts , 2006 .

[14]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[15]  Elke U. Weber,et al.  The Interpretation of 'Likely' Depends on the Context, But 70% is 70% - Right? The Influence of Associative Processes on Perceived Certainty , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[16]  O. Huber,et al.  Active information search and complete information presentation in naturalistic risky decision tasks , 1997 .

[17]  William G. Cole,et al.  Understanding Bayesian reasoning via graphical displays , 1989, CHI '89.

[18]  冨山 芳幸,et al.  「Completing the Forecast : Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts」, National Research Council著, The National Academies Press, 2006年, 112頁, 25.88ドル, ISBN-13:978-0-309-10255-1(本だな) , 2007 .

[19]  Adrian E. Raftery,et al.  Weather Forecasting with Ensemble Methods , 2005, Science.

[20]  A. Damasio,et al.  Deciding Advantageously Before Knowing the Advantageous Strategy , 1997, Science.

[21]  T. Gilovich,et al.  Heuristics and Biases: Introduction – Heuristics and Biases: Then and Now , 2002 .

[22]  Susan Joslyn,et al.  The Effect of Probabilistic Information on Threshold Forecasts , 2007 .

[23]  Richard A. Griggs,et al.  The elusive thematic‐materials effect in Wason's selection task , 1982 .

[24]  H. Simon,et al.  Models of Thought , 1979 .

[25]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[26]  Limor Nadav-Greenberg,et al.  The Effect of Uncertainty Visualizations on Decision Making in Weather Forecasting , 2008 .

[27]  Roger S. Pulwarty,et al.  Climate and Salmon Restoration in the Columbia River Basin: The Role and Usability of Seasonal Forecasts , 1997 .

[28]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[29]  Nir Vulkan.  An Economist's Perspective on Probability Matching , 2000 .

[30]  L. Cosmides,et al.  Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty , 1996, Cognition.

[31]  J. Baron.  Thinking and Deciding , 2023 .

[32]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[33]  Mirjam R. M. Westenberg.  Decision traps: The ten barriers to brilliant decision-making & how to overcome them : J.E. Russo and P.J.H. Schoemaker, Doubleday, New York, 1989. 280 pp. $19.95, ISBN 0-385-24835-0 , 1993 .

[34]  E. Baker.  Public Response to Hurricane Probability Forecasts , 1995 .

[35]  Gerd Gigerenzer,et al.  The "conjunction fallacy" revisited : How intelligent inferences look like reasoning errors , 1999 .

[36]  B. Fischhoff,et al.  Judgment and decision making. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[37]  D. Bernoulli.  Exposition of a New Theory on the Measurement of Risk , 1954 .

[38]  E. Weber.  From Subjective Probabilities to Decision Weights: The Effect of Asymmetric Loss Functions on the Evaluation of Uncertain Outcomes and Events , 1994 .

[39]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[40]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[41]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .