Cry Wolf or Equivocate? Credible Forecast Guidance in a Cost-Loss Game

What is the most credible way to convey the risk in expert forecasts to the nonexpert decision makers who use the forecast? We test two ways to communicate this information: provide an unequivocal recommendation or equivocate by providing the probability of the uncertain event of interest. We use a simple game in which human subjects (the forecast users) decide whether to take a risk of a loss or pay a cost to avoid the risk. We find that the influence of forecast information differs depending on whether the information implies that the decision maker should take the status quo action, the preforecast optimal action, or the siren action, optimal only if the period-by-period forecast implies it. Unequivocal recommendations are more successful at inducing the status quo action. Equivocating by providing probabilities is more successful at inducing the siren action. Unequivocal recommendations to take the siren action are less effective because the false certainty makes them more vulnerable to the “cry wolf”...

[1]  Joachim Meyer,et al.  Why Better Operators Receive Worse Warnings , 2002, Hum. Factors.

[2]  D. Budescu,et al.  Preferences and reasons for communicating probabilistic information in verbal or numerical terms , 1993 .

[3]  Mark R. Lehto,et al.  Improving the effectiveness of warnings by increasing the appropriateness of their information content: some hypotheses about human compliance , 1996 .

[4]  P. Kolesar,et al.  Improving Emergency Responsiveness with Management Science , 2004 .

[5]  A. Tversky,et al.  A Belief-Based Account of Decision Under Uncertainty , 1998 .

[6]  E. Weber From Subjective Probabilities to Decision Weights: The Effect of Asymmetric Loss Functions on the Evaluation of Uncertain Outcomes and Events , 1994 .

[7]  Dean P. Foster,et al.  Graininess of judgment under uncertainty: An accuracy-informativeness trade-off , 1995 .

[8]  Adam J. L. Harris,et al.  Communicating environmental risks: Clarifying the severity effect in interpretations of verbal probability expressions. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[9]  David V. Budescu,et al.  Subjective estimation of precise and vague uncertainties. , 1987 .

[10]  Nate Silver,et al.  The signal and the noise : why so many predictions fail but some don't , 2012 .

[11]  Leonard A. Smith,et al.  The Boy Who Cried Wolf Revisited: The Impact of False Alarm Intolerance on Cost-Loss Scenarios , 2004 .

[12]  Dean P. Foster,et al.  Precision and Accuracy of Judgmental Estimation , 1997 .

[13]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[14]  S. Breznitz Cry Wolf: The Psychology of False Alarms , 1984 .

[15]  Elke U. Weber,et al.  Contextual Effects in the Interpretations of Probability Words: Perceived Base Rate and Severity of Events , 1990 .

[16]  J P Bliss,et al.  Human probability matching behaviour in response to alarms of varying reliability. , 1995, Ergonomics.

[17]  Ido Erev,et al.  The Negative Effect of Probability Assessments on Decision Quality , 1993 .

[18]  David V. Budescu,et al.  Improving Communication of Uncertainty in the Reports of the Intergovernmental Panel on Climate Change , 2009, Psychological science.

[19]  Yuval Rottenstreich,et al.  On decision making without likelihood judgment. , 2006 .

[20]  Amnon Rapoport,et al.  Measuring the Vague Meanings of Probability Terms , 1986 .

[21]  Lawrence M. Wein,et al.  Analyzing Bioterror Response Logistics: The Case of Anthrax , 2005, Manag. Sci..

[22]  Edieal J. Pinker An Analysis of Short-Term Responses to Threats of Terrorism , 2007, Manag. Sci..

[23]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[24]  Tzur M. Karelitz,et al.  You say "probable" and I say "likely": improving interpersonal communication with verbal probability phrases. , 2004, Journal of experimental psychology. Applied.

[25]  Peter J. Kolesar,et al.  ANNIVERSARY ARTICLE: Improving Emergency Responsiveness with Management Science , 2004, Manag. Sci..

[26]  Gary E. Bolton,et al.  A Laboratory Study of the Benefits of Including Uncertainty Information in Weather Forecasts , 2006 .

[27]  S. Broomell,et al.  Effective communication of uncertainty in the IPCC reports , 2012, Climatic Change.