Diversity in Interpretations of Probability: Implications for Weather Forecasting

Over the last years, probability weather forecasts have become increasingly popular due in part to the development of ensemble forecast systems. Despite its widespread use in atmospheric sciences, probability forecasting remains a subtle and ambiguous way of representing the uncertainty related to a future meteorological situation. There are several schools of thought regarding the interpretation of probabilities, none of them without flaws, internal contradictions, or paradoxes. Usually, researchers tend to have personal views that are mostly based on intuition and follow a pragmatic approach. These conceptual differences may not matter when accuracy of a probabilistic forecast is measured over a long period (e.g., through the use of Brier score), which may be useful for particular objectives such as cost/benefit decision making. However, when scientists wonder about the exact meaning of the probabilistic forecast in a single case (e.g., rare and extreme event), the differences of interpretation become important. This work intends to describe this problem by first drawing attention to the more commonly accepted interpretations of probability, and then, the consequences of these assumptions are studied. Results suggest that without agreement on the interpretation, the usefulness of the probability forecast as a tool for single events—which include record-breaking events—remains unknown. An open discussion of this topic within the community would be useful to clarify the communication among researchers, with the public and with decision makers.

[1]  E. Epstein,et al.  Stochastic dynamic prediction , 1969 .

[2]  E. Epstein,et al.  Stochastic dynamic prediction1 , 1969 .

[3]  T. Hamill Interpretation of Rank Histograms for Verifying Ensemble Forecasts , 2001 .

[4]  Neville Nicholls,et al.  Cognitive Illusions, Heuristics, and Climate Prediction , 1999 .

[5]  F. N. David,et al.  Games, gods and gambling: The origins and history of probability and statistical ideas from the earliest times to the Newtonian era , 1963 .

[6]  D. Richardson Skill and relative economic value of the ECMWF ensemble prediction system , 2000 .

[7]  M. Ehrendorfer The Liouville Equation and Its Potential Usefulness for the Prediction of Forecast Skill. Part II: Applications , 1994 .

[8]  A. H. Murphy,et al.  The Early History of Probability Forecasts: Some Extensions and Clarifications , 1998 .

[9]  F. Butzen,et al.  The Science of Conjecture: Evidence and Probability Before Pascal , 2002 .

[10]  F. Atger,et al.  Spatial and Interannual Variability of the Reliability of Ensemble-Based Probabilistic Forecasts: Consequences for Calibration , 2003 .

[11]  Thomas R. Stewart,et al.  Improving Reliability of Judgmental Forecasts , 2001 .

[12]  A. H. Murphy,et al.  Forecasters and Probability Forecasts: the Responses to a Questionnaire , 1971 .

[13]  E. Byrne Probability and opinion: A Study in the Medieval Presuppositions of Post-Medieval Theories of Probability , 1968 .

[14]  M. Smithson Ignorance and Uncertainty , 1989, Cognitive Science.

[15]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[16]  M. Ehrendorfer The Liouville Equation and Its Potential Usefulness for the Prediction of Forecast Skill. Part I: Theory , 1994 .

[17]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[18]  A. H. Murphy,et al.  Scalar and Vector Partitions of the Probability Score: Part I. Two-State Situation , 1972 .

[19]  Roy Weatherford,et al.  Philosophical Foundations of Probability Theory , 2022 .

[20]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[21]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[22]  A. H. Murphy,et al.  forecasters and probability forecasts: some current problems1,2 , 1971 .

[23]  A. H. Murphy,et al.  Forecast value: prototype decision-making models , 1997 .

[24]  Francis W. Zwiers,et al.  Seasonal predictions based on two dynamical models , 2001 .

[25]  D. Gillies Philosophical Theories of Probability , 2000 .

[26]  A. H. Murphy,et al.  Misinterpretations of precipitation probability forecasts , 1980 .

[27]  Thomas M. Hamill,et al.  Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective Forecasts , 2004 .

[28]  Rex J. Fleming,et al.  ON STOCHASTIC DYNAMIC PREDICTION , 1971 .

[29]  A. Persson User Guide to ECMWF forecast products , 2001 .