The Complex Relationship between Forecast Skill and Forecast Value: A Real-World Analysis

Abstract For routine forecasts of temperature and precipitation, the relative skill advantage of human forecasters with respect to the numerical–statistical guidance is small (and diminishing). Since the relationship between forecast skill and the value of those forecasts is complex, the authors have examined their value across a range of real-world user contexts. It is found that although in most cases the meteorological information possessed considerable value to the users, human intervention in making those forecasts (as measured by National Weather Service forecasts) has generally led to minimal gains in value beyond that which is obtainable through direct use of numerical–statistical guidance. An important exception is the use of meteorological information by gas utilities during peak wintertime periods; in those circumstances, the value of human intervention was considerable. The presence of information in the National Weather Service forecasts independent of that contained in the numerical–statisti...

[1]  A. H. Murphy,et al.  Measures of the Utility of Probabilistic Predictions in Cost-Loss Ratio Decision Situations in which Knowledge of the Cost-Loss Ratios is Incomplete , 1969 .

[2]  H. Jean Thiebaux Experiments with Correlation Representations for Objective Analysis , 1975 .

[3]  A. H. Murphy,et al.  The Value of Climatological, Categorical and Probabilistic Forecasts in the Cost-Loss Ratio Situation , 1977 .

[4]  David Suchman,et al.  Some Economic Effects of Private Meteorological Forecasting , 1979 .

[5]  Autocorrelations of Moisture Parameters on Isentropic Surfaces , 1981 .

[6]  Wrap or Not? News Delivery Dilemma. , 1982 .

[7]  An Update on Trends in Skill of Daily Forecasts of Temperature and Precipitation at the State University of New York at Albany , 1983 .

[8]  Trends in skill of Boston forecasts made at MIT, 1966-84 , 1986 .

[9]  A. H. Murphy,et al.  A General Framework for Forecast Verification , 1987 .

[10]  A. H. Murphy,et al.  Skill Scores Based on the Mean Square Error and Their Relationships to the Correlation Coefficient , 1988 .

[11]  Frederick G. Shuman,et al.  History of Numerical Weather Prediction at the National Meteorological Center , 1989 .

[12]  Eugenia Kalnay,et al.  Global Numerical Weather Prediction at the National Meteorological Center , 1990 .

[13]  R. C. Sheets The National Hurricane Center—Past, Present, and Future , 1990 .

[14]  Frederick P. Ostby Operations of the National Severe Storms Forecast Center , 1992 .

[15]  Roman Krzysztofowicz,et al.  Probabilistic Quantitative Precipitation Forecasts for River Basins , 1993, Weather and Forecasting.

[16]  Lance F. Bosart,et al.  An assessment of thunderstorm probability forecasting skill , 1994 .

[17]  Robert L. Vislocky,et al.  Improved Model Output Statistics Forecasts through Model Consensus , 1995 .

[18]  A. H. Murphy,et al.  Screening probability forecasts: contrasts between choosing and combining , 1995 .

[19]  Norman W. Junker,et al.  Evaluation of 33 Years of Quantitative Precipitation Forecasting at the NMC , 1995 .

[20]  Paul J. Roebber,et al.  The Contributions of Education and Experience to Forecast Skill , 1996 .

[21]  A. H. Murphy,et al.  Economic value of weather and climate forecasts , 1997 .