Verification of River Stage Forecasts

Little verification of hydrologic forecasts has been conducted to date, and therefore little is known about the skill of hydrologic forecasts. This dissertation presents a verification study of river stage forecasts with lead-times up to three days for sixteen locations in the United States for a period spanning the past decade. The verification metrics from this limited sample indicate that the below flood stage forecasts are skillful, and so are the day 1 above flood stage forecasts. However, by day 3, the longer lead-time, above flood stage forecasts appear to have little skill (when compared with simple persistence). Further, they have not improved during the period of record despite a number of forecast process improvements. A path to improving the forecasts is suggested, via a new approach to selecting enhancements to the hydrologic forecast process. In support of this method, two fundamental building blocks of a robust verification program are presented: a method to pinpoint sources of skill in forecasts, and a standardized process for verifying forecasts. One element of a complete verification system is a process to determine why forecasts behave as they do. Forecasters need to be able to determine what causes a forecast to be good and what causes it to be bad. Therefore, an operationally implementable method for conducting this type of verification analysis is described and demonstrated. The method is used to evaluate the influence of model calibration, model initial conditions, and precipitation forecasts on the skill of single-valued (deterministic) river forecasts.

[1]  Roman Krzysztofowicz,et al.  Hydrologic uncertainty processor for probabilistic river stage forecasting: precipitation-dependent model , 2001 .

[2]  Dong-Jun Seo,et al.  Real-time estimation of rainfall fields using radar rainfall and rain gage data , 1998 .

[3]  A. H. Murphy,et al.  A General Framework for Forecast Verification , 1987 .

[4]  F. Zwiers,et al.  The interpretation and estimation of effective sample size , 1984 .

[5]  Kuldeep Kumar,et al.  Forecast Verification: a Practitioner's Guide in Atmospheric Sciences , 2005 .

[6]  R. E. Livezey,et al.  A Skill Analysis of Soviet Seasonal Weather Forecasts , 1977 .

[7]  A. H. Murphy,et al.  What Is a Good Forecast? An Essay on the Nature of Goodness in Weather Forecasting , 1993 .

[8]  S. Sorooshian,et al.  CONFIDENCE BUILDERS Evaluating Seasonal Climate Forecasts from User Perspectives , 2002 .

[9]  Roman Krzysztofowicz,et al.  Calibration of Probabilistic Quantitative Precipitation Forecasts , 1999 .

[10]  Jay P. Breidenbach,et al.  Real-Time Correction of Spatially Nonuniform Bias in Radar Rainfall Data Using Rain Gauge Measurements , 2002 .

[11]  Dong-Jun Seo,et al.  The distributed model intercomparison project (DMIP): Motivation and experiment design , 2004 .

[12]  J. Michael Fritsch,et al.  Improving quantitative precipitation forecasts in the warm season: A USWRP research and development strategy , 2004 .

[13]  Roman Krzysztofowicz,et al.  Bayesian theory of probabilistic forecasting via deterministic hydrologic model , 1999 .

[14]  Eric A. Anderson,et al.  National Weather Service river forecast system: snow accumulation and ablation model , 1973 .

[15]  Witold F. Krajewski,et al.  Evaluating NEXRAD Multisensor Precipitation Estimates for Operational Hydrologic Forecasting , 2000 .

[16]  Stephen E. Fienberg,et al.  The Comparison and Evaluation of Forecasters. , 1983 .

[17]  Glenn W. Brier,et al.  Verification of Weather Forecasts , 1951 .

[18]  Bob Glahn,et al.  FORECASTER'S FORUM Discussion of Verification Concepts in Forecast Verification: A Practitioner's Guide in Atmospheric Science , 2004 .

[19]  Allan H. Murphy,et al.  Comparative Evaluation of Weather Forecasting Systems: Sufficiency, Quality, and Accuracy , 1988 .

[20]  M. A. Kohler,et al.  Hydrology for engineers , 1958 .

[21]  B. McDonald.  The NWS National QPF Verification Program , 2000 .

[22]  M. Clark,et al.  Climate Index Weighting Schemes for NWS ESP-Based Seasonal Volume Forecasts , 2004 .

[23]  A. H. Murphy,et al.  Equitable Skill Scores for Categorical Forecasts , 1992 .

[24]  David G. Morris.  A categorical, event oriented, flood forecast verification system for National Weather Service hydrology , 1988 .

[25]  S. Sorooshian,et al.  Evaluation of Official Western U.S. Seasonal Water Supply Outlooks, 1922–2002 , 2004 .

[26]  A. H. Murphy,et al.  Diagnostic Verification of Temperature Forecasts , 1989 .

[27]  Harold E. Brooks,et al.  Verification of Public Weather Forecasts Available via the Media , 1997 .

[28]  Kevin E. Trenberth,et al.  Some Effects of Finite Sample Size and Persistence on Meteorological Statistics.Part II: Potential Predictability , 1984 .

[29]  Soroosh Sorooshian,et al.  Verification of National Weather Service Ensemble Streamflow Predictions for Water Supply Forecasting in the Colorado River Basin , 2003 .

[30]  A. H. Murphy.  The Finley Affair: A Signal Event in the History of Forecast Verification , 1996 .

[31]  Gary W. Yohe,et al.  Economic Value of Weather and Climate Forecasts , 1998 .

[32]  Eugenia Kalnay,et al.  Three years of operational prediction of forecast skill at NMC , 1995 .

[33]  Michael D. Hudlow,et al.  Technological developments in real-time operational hydrologic forecasting in the United States , 1988 .

[34]  Roman Krzysztofowicz,et al.  Hydrologic uncertainty processor for probabilistic stage transition forecasting , 2004 .

[35]  Dong-Jun Seo,et al.  Real-Time Variational Assimilation of Hydrologic and Hydrometeorological Data into Operational Hydrologic Forecasting , 2003 .