Snow Model Verification Using Ensemble Prediction and Operational Benchmarks

Hydrologic model evaluations have traditionally focused on measuring how closely the model can simulate various characteristics of historical observations. Although advancing hydrologic forecasting is an often-stated goal of numerous modeling studies, testing in a forecasting mode is seldom undertaken, limiting information derived from these analyses. One can overcome this limitation through generation, and subsequent analysis, of ensemble hindcasts. In this study, long-range ensemble hindcasts are generated for the available period of record for a basin in southwestern Idaho for the purpose of evaluating the Snow– Atmosphere–Soil Transfer (SAST) model against the current operational benchmark, the National Weather Service’s (NWS) snow accumulation and ablation model SNOW17. Both snow models were coupled with the NWS operational rainfall runoff model and ensembles of seasonal discharge and weekly snow water equivalent (SWE) were evaluated. Ensemble predictions from both the SAST and SNOW17 models were better than climatology forecasts, for the period studied. In most cases, the accuracy of the SAST-generated predictions was similar to the SNOW17-generated predictions, except during periods of significant melting. Differences in model performance are partially attributed to initial condition errors. After updating the SWE state in the snow models with the observed SWE, the forecasts were improved during the first 2–4 weeks of the forecast window and the skills were essentially equal in both forecasting systems for the study watershed. Climate dominated the forecast uncertainty in the latter part of the forecast window while initial conditions controlled the forecast skill in the first 3–4 weeks of the forecast. The use of hindcasting in the snow model analysis revealed that, given the dominance of the initial conditions on forecast skill, streamflow predictions will be most improved through the use of state updating.

[1]  Martyn P. Clark,et al.  Incorporating Medium-Range Numerical Weather Model Output into the Ensemble Streamflow Prediction System of the National Weather Service , 2005 .

[2]  M. Clark,et al.  Use of Medium-Range Numerical Weather Prediction Model Output to Produce Forecasts of Streamflow , 2004 .

[3]  T. Hamill The National Weather Service River Forecast System , 1999 .

[4]  Dong-Jun Seo,et al.  Real-Time Variational Assimilation of Hydrologic and Hydrometeorological Data into Operational Hydrologic Forecasting , 2003 .

[5]  Frederick B. Pierson,et al.  Long‐Term Stream Discharge and Suspended‐Sediment Database, Reynolds Creek Experimental Watershed, Idaho, United States , 2001 .

[6]  Soroosh Sorooshian,et al.  Operational snow modeling: Addressing the challenges of an energy balance model for National Weather Service forecasts , 2008 .

[7]  Arun Kumar,et al.  Long‐range experimental hydrologic forecasting for the eastern United States , 2002 .

[8]  S. Sorooshian,et al.  A multistep automatic calibration scheme for river forecasting models , 2000 .

[9]  H. Gupta,et al.  Real-Time Data Assimilation for Operational Ensemble Streamflow Forecasting , 2006 .

[10]  Clifford F. Mass,et al.  Description and evaluation of a hydrometeorological forecast system for mountainous watersheds , 2002 .

[11]  Eric A. Anderson,et al.  National Weather Service river forecast system: snow accumulation and ablation model , 1973 .

[12]  Albert Rango,et al.  Operational snowmelt runoff forecasting in the Spanish Pyrenees using the snowmelt runoff model , 2002 .

[13]  Soroosh Sorooshian,et al.  Comparative Analyses of Physically Based Snowmelt Models for Climate Simulations , 1999 .

[14]  Richard P. Hooper,et al.  Testing and validating environmental models , 1996 .

[15]  Edward S. Epstein,et al.  A Scoring System for Probability Forecasts of Ranked Categories , 1969 .

[16]  D. Marks Research data collection at the Reynolds Creek Experimental Watershed , 2007 .

[17]  R. Jordan A One-dimensional temperature model for a snow cover : technical documentation for SNTHERM.89 , 1991 .

[18]  Newsha K. Ajami,et al.  Hydrologic ensemble prediction experiment focuses on reliable forecasts , 2005 .

[19]  E. Anderson,et al.  A point energy and mass balance model of a snow cover , 1975 .

[20]  A. H. Murphy,et al.  A General Framework for Forecast Verification , 1987 .

[21]  Arun Kumar,et al.  A retrospective assessment of National Centers for Environmental Prediction climate model-based ensemble hydrologic forecasting in the western United States , 2005 .

[22]  David C. Robertson,et al.  Long‐Term Snow Database, Reynolds Creek Experimental Watershed, Idaho, United States , 2001 .

[23]  R. Dickinson,et al.  One-dimensional snow water and energy balance model for vegetated surfaces , 1999 .

[24]  Gerald N. Flerchinger,et al.  Thirty‐five years of research data collection at the Reynolds Creek Experimental Watershed, Idaho, United States , 2001 .

[25]  Qingyun Duan,et al.  NOAA'S Advanced Hydrologic Prediction Service: Building Pathways for Better Science in Water Forecasting , 2005 .

[26]  Soroosh Sorooshian,et al.  Verification of National Weather Service Ensemble Streamflow Predictions for Water Supply Forecasting in the Colorado River Basin , 2003 .

[27]  Tempei Hashino,et al.  Distributions-Oriented Verification of Ensemble Streamflow Predictions , 2004 .

[28]  A. Rango,et al.  MODEL ACCURACY IN SNOWMELT-RUNOFF FORECASTS EXTENDING FROM 1 TO 20 DAYS , 1994 .

[29]  Yongkang Xue,et al.  A simple snow-atmosphere-soil transfer model , 1999 .

[30]  Dennis P. Lettenmaier,et al.  Columbia River Streamflow Forecasting Based on ENSO and PDO Climate Signals , 1999 .

[31]  Gerald N. Day,et al.  Extended Streamflow Forecasting Using NWSRFS , 1985 .

[32]  Clayton L. Hanson,et al.  Long‐Term Soil Water Content Database, Reynolds Creek Experimental Watershed, Idaho, United States , 2001 .

[33]  Dennis P. Lettenmaier Limitations on Seasonal Snowmelt Forecast Accuracy , 1984 .

[34]  A. H. Murphy,et al.  Diagnostic verification of probability forecasts , 1992 .

[35]  Francisco J. Doblas-Reyes,et al.  A Debiased Ranked Probability Skill Score to Evaluate Probabilistic Ensemble Forecasts with Small Ensemble Sizes , 2005 .

[36]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[37]  K. Georgakakos,et al.  Assessment of Folsom lake response to historical and potential future climate scenarios: 1. Forecasting , 2001 .

[38]  Thomas E. Croley,et al.  Using Meteorology Probability Forecasts in Operational Hydrology , 2000 .

[39]  S. Sorooshian,et al.  Evaluation of Official Western U.S. Seasonal Water Supply Outlooks, 1922–2002 , 2004 .

[40]  Soroosh Sorooshian,et al.  A 'User-Friendly' approach to parameter estimation in hydrologic models , 2006 .

[41]  Emmanuel Roulin,et al.  Skill of Medium-Range Hydrological Ensemble Predictions , 2005 .

[42]  R. Buizza,et al.  The Hydrologic Ensemble Prediction EXperiment (HEPEX) , 2006 .

[43]  Arun Kumar,et al.  Seasonal Predictions, Probabilistic Verifications, and Ensemble Size , 2001 .

[44]  M. Clark,et al.  Climate Index Weighting Schemes for NWS ESP-Based Seasonal Volume Forecasts , 2004 .

[45]  Soroosh Sorooshian,et al.  HYDROLOGIC VERIFICATION A Call for Action and Collaboration , 2007 .