Assessing the Benefits of Convection-Permitting Models by Neighborhood Verification: Examples from MAP D-PHASE

Abstract High-resolution numerical weather prediction (NWP) models produce more detailed precipitation structures but the real benefit is probably the more realistic statistics gained with the higher resolution and not the information on the specific grid point. By evaluating three model pairs, each consisting of a high-resolution NWP system resolving convection explicitly and its low-resolution-driving model with parameterized convection, on different spatial scales and for different thresholds, this paper addresses the question of whether high-resolution models really perform better than their driving lower-resolution counterparts. The model pairs are evaluated by means of two fuzzy verification methods—upscaling (UP) and fractions skill score (FSS)—for the 6 months of the D-PHASE Operations Period and in a highly complex terrain. Observations are provided by the Swiss radar composite and the evaluation is restricted to the area covered by the Swiss radar stations. The high-resolution models outperform ...

[1]  Volker Wulfmeyer,et al.  MAP D-PHASE: Demonstrating forecast capabilities for flood events in the Alpine region. , 2009 .

[2]  W. Gallus,et al.  Comparison of the Diurnal Precipitation Cycle in Convection-Resolving and Non-Convection-Resolving Mesoscale Models , 2007 .

[3]  Efi Foufoula-Georgiou,et al.  Space‐time rainfall organization and its role in validating quantitative precipitation forecasts , 2000 .

[4]  D. Boos.  Introduction to the Bootstrap World , 2003 .

[5]  C. Frei,et al.  SAL—A Novel Quality Measure for the Verification of Quantitative Precipitation Forecasts , 2008 .

[6]  U. Germann,et al.  Radar precipitation measurement in a mountainous region , 2006 .

[7]  S. J. Weiss,et al.  Next-Day Convection-Allowing WRF Model Guidance: A Second Look at 2-km versus 4-km Grid Spacing , 2009 .

[8]  U. Damrath,et al.  Probabilistic precipitation forecasts from a deterministic model: a pragmatic approach , 2005 .

[9]  R. Houze,et al.  The MAP special observing period , 2001 .

[10]  C. Keil,et al.  A Displacement and Amplitude Score Employing an Optical Flow Technique , 2009 .

[11]  S. J. Weiss,et al.  Some Practical Considerations Regarding Horizontal Resolution in the First Generation of Operational Convection-Allowing NWP , 2008 .

[12]  F. Ament,et al.  Evaluation of MAP D-PHASE heavy precipitation alerts in Switzerland during summer 2007 , 2011 .

[13]  C. Schär,et al.  Atmospheric Predictability at Synoptic Versus Cloud-Resolving Scales , 2007 .

[14]  U. Germann,et al.  MAP D-PHASE: Real-Time Demonstration of Weather Forecast Quality in the Alpine region , 2009 .

[15]  Kevin W. Manning,et al.  Experiences with 0–36-h Explicit Convective Forecasts with the WRF-ARW Model , 2008 .

[16]  Elizabeth E. Ebert,et al.  Neighborhood Verification: A Strategy for Rewarding Close Forecasts , 2009 .

[17]  C. Kottmeier,et al.  The convective and orographically-induced precipitation study: A research and development project of the world weather research program , 2008 .

[18]  N. Roberts,et al.  Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events , 2008 .

[19]  Volker Wulfmeyer,et al.  RESEARCH CAMPAIGN: The Convective and Orographically Induced Precipitation Study , 2008 .

[20]  Nigel Roberts,et al.  Intercomparison of Spatial Forecast Verification Methods: Identifying Skillful Spatial Scales Using the Fractions Skill Score , 2010 .

[21]  Elizabeth E. Ebert,et al.  Fuzzy verification of high‐resolution gridded forecasts: a review and proposed framework , 2008 .

[22]  Nigel Roberts,et al.  Characteristics of high-resolution versions of the Met Office unified model for forecasting convection over the United Kingdom , 2008 .

[23]  Diane Chaumont,et al.  Evaluation of Precipitation from Numerical Weather Prediction Models and Satellites Using Values Retrieved from Radars , 2007 .

[24]  S. Vogt,et al.  MAP D‐PHASE: real‐time demonstration of hydrological ensemble prediction systems , 2008 .

[25]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .