Fuzzy verification of high‐resolution gridded forecasts: a review and proposed framework

High-resolution forecasts from numerical models can look quite realistic and provide the forecaster with very useful guidance. However, when verified using traditional metrics they often score quite poorly because of the difficulty of predicting an exact match to the observations at high resolution. ‘Fuzzy’ verification rewards closeness by relaxing the requirement for exact matches between forecasts and observations. The key to the fuzzy approach is the use of a spatial window or neighbourhood surrounding the forecast and/or observed points. The treatment of the data within the window may include averaging (upscaling), thresholding, or generation of a PDF, depending on the particular fuzzy method used and its implicit decision model concerning what makes a good forecast. The size of the neighbourhood can be varied to provide verification results at multiple scales, thus allowing the user to determine at which scales the forecast has useful skill. This article describes a framework for fuzzy verification that incorporates several fuzzy verification methods. It is demonstrated on a high-resolution precipitation forecast from the United Kingdom (UK) and the results interpreted to show the additional information that can be gleaned from this approach. Copyright © 2008 Royal Meteorological Society

[1]  U. Damrath,et al.  Probabilistic precipitation forecasts from a deterministic model: a pragmatic approach , 2005 .

[2]  Efi Foufoula-Georgiou,et al.  Scale issues in verification of precipitation forecasts , 2001 .

[3]  Christopher A. Davis,et al.  Summary of the 1998 Workshop on Mesoscale Model Verification , 2000 .

[4]  D. Stephenson,et al.  A new intensity‐scale approach for the verification of spatial precipitation forecasts , 2004 .

[5]  J. McBride,et al.  Verification of precipitation in weather systems: determination of systematic errors , 2000 .

[6]  Zbynek Sokol,et al.  A radar-based verification of precipitation forecast for local convective storms , 2007 .

[7]  V. Ducrocq,et al.  Point and areal validation of forecast precipitation fields , 2006 .

[8]  Caren Marzban,et al.  Cluster Analysis for Verification of Precipitation Fields , 2006 .

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  B. Brown,et al.  Object-Based Verification of Precipitation Forecasts. Part I: Methodology and Application to Mesoscale Rain Areas , 2006 .

[11]  Kenneth J. Westrick,et al.  Does Increasing Horizontal Resolution Produce More Skillful Forecasts , 2002 .

[12]  N. Roberts,et al.  Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events , 2008 .

[13]  S. J. Weiss,et al.  Examination of convection-allowing configurations of the WRF model for the prediction of severe convective weather : The SPC/NSSL spring program 2004 , 2006 .

[14]  Efi Foufoula-Georgiou,et al.  Space‐time rainfall organization and its role in validating quantitative precipitation forecasts , 2000 .

[15]  I. Zawadzki,et al.  Scale Dependence of the Predictability of Precipitation from Continental Radar Images. Part II: Probability Forecasts , 2004 .

[16]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[17]  G. Engelen,et al.  Map Comparison Kit 3: User Manual , 2006 .

[18]  A. Montani,et al.  A spatial verification method applied to the evaluation of high‐resolution ensemble forecasts , 2008 .

[19]  D. Richardson.  Skill and relative economic value of the ECMWF ensemble prediction system , 2000 .

[20]  B. Golding.  Quantitative precipitation forecasting in the UK , 2000 .

[21]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[22]  Inge Uljee,et al.  Further developments of a fuzzy set map comparison approach , 2005, Int. J. Geogr. Inf. Sci..

[23]  J. Kain,et al.  Sensitivity of Several Performance Measures to Displacement Error, Bias, and Event Frequency , 2006 .

[24]  F. Atger.  Verification of intense precipitation forecasts from single models and ensemble prediction systems , 2001 .