Application of Spatial Verification Methods to Idealized and NWP-Gridded Precipitation Forecasts

Abstract Several spatial forecast verification methods have been developed that are suited for high-resolution precipitation forecasts. They can account for the spatial coherence of precipitation and give credit to a forecast that does not necessarily match the observation at any particular grid point. The methods were grouped into four broad categories (neighborhood, scale separation, features based, and field deformation) for the Spatial Forecast Verification Methods Intercomparison Project (ICP). Participants were asked to apply their new methods to a set of artificial geometric and perturbed forecasts with prescribed errors, and a set of real forecasts of convective precipitation on a 4-km grid. This paper describes the intercomparison test cases, summarizes results from the geometric cases, and presents subjective scores and traditional scores from the real cases. All the new methods could detect bias error, and the features-based and field deformation methods were also able to diagnose displacement ...

[1]  S. J. Weiss,et al.  Some Practical Considerations Regarding Horizontal Resolution in the First Generation of Operational Convection-Allowing NWP , 2008 .

[2]  F. Mesinger,et al.  Applying a General Analytic Method for Assessing Bias Sensitivity to Bias-Adjusted Threat and Equitable Threat Scores , 2009 .

[3]  Jason E. Nachamkin.  Application of the Composite Method to the Spatial Forecast Verification Methods Intercomparison Dataset , 2009 .

[4]  Nigel Roberts,et al.  Intercomparison of Spatial Forecast Verification Methods: Identifying Skillful Spatial Scales Using the Fractions Skill Score , 2010 .

[5]  Kevin W. Manning,et al.  Experiences with 0–36-h Explicit Convective Forecasts with the WRF-ARW Model , 2008 .

[6]  Elizabeth E. Ebert,et al.  Neighborhood Verification: A Strategy for Rewarding Close Forecasts , 2009 .

[7]  C. Frei,et al.  SAL—A Novel Quality Measure for the Verification of Quantitative Precipitation Forecasts , 2008 .

[8]  C. Keil,et al.  A Displacement and Amplitude Score Employing an Optical Flow Technique , 2009 .

[9]  Efi Foufoula-Georgiou,et al.  A new metric for comparing precipitation patterns with an application to ensemble forecasts , 2005 .

[10]  Eric Gilleland,et al.  Intercomparison of Spatial Forecast Verification Methods , 2009 .

[11]  Heini Wernli,et al.  Spatial Forecast Verification Methods Intercomparison Project: Application of the SAL Technique , 2009 .

[12]  Caren Marzban,et al.  Three Spatial Verification Techniques: Cluster Analysis, Variogram, and Optical Flow , 2009 .

[13]  B. Casati,et al.  New Developments of the Intensity-Scale Technique within the Spatial Verification Methods Intercomparison Project , 2010 .

[14]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[15]  Caren Marzban,et al.  Verification with Variograms , 2009 .

[16]  Neil I. Fox,et al.  An Object-Oriented Multiscale Verification Scheme , 2010 .

[17]  Elizabeth E. Ebert,et al.  Toward Better Understanding of the Contiguous Rain Area (CRA) Method for Spatial Forecast Verification , 2009 .

[18]  F. Atger.  Verification of intense precipitation forecasts from single models and ensemble prediction systems , 2001 .

[19]  B. Brown,et al.  The Method for Object-Based Diagnostic Evaluation (MODE) Applied to Numerical Forecasts from the 2005 NSSL/SPC Spring Program , 2009 .