NWP model forecast skill optimization via closure parameter variations

We apply a recently developed method, the Ensemble Prediction and Parameter Estimation System (EPPES), to demonstrate how numerical weather prediction (NWP) model closure parameters can be optimized. As proof of concept, we tune the medium-range forecast skill of the ECMWF model HAMburg version (ECHAM5) atmospheric general circulation model using an ensemble prediction system (EPS) emulator. Initial state uncertainty is represented in the EPS emulator by applying the initial state perturbations generated at the European Centre for Medium-range Weather Forecasts (ECMWF). Model uncertainty is represented in the emulator via parameter variations at the initial time. We vary four closure parameters related to parametrizations of subgrid-scale physical processes of clouds and precipitation. With this set-up, we generate ensembles of 10-day global forecasts with the ECHAM5 model at T42L31 resolution twice a day over a period of three months. The cost function in the optimization is formulated in terms of standard forecast skill scores, verified against the ECMWF operational analyses. A summarizing conclusion of the experiments is that the EPPES method is able to find ECHAM5 model closure parameter values that correspond to smaller values of the cost function. The forecast skill score improvements verify positively in dependent and independent samples. The main reason is the reduced temperature bias in the tropical lower troposphere. Moreover, the optimization improved the top-of-atmosphere radiation flux climatology of the ECHAM5 model, as verified against the Clouds and the Earth's Radiant Energy System (CERES) radiation data over a 6-year period, while the simulated tropical cloud cover was reduced, thereby increasing a negative bias as verified against the International Satellite Cloud Climatology Project (ISCCP) data.

[1]  Neill E. Bowler,et al.  The MOGREPS short‐range ensemble prediction system , 2008 .

[2]  Johnny Wei-Bing Lin,et al.  Influence of a stochastic moist convective parameterization on tropical climate variability , 2000 .

[3]  Robert Pincus,et al.  On Constraining Estimates of Climate Sensitivity with Present-Day Observations through Model Weighting , 2011 .

[4]  D. Wilks Effects of stochastic parametrizations in the Lorenz '96 system , 2005 .

[5]  Luis Kornblueh,et al.  Sensitivity of Simulated Climate to Horizontal and Vertical Resolution in the ECHAM5 Atmosphere Model , 2006 .

[6]  James C McWilliams,et al.  Considerations for parameter optimization and sensitivity in climate models , 2010, Proceedings of the National Academy of Sciences.

[7]  Kevin E. Trenberth,et al.  Evaluation of the atmospheric moisture and hydrological cycle in the NCEP/NCAR reanalyses , 1998 .

[8]  Hannu Savijärvi,et al.  Error Growth in a Large Numerical Forecast System , 1995 .

[9]  W. Rossow,et al.  The International Satellite Cloud Climatology Project (ISCCP) Web Site An Online Resource for Research , 2004 .

[10]  Fuqing Zhang,et al.  Ensemble‐based simultaneous state and parameter estimation with MM5 , 2006 .

[11]  Heikki Haario,et al.  Ensemble prediction and parameter estimation system: the method , 2012 .

[12]  Thomas Jung,et al.  Systematic Model Error: The Impact of Increased Horizontal Resolution versus Improved Stochastic and Deterministic Parameterizations , 2012 .

[13]  D. Stensrud Parameterization Schemes: Keys to Understanding Numerical Weather Prediction Models , 2007 .

[14]  I. M. Navon,et al.  Impact of Parameter Estimation on the Performance of the FSU Global Spectral Model Using Its Full-Physics Adjoint , 1999 .

[15]  Erkki Oja,et al.  Estimation of ECHAM5 climate model closure parameters with adaptive MCMC , 2010 .

[16]  Tim N. Palmer,et al.  Ensemble forecasting , 2008, J. Comput. Phys..

[17]  C. Snyder,et al.  Linear and non-linear response to parameter variations in a mesoscale model , 2009 .

[18]  E. Lorenz Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[19]  Fuqing Zhang,et al.  Evaluation of Planetary Boundary Layer Scheme Sensitivities for the Purpose of Parameter Estimation , 2010 .

[20]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[21]  David R. Doelling,et al.  Toward Optimal Closure of the Earth's Top-of-Atmosphere Radiation Budget , 2009 .

[22]  Carolyn A. Reynolds,et al.  Examination of parameter variations in the U. S. Navy Global Ensemble , 2011 .

[23]  A. Betts,et al.  Evaluation of the ERA-40 Surface Water Budget and Surface Temperature for the Mackenzie River Basin , 2003 .

[24]  Heikki Haario,et al.  Ensemble prediction and parameter estimation system: the concept , 2012 .

[25]  Fuqing Zhang,et al.  Ensemble-based simultaneous state and parameter estimation in a two-dimensional sea-breeze model , 2006 .