The effect of improved ensemble covariances on hybrid variational data assimilation

Hybrid four-dimensional ensemble-variational (4DEnVar) data assimilation is a method which avoids using a linear and adjoint model by relying on an input ensemble to propagate analysis increments in time. Previous studies have shown that hybrid 4DEnVar performs worse than hybrid four-dimensional variational (4D-Var) assimilation. Given hybrid 4DEnVar's heavy reliance on the ensemble, this comparison may be affected by the quality of the input ensemble. Here we investigate how improvements to the ensemble system affect hybrid 4D-Var and how they affect the comparison with hybrid 4DEnVar. Using the Met Office's operational ensemble generation scheme (the ensemble transform Kalman filter, ETKF) it is found that hybrid 4D-Var gains little benefit from using an enlarged ensemble as input (176 as opposed to 23 members). By contrast, hybrid 4DEnVar benefits more from the increased ensemble size, and it benefits further when the weighting given to the ensemble covariance is increased. Both data assimilation methods benefit when the input ensemble is changed from using the ETKF to using an ensemble of 4DEnVars. Both schemes also show further benefit when a large ensemble (200 members) of 4DEnVars is used, and when a large weight is given to the covariance information from this ensemble. Thus, improving the ensemble covariance used in assimilation (ensemble generation method and ensemble size) and increasing its weight can have substantial benefits. Given that both hybrid 4D-Var and hybrid 4DEnVar benefit from improvements to the input ensemble, the relative performance is largely unaffected by the ensemble changes and hybrid 4D-Var performs better than hybrid 4DEnVar for all input ensembles.

[1]  M. Buehner,et al.  Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part II: One-Month Experiments with Real Observations , 2010 .

[2]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test , 2008 .

[3]  Kayo Ide,et al.  An OSSE-Based Evaluation of Hybrid Variational–Ensemble Data Assimilation for the NCEP GFS. Part I: System Description and 3D-Hybrid Results , 2015 .

[4]  M. J. P. Cullen,et al.  Modelling static 3-D spatial background error covariances – the effect of vertical and horizontal transform order , 2014 .

[5]  P. Earnshaw,et al.  The Met Office Unified Model Global Atmosphere 7.0/7.1 and JULES Global Land 7.0 configurations , 2011, Geoscientific Model Development.

[6]  A. Lorenc,et al.  The Met Office global four‐dimensional variational data assimilation scheme , 2007 .

[7]  Seung-Jong Baek,et al.  Higher Resolution in an Operational Ensemble Kalman Filter , 2014 .

[8]  Neill E. Bowler,et al.  Comparison of Hybrid-4DEnVar and Hybrid-4DVar Data Assimilation Methods for Global NWP , 2015 .

[9]  Kayo Ide,et al.  An OSSE-Based Evaluation of Hybrid Variational-Ensemble Data Assimilation for the NCEP GFS. Part II: 4DEnVar and Hybrid Variants , 2015 .

[10]  N. B. Ingleby,et al.  The Met. Office global three‐dimensional variational data assimilation scheme , 2000 .

[11]  Mark Buehner,et al.  Implementation of Deterministic Weather Forecasting Systems Based on Ensemble–Variational Data Assimilation at Environment Canada. Part I: The Global System , 2015 .

[12]  Ian Roulstone,et al.  A comparison of 4DVar with ensemble data assimilation methods , 2014 .

[13]  Marc Bocquet,et al.  Localization and the iterative ensemble Kalman smoother , 2016 .

[14]  Mark Buehner,et al.  An Ensemble Kalman Filter for Numerical Weather Prediction Based on Variational Data Assimilation: VarEnKF , 2017 .

[15]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[16]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[17]  M. Diamantakis,et al.  An inherently mass‐conserving semi‐implicit semi‐Lagrangian discretization of the deep‐atmosphere global non‐hydrostatic equations , 2014 .

[18]  Andrew C. Lorenc,et al.  Why does 4D‐Var beat 3D‐Var? , 2005 .

[19]  Jonathan Poterjoy,et al.  Comparison of Hybrid Four-Dimensional Data Assimilation Methods with and without the Tangent Linear and Adjoint Models for Predicting the Life Cycle of Hurricane Karl (2010) , 2016 .

[20]  Craig H. Bishop,et al.  Localized Ensemble-Based Tangent Linear Models and Their Use in Propagating Hybrid Error Covariance Models , 2016 .

[21]  A. Staniforth,et al.  A new dynamical core for the Met Office's global and regional modelling of the atmosphere , 2005 .

[22]  Jean-Noël Thépaut,et al.  Impact of the Digital Filter as a Weak Constraint in the Preoperational 4DVAR Assimilation System of Météo-France , 2001 .

[23]  Mark Buehner,et al.  Evaluation of a Spatial/Spectral Covariance Localization Approach for Atmospheric Data Assimilation , 2012 .

[24]  Jonathan Poterjoy,et al.  Systematic Comparison of Four-Dimensional Data Assimilation Methods With and Without the Tangent Linear Model Using Hybrid Background Error Covariance: E4DVar versus 4DEnVar , 2015 .

[25]  Neill E. Bowler,et al.  The MOGREPS short‐range ensemble prediction system , 2008 .

[26]  Neill E. Bowler,et al.  Inflation and localization tests in the development of an ensemble of 4D‐ensemble variational assimilations , 2017 .

[27]  J. Schmetz,et al.  Operational Cloud-Motion Winds from Meteosat Infrared Images , 1993 .

[28]  A. Lorenc,et al.  Operational implementation of a hybrid ensemble/4D‐Var global data assimilation system at the Met Office , 2013 .

[29]  Florence Rabier,et al.  Overview of global data assimilation developments in numerical weather‐prediction centres , 2005 .

[30]  C. Donlon,et al.  The Operational Sea Surface Temperature and Sea Ice Analysis (OSTIA) system , 2012 .

[31]  I. Dharssi,et al.  Operational assimilation of ASCAT surface soil wetness at the Met Office , 2011 .

[32]  David D. Parrish,et al.  GSI 3DVar-Based Ensemble-Variational Hybrid Data Assimilation for NCEP Global Forecast System: Single-Resolution Experiments , 2013 .

[33]  M. Buehner,et al.  Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part I: Description and Single-Observation Experiments , 2010 .

[34]  J. Kepert Covariance localisation and balance in an Ensemble Kalman Filter , 2009 .

[35]  B. Khattatov,et al.  Data assimilation : making sense of observations , 2010 .

[36]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[37]  Gérald Desroziers,et al.  Improving spatial localization in 4DEnVar , 2016 .