Nonlinear effects in 4D-Var

Abstract. The ability of a data assimilation system to deal effectively with nonlinearities arising from the prognostic model or the relationship between the control variables and the available observations has received a lot of attention in theoretical studies based on very simplified test models. Less work has been done to quantify the importance of nonlinearities in operational, state-of-the-art global data assimilation systems. In this paper we analyse the nonlinear effects present in ECMWF 4D-Var and evaluate the ability of the incremental formulation to solve the nonlinear assimilation problem in a realistic NWP environment. We find that nonlinearities have increased over the years due to a combination of increased model resolution and the ever-growing importance of observations that are nonlinearly related to the state. Incremental 4D-Var is well suited for dealing with these nonlinear effects, but at the cost of increasing the number of outer loop relinearisations. We then discuss strategies for accommodating the increasing number of sequential outer loops in the tight schedules of operational global NWP.

[1]  Olivier Talagrand,et al.  On extending the limits of variational assimilation in nonlinear chaotic systems , 1996 .

[2]  A. Lorenc,et al.  The Met Office global four‐dimensional variational data assimilation scheme , 2007 .

[3]  R. Maddox.  Meoscale Convective Complexes , 1980 .

[4]  Yannick Trémolet,et al.  Diagnostics of linear and incremental approximations in 4D‐Var , 2004 .

[5]  Philippe Courtier,et al.  Four‐Dimensional Assimilation In the Presence of Baroclinic Instability , 1992 .

[6]  P. Gauthier,et al.  A validation of the incremental formulation of 4D variational data assimilation in a nonlinear barotropic flow , 1998 .

[7]  Mats Hamrud,et al.  A new grid for the IFS , 2016 .

[8]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[9]  Anna Trevisan,et al.  Assimilation of Standard and Targeted Observations within the Unstable Subspace of the Observation–Analysis–Forecast Cycle System , 2004 .

[10]  Collected Reprint Series.  7. Mesoscale Convective Complexes in the Americas , 2013 .

[11]  Pierre Gauthier,et al.  Chaos and quadri-dimensional data assimilation: a study based on the Lorenz model , 1992 .

[12]  I. Hoteit,et al.  A reduced‐order simulated annealing approach for four‐dimensional variational data assimilation in meteorology and oceanography , 2008 .

[13]  Nancy Nichols,et al.  Approximate iterative methods for variational data assimilation , 2005 .

[14]  P. Courtier,et al.  Quasi‐continuous variational data assimilation , 1996 .

[15]  Michael Ghil,et al.  Data assimilation as a nonlinear dynamical systems problem: stability and convergence of the prediction-assimilation system. , 2007, Chaos.

[16]  M. Fisher.  Estimation of Entropy Reduction and Degrees of Freedom for Signal for Large Variational Analysis Systems , 2003 .

[17]  J. Thepaut,et al.  383 Assimilation and Modelling of the Hydrological Cycle : ECMWF ’ s Status and Plans , 2002 .

[18]  Andrew C. Lorenc,et al.  4D‐Var and the butterfly effect: Statistical four‐dimensional data assimilation for a wide range of scales , 2007 .

[19]  A. Simmons,et al.  The ECMWF operational implementation of four‐dimensional variational assimilation. I: Experimental results with simplified physics , 2007 .

[20]  G. Radnoti.  467 Diagnostics of linear and incremental approximations in 4 D-Var revisited for higher resolution analysis , 2005 .

[21]  C. Liou,et al.  On the initialization of tropical cyclones with a three dimensional variational analysis , 2012, Natural Hazards.

[22]  Serge Gratton,et al.  Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems , 2007, SIAM J. Optim..

[23]  Olivier Talagrand,et al.  Four‐dimensional variational assimilation in the unstable subspace and the optimal subspace dimension , 2010 .

[24]  Liang Xu,et al.  Development of NAVDAS-AR: non-linear formulation and outer loop tests , 2006 .

[25]  P. Bauer,et al.  Direct 4D‐Var assimilation of all‐sky radiances. Part II: Assessment , 2010 .

[26]  N. Bormann,et al.  The growing impact of satellite observations sensitive to humidity, cloud and precipitation , 2017 .

[27]  Christina Tavolato,et al.  On the use of a Huber norm for observation quality control in the ECMWF 4D‐Var , 2015 .

[28]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[29]  Y. Trémolet.  Incremental 4D-Var convergence study , 2007 .

[30]  Monique Tanguay,et al.  Four‐dimensional data assimilation with a wide range of scales , 1995 .

[31]  Yannick Trémolet.  Incremental 4D-Var convergence study , 2007 .

[32]  Monique Tanguay,et al.  Extension of 3DVAR to 4DVAR: Implementation of 4DVAR at the Meteorological Service of Canada , 2007 .

[33]  Michael Ghil,et al.  Advanced data assimilation in strongly nonlinear dynamical systems , 1994 .

[34]  Philippe Lopez,et al.  Linearized Physics for Data Assimilation at ECMWF , 2013 .

[35]  F. Veerse,et al.  Multiple‐truncation incremental approach for four‐dimensional variational data assimilation , 1998 .

[36]  M. Rodwell,et al.  Characteristics of occasional poor medium-range weather forecasts for Europe , 2013 .

[37]  Peter Bauer,et al.  Observation errors in all‐sky data assimilation , 2011 .