Quasi-static ensemble variational data assimilation: a theoretical and numerical study with the iterative ensemble Kalman smoother

Abstract. The analysis in nonlinear variational data assimilation is the solution of a non-quadratic minimization. Thus, the analysis efficiency relies on its ability to locate a global minimum of the cost function. If this minimization uses a Gauss–Newton (GN) method, it is critical for the starting point to be in the attraction basin of a global minimum. Otherwise the method may converge to a local extremum, which degrades the analysis. With chaotic models, the number of local extrema often increases with the temporal extent of the data assimilation window, making the former condition harder to satisfy. This is unfortunate because the assimilation performance also increases with this temporal extent. However, a quasi-static (QS) minimization may overcome these local extrema. It accomplishes this by gradually injecting the observations in the cost function. This method was introduced by Pires et al. (1996) in a 4D-Var context. We generalize this approach to four-dimensional strong-constraint nonlinear ensemble variational (EnVar) methods, which are based on both a nonlinear variational analysis and the propagation of dynamical error statistics via an ensemble. This forces one to consider the cost function minimizations in the broader context of cycled data assimilation algorithms. We adapt this QS approach to the iterative ensemble Kalman smoother (IEnKS), an exemplar of nonlinear deterministic four-dimensional EnVar methods. Using low-order models, we quantify the positive impact of the QS approach on the IEnKS, especially for long data assimilation windows. We also examine the computational cost of QS implementations and suggest cheaper algorithms.

[1]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[2]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .

[3]  Marc Bocquet,et al.  Localization and the iterative ensemble Kalman smoother , 2016 .

[4]  Olivier Talagrand,et al.  Four‐dimensional variational assimilation in the unstable subspace and the optimal subspace dimension , 2010 .

[5]  J. Amezcua,et al.  Comparing hybrid data assimilation methods on the Lorenz 1963 model with increasing non-linearity , 2015 .

[6]  Marc Bocquet,et al.  Asynchronous data assimilation with the EnKF in presence of additive model error , 2018 .

[7]  Olivier Talagrand,et al.  On extending the limits of variational assimilation in nonlinear chaotic systems , 1996 .

[8]  M. Bocquet,et al.  An iterative ensemble Kalman filter in presence of additive model error November 10 , 2017 , 2018 .

[9]  A. Lorenc Four-dimensional variational data assimilation , 2014 .

[10]  A. Carrassi,et al.  Four-dimensional ensemble variational data assimilation and the unstable subspace , 2017 .

[11]  J. C. Quinn,et al.  Systematic variational method for statistical nonlinear state and parameter estimation. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  D. Newton AN INTRODUCTION TO ERGODIC THEORY (Graduate Texts in Mathematics, 79) , 1982 .

[13]  Marc Bocquet,et al.  Ensemble Kalman filtering without the intrinsic need for inflation , 2011 .

[14]  Marc Bocquet,et al.  An iterative ensemble Kalman smoother , 2014 .

[15]  Marc Bocquet,et al.  Joint state and parameter estimation with an iterative ensemble Kalman smoother , 2013 .

[16]  Kevin Judd,et al.  Gradient free descent: shadowing, and state estimation using limited derivative information , 2004 .

[17]  Marc Bocquet,et al.  Advanced Data Assimilation for Geosciences: Lecture Notes of the Les Houches School of Physics: Special Issue, June 2012 , 2014 .

[18]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[19]  Marc Bocquet,et al.  Data Assimilation: Methods, Algorithms, and Applications , 2016 .

[20]  Y. Trémolet 477 Accounting for an imperfect model in 4 D-Var Yannick Trémolet , 2007 .

[21]  Michael Ghil,et al.  Advanced data assimilation in strongly nonlinear dynamical systems , 1994 .

[22]  Michael Ghil,et al.  Estimating model evidence using data assimilation , 2016, 1605.01526.

[23]  Robert Vautard,et al.  Four-dimensional variational assimilation and predictability in a quasi-geostrophic model , 1998 .

[24]  Marc Bocquet,et al.  Expanding the validity of the ensemble Kalman filter without the intrinsic need for inflation , 2015 .

[25]  Didier Auroux,et al.  Smoothing Problems in a Bayesian Framework and Their Linear Gaussian Solutions , 2012 .

[26]  Marc Bocquet,et al.  Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems , 2012 .