Saddle point preconditioners for weak-constraint 4D-Var

Data assimilation algorithms combine information from observations and prior model information to obtain the most likely state of a dynamical system. The linearised weak-constraint four-dimensional variational assimilation problem can be reformulated as a saddle point problem, in order to exploit highly parallel modern computer architectures. In this setting, the choice of preconditioner is crucial to ensure fast convergence and retain the inherent parallelism of the saddle point formulation. We propose new preconditioning approaches for the model term and observation error covariance term which lead to fast convergence of preconditioned Krylov subspace methods, and many of these suggested approximations are highly parallelisable. In particular our novel approach includes model information in the model term within the preconditioner, which to our knowledge has not previously been considered for data assimilation problems. We develop new theory demonstrating the effectiveness of the new preconditioners. Linear and non-linear numerical experiments reveal that our new approach leads to faster convergence than existing state-of-the-art preconditioners for a broader range of problems than indicated by the theory alone. We present a range of numerical experiments performed in serial, with further improvements expected if the highly parallelisable nature of the preconditioners is exploited. Saddle point systems; variational data assimilation; preconditioning 65F08; 65F10; 65N21;

[1]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[2]  Y. Trémolet Model‐error estimation in 4D‐Var , 2007 .

[3]  D. Bernstein Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[4]  Yannick Trémolet,et al.  Preconditioning of variational data assimilation and the use of a bi‐conjugate gradient method , 2013 .

[5]  YU. A. KUZNETSOV,et al.  Efficient iterative solvers for elliptic finite element problems on nonmatching grids , 1995 .

[6]  Luca Bergamaschi,et al.  Erratum to: Inexact constraint preconditioners for linear systems arising in interior point methods , 2011, Comput. Optim. Appl..

[7]  A. Lorenc,et al.  The Met Office global four‐dimensional variational data assimilation scheme , 2007 .

[8]  Sarah L. Dance,et al.  New bounds on the condition number of the Hessian of the preconditioned variational data assimilation problem , 2020, Numer. Linear Algebra Appl..

[9]  G. Evensen,et al.  Data assimilation in the geosciences: An overview of methods, issues, and perspectives , 2017, WIREs Climate Change.

[10]  Serge Gratton,et al.  Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems , 2007, SIAM J. Optim..

[11]  M. Saunders,et al.  Solution of Sparse Indefinite Systems of Linear Equations , 1975 .

[12]  Andrew J. Wathen,et al.  Preconditioning Iterative Methods for the Optimal Control of the Stokes Equations , 2011, SIAM J. Sci. Comput..

[13]  Serge Gratton,et al.  Guaranteeing the convergence of the saddle formulation for weakly constrained 4D‐Var data assimilation , 2017, Quarterly Journal of the Royal Meteorological Society.

[14]  Serge Gratton,et al.  Low rank updates in preconditioning the saddle point systems arising from data assimilation problems , 2018, Optim. Methods Softw..

[15]  Y. Trémolet Accounting for an imperfect model in 4D‐Var , 2006 .

[16]  Luca Bergamaschi,et al.  Erratum to: Inexact constraint preconditioners for linear systems arising in interior point methods , 2011, Comput. Optim. Appl..

[18]  Jennifer A. Scott,et al.  Spectral estimates for saddle point matrices arising in weak constraint four‐dimensional variational data assimilation , 2019, Numer. Linear Algebra Appl..

[19]  N. Nichols,et al.  Investigating the role of prior and observation error correlations in improving a model forecast of forest carbon balance using Four-dimensional Variational data assimilation , 2016 .

[20]  N. Nichols,et al.  Technical note: Assessment of observation quality for data assimilation in flood models , 2018, Hydrology and Earth System Sciences.

[21]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[22]  Fuzhen Zhang Matrix Theory: Basic Results and Techniques , 1999 .

[23]  Gene H. Golub,et al.  Numerical solution of saddle point problems , 2005, Acta Numerica.

[24]  Sarah L. Dance,et al.  Improving the condition number of estimated covariance matrices , 2018, Tellus A: Dynamic Meteorology and Oceanography.

[25]  Gene H. Golub,et al.  A Note on Preconditioning for Indefinite Linear Systems , 1999, SIAM J. Sci. Comput..

[26]  Serge Gratton,et al.  Range-Space Variants and Inexact Matrix-Vector Products in Krylov Solvers for Linear Systems Arising from Inverse Problems , 2011, SIAM J. Matrix Anal. Appl..

[27]  Serge Gratton,et al.  B‐preconditioned minimization algorithms for variational data assimilation with the dual formulation , 2014 .

[28]  Melina A. Freitag,et al.  A low-rank approach to the solution of weak constraint variational data assimilation problems , 2017, J. Comput. Phys..

[29]  Nancy Nichols,et al.  Correlated observation errors in data assimilation , 2008 .

[30]  Selime Gürol,et al.  Parallelization in the time dimension of four‐dimensional variational data assimilation , 2017 .

[31]  S. Dance,et al.  Understanding the effect of disturbance from selective felling on the carbon dynamics of a managed woodland by combining observations with model predictions , 2017 .

[32]  Barry Lee,et al.  Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics , 2006, Math. Comput..

[33]  A. El-Said Conditioning of the weak-constraint variational data assimilation problem for numerical weather prediction , 2015 .

[34]  Sarah L. Dance,et al.  The conditioning of least squares problems in preconditioned variational data assimilation , 2020, ArXiv.

[35]  J. Eyre,et al.  Accounting for correlated error in the assimilation of high‐resolution sounder data , 2014 .

[36]  Sarah L. Dance,et al.  The conditioning of least‐squares problems in variational data assimilation , 2018, Numer. Linear Algebra Appl..

[37]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[38]  Sarah L. Dance,et al.  Observation impact, domain length and parameter estimation in data assimilation for flood forecasting , 2018, Environ. Model. Softw..