Preconditioning of variational data assimilation and the use of a bi‐conjugate gradient method

Presently, a preferred minimization for strong-constraint four-dimensional variational (4D-Var) assimilation uses a Lanczos-based conjugate gradient (CG) algorithm. This requires the availability of a square-root of the background-error covariance matrix (B). In the context of weak-constraint 4D-Var, this requirement might be too restrictive for the formulations of the model error term. It might therefore be desirable to avoid a square-root decomposition of the augmented background term. An appealing minimization scheme is the double CG minimization employed, for example, in the grid-point statistical interpolation (GSI) analysis. Realizing the double CG algorithm is a special case of the more general bi-conjugate gradient (BiCG) method for solving non-symmetric problems, the present work introduces a Lanczos-based preconditioning strategy when B, instead of its square-root, is used initially. Implementation of the scheme is done in the context of the GSI analysis system, and preliminary experiments are presented using its 3D-Var version. Comparison of the Lanczos-based CG and the BiCG shows that the algorithms converge at the same rate and to the same solution. Despite the additional computational cost, the importance of the re-orthogonalization step is also shown to be fundamental to any of these CG algorithms. Furthermore, when using the Hessian eigenvectors for preconditioning, the BiCG behaviour is shown to be comparable to that of the Lanczos-CG algorithm. Both schemes construct the same approximation of the Hessian with the same number of eigenvectors, and benefit in the same way from the reduction of the condition number. The efficiency, computational cost, and stability of the three algorithms are discussed. Copyright © 2012 Royal Meteorological Society

[1]  Y. Sasaki SOME BASIC FORMALISMS IN NUMERICAL VARIATIONAL ANALYSIS , 1970 .

[2]  Jean-Noël Thépaut,et al.  Simplified and Regular Physical Parameterizations for Incremental Four-Dimensional Variational Assimilation , 1999 .

[3]  J. Derber,et al.  Four‐dimensional variational data assimilation with a diabatic version of the NCEP global spectral model: System development and preliminary results , 2001 .

[4]  Y. Trémolet Incremental 4D-Var convergence study , 2007 .

[5]  I. Yu. Gejadze,et al.  On Analysis Error Covariances in Variational Data Assimilation , 2008, SIAM J. Sci. Comput..

[6]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[7]  Ionel M. Navon,et al.  Conjugate-Gradient Methods for Large-Scale Minimization in Meteorology , 1987 .

[8]  Monique Tanguay,et al.  Extension of 3DVAR to 4DVAR: Implementation of 4DVAR at the Meteorological Service of Canada , 2007 .

[9]  P. Sonneveld CGS, A Fast Lanczos-Type Solver for Nonsymmetric Linear systems , 1989 .

[10]  John Derber,et al.  Atmospheric transmittance of an absorbing gas. 6. OPTRAN status report and introduction to the NESDIS/NCEP community radiative transfer model. , 2004, Applied optics.

[11]  John Derber,et al.  The Use of TOVS Cloud-Cleared Radiances in the NCEP SSI Analysis System , 1998 .

[12]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. Ii: Numerical Results , 2007 .

[13]  J. Mahfouf,et al.  The ecmwf operational implementation of four‐dimensional variational assimilation. III: Experimental results and diagnostics with operational configuration , 2000 .

[14]  G. Golub,et al.  Iterative solution of linear systems , 1991, Acta Numerica.

[15]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[16]  Jean-Noël Thépaut,et al.  Impact of the Digital Filter as a Weak Constraint in the Preoperational 4DVAR Assimilation System of Météo-France , 2001 .

[17]  Zhishun A. Liu,et al.  A Look Ahead Lanczos Algorithm for Unsymmetric Matrices , 1985 .

[18]  A. Lorenc Optimal nonlinear objective analysis , 1988 .

[19]  Samuel Buis,et al.  Intercomparison of the primal and dual formulations of variational data assimilation , 2008 .

[20]  A. Lorenc,et al.  The Met Office global four‐dimensional variational data assimilation scheme , 2007 .

[21]  Claude Lemaréchal,et al.  Some numerical experiments with variable-storage quasi-Newton algorithms , 1989, Math. Program..

[22]  M. Saunders,et al.  Solution of Sparse Indefinite Systems of Linear Equations , 1975 .

[23]  A. Simmons,et al.  The ECMWF operational implementation of four‐dimensional variational assimilation. I: Experimental results with simplified physics , 2007 .

[24]  S. Schubert,et al.  MERRA: NASA’s Modern-Era Retrospective Analysis for Research and Applications , 2011 .

[25]  Rosemary Munro,et al.  Diagnosis of background errors for radiances and other observable quantities in a variational data assimilation scheme, and the explanation of a case of poor convergence , 2000 .

[26]  William Carlisle Thacker,et al.  The role of the Hessian matrix in fitting models to measurements , 1989 .

[27]  Y. Honda,et al.  A pre‐operational variational data assimilation system for a non‐hydrostatic model at the Japan Meteorological Agency: formulation and preliminary results , 2005 .

[28]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[29]  Y. Trémolet Accounting for an imperfect model in 4D‐Var , 2006 .

[30]  John Derber,et al.  A Global Oceanic Data Assimilation System , 1989 .

[31]  P. Gauthier,et al.  Convergence properties of the primal and dual forms of variational data assimilation , 2010 .

[32]  Jean-Noël Thépaut,et al.  A 4D‐Var re‐analysis of FASTEX , 2003 .

[33]  Andrew C. Lorenc,et al.  Development of an Operational Variational Assimilation Scheme (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice) , 1997 .

[34]  R. Purser,et al.  Three-Dimensional Variational Analysis with Spatially Inhomogeneous Covariances , 2002 .

[35]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[36]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[37]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[38]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..