An observation‐space formulation of variational assimilation using a restricted preconditioned conjugate gradient algorithm

We consider parameter estimation problems involving a set of m physical observations, where an unknown vector of n parameters is defined as the solution of a nonlinear least-squares problem. We assume that the problem is regularized by a quadratic penalty term. When solution techniques based on successive linearization are considered, as in the incremental four-dimensional variational (4D-Var) techniques for data assimilation, a sequence of linear systems with particular structure has to be solved. We exhibit a subspace of dimension m that contains the solution of these linear systems, and derive a variant of the conjugate gradient algorithm that is more efficient in terms of memory and computational costs than its standard form, when m is smaller than n. The new algorithm, which we call the Restricted Preconditioned Conjugate Gradient (RPCG), can be viewed as an alternative to the so-called Physical-space Statistical Analysis System (PSAS) algorithm, which is another approach to solve the linear problem. In addition, we show that the non-monotone and somehow chaotic behaviour of PSAS algorithm when viewed in the model space, experimentally reported by some authors, can be fully suppressed in RPCG. Moreover, since preconditioning and re-orthogonalization of residuals vectors are often used in practice to accelerate convergence in high-dimension data assimilation, we show how to reformulate these techniques within subspaces of dimension m in RPCG. Numerical experiments are reported, on an idealized data assimilation system based on the heat equation, that clearly show the effectiveness of our algorithm for large-scale problems. Copyright © 2009 Royal Meteorological Society

[1]  H. V. D. Vorst,et al.  The rate of convergence of Conjugate Gradients , 1986 .

[2]  Serge Gratton,et al.  Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems , 2007, SIAM J. Optim..

[3]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[4]  James Demmel,et al.  Applied Numerical Linear Algebra , 1997 .

[5]  Y. Trémolet Model‐error estimation in 4D‐Var , 2007 .

[6]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[7]  Y. Trémolet Accounting for an imperfect model in 4D‐Var , 2006 .

[8]  Samuel Buis,et al.  Intercomparison of the primal and dual formulations of variational data assimilation , 2008 .

[9]  Claude Lemaréchal,et al.  Some numerical experiments with variable-storage quasi-Newton algorithms , 1989, Math. Program..

[10]  Gene H. Golub,et al.  Matrix computations , 1983 .

[11]  Nancy Nichols,et al.  An investigation of incremental 4D‐Var using non‐tangent linear models , 2005 .

[12]  Carl Tim Kelley,et al.  Iterative methods for optimization , 1999, Frontiers in applied mathematics.

[13]  Serge Gratton,et al.  Limited‐memory preconditioners, with application to incremental four‐dimensional variational data assimilation , 2008 .

[14]  Florence Rabier,et al.  Overview of global data assimilation developments in numerical weather‐prediction centres , 2005 .

[15]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[16]  Philippe Courtier,et al.  Dual formulation of four‐dimensional variational assimilation , 1997 .

[17]  D. Auroux Generalization of the dual variational data assimilation algorithm to a nonlinear layered quasi-geostrophic ocean model , 2007 .

[18]  Nancy Nichols,et al.  Inner-Loop Stopping Criteria for Incremental Four-Dimensional Variational Data Assimilation , 2006 .

[19]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[20]  Jorge Nocedal,et al.  Automatic Preconditioning by Limited Memory Quasi-Newton Updating , 1999, SIAM J. Optim..

[21]  Mei Han An,et al.  accuracy and stability of numerical algorithms , 1991 .

[22]  Jérôme Vialard,et al.  Three- and Four-Dimensional Variational Assimilation with a General Circulation Model of the Tropical Pacific Ocean. Part I: Formulation, Internal Diagnostics, and Consistency Checks , 2003 .

[23]  Nancy Nichols,et al.  Approximate iterative methods for variational data assimilation , 2005 .

[24]  O. Axelsson Iterative solution methods , 1995 .