Improving the ensemble transform Kalman filter using a second-order Taylor approximation of the nonlinear observation operator

Abstract. The ensemble transform Kalman filter (ETKF) assimilation scheme has recently seen rapid development and wide application. As a specific implementation of the ensemble Kalman filter (EnKF), the ETKF is computationally more efficient than the conventional EnKF. However, the current implementation of the ETKF still has some limitations when the observation operator is strongly nonlinear. One problem in the minimization of a nonlinear objective function similar to 4D-Var is that the nonlinear operator and its tangent-linear operator have to be calculated iteratively if the Hessian is not preconditioned or if the Hessian has to be calculated several times. This may be computationally expensive. Another problem is that it uses the tangent-linear approximation of the observation operator to estimate the multiplicative inflation factor of the forecast errors, which may not be sufficiently accurate. This study attempts to solve these problems. First, we apply the second-order Taylor approximation to the nonlinear observation operator in which the operator, its tangent-linear operator and Hessian are calculated only once. The related computational cost is also discussed. Second, we propose a scheme to estimate the inflation factor when the observation operator is strongly nonlinear. Experimentation with the Lorenz 96 model shows that using the second-order Taylor approximation of the nonlinear observation operator leads to a reduction in the analysis error compared with the traditional linear approximation method. Furthermore, the proposed inflation scheme leads to a reduction in the analysis error compared with the procedure using the traditional inflation scheme.

[1]  Peter R. Oke,et al.  A comparison of shelf observation platforms for assimilation in an eddy-resolving ocean model , 2009 .

[2]  Xuguang Wang,et al.  A Comparison of Breeding and Ensemble Transform Kalman Filter Ensemble Forecast Schemes , 2003 .

[3]  Craig H. Bishop,et al.  Ensemble Transformation and Adaptive Observations , 1999 .

[4]  M. Zupanski.  Maximum Likelihood Ensemble Filter: Theoretical Aspects , 2005 .

[5]  J. Hansen,et al.  Implications of Stochastic and Deterministic Filters as Ensemble-Based Data Assimilation Methods in Varying Regimes of Error Growth , 2004 .

[6]  Takemasa Miyoshi,et al.  Ensemble Kalman Filter and 4D-Var Intercomparison with the Japanese Operational Global Analysis and Prediction System , 2010 .

[7]  Neill E. Bowler,et al.  Improving the use of observations to calibrate ensemble spread , 2011 .

[8]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[9]  G. Evensen.  Inverse methods and data assimilation in nonlinear ocean models , 1994 .

[10]  Geir Evensen,et al.  Advanced Data Assimilation for Strongly Nonlinear Dynamics , 1997 .

[11]  Renate Hagedorn,et al.  Ensemble prediction: a pedagogical perspective , 2008 .

[12]  Istvan Szunyogh,et al.  Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter , 2005, physics/0511236.

[13]  Xiao Liang,et al.  Maximum likelihood estimation of inflation factors on error covariance matrices for ensemble Kalman filter assimilation , 2012 .

[14]  A. Lorenc,et al.  The Met Office global four‐dimensional variational data assimilation scheme , 2007 .

[15]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[16]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test , 2008 .

[17]  J. Whitaker,et al.  Accounting for the Error due to Unresolved Scales in Ensemble Data Assimilation: A Comparison of Different Approaches , 2005 .

[18]  Peter R. Oke,et al.  A deterministic formulation of the ensemble Kalman filter : an alternative to ensemble square root filters , 2008 .

[19]  E. Kalnay,et al.  Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter , 2009 .

[20]  Takemasa Miyoshi,et al.  Estimating and including observation-error correlations in data assimilation , 2013 .

[21]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[22]  Ionel M. Navon,et al.  Second-Order Information in Data Assimilation* , 2002 .

[23]  J. Lambert.  Numerical Methods for Ordinary Differential Equations , 1991 .

[24]  Ionel M. Navon,et al.  Impact of non‐smooth observation operators on variational and sequential data assimilation for a limited‐area shallow‐water equation model , 2012 .

[25]  Ionel M. Navon,et al.  Efficiency of a POD-based reduced second-order adjoint model in 4 D-Var data assimilation , 2006 .

[26]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[27]  Peter Jan,et al.  Particle Filtering in Geophysical Systems , 2009 .

[28]  R. Reichle.  Data assimilation methods in the Earth sciences , 2008 .

[29]  Dongxiao Zhang,et al.  Data assimilation for nonlinear problems by ensemble Kalman filter with reparameterization , 2009 .

[30]  Nancy Nichols,et al.  Data assimilation with correlated observation errors: experiments with a 1-D shallow water model , 2013 .

[31]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[32]  Philippe Courtier,et al.  Unified Notation for Data Assimilation : Operational, Sequential and Variational , 1997 .

[33]  C. Bohren,et al.  An introduction to atmospheric radiation , 1981 .

[34]  E. Kalnay,et al.  Handling Nonlinearity in an Ensemble Kalman Filter: Experiments with the Three-Variable Lorenz Model , 2012 .

[35]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[36]  Jeffrey L. Anderson.  Spatially and temporally varying adaptive covariance inflation for ensemble filters , 2009 .

[37]  J. Butcher.  Numerical Methods for Ordinary Differential Equations: Butcher/Numerical Methods , 2005 .

[38]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .

[39]  Michael Ghil,et al.  Advanced data assimilation in strongly nonlinear dynamical systems , 1994 .

[40]  Liqun Wang,et al.  A new structure for error covariance matrices and their adaptive estimation in EnKF assimilation , 2013 .

[41]  Takemasa Miyoshi,et al.  The Local Ensemble Transform Kalman Filter with the Weather Research and Forecasting Model: Experiments with Real Observations , 2012, Pure and Applied Geophysics.

[42]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[43]  Liqun Wang,et al.  Second-order nonlinear least squares estimation , 2008 .

[44]  Matematik,et al.  Numerical Methods for Ordinary Differential Equations: Butcher/Numerical Methods , 2005 .

[45]  T. Miyoshi.  The Gaussian Approach to Adaptive Covariance Inflation and Its Implementation with the Local Ensemble Transform Kalman Filter , 2011 .

[46]  Jeffrey L. Anderson,et al.  An adaptive covariance inflation error correction algorithm for ensemble filters , 2007 .

[47]  E. Lorenz.  Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[48]  M. Matricardi,et al.  An improved fast radiative transfer model for assimilation of satellite radiance observations , 1999 .