On the convergence of a non-linear ensemble Kalman smoother

Abstract Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge dimension. Little is known, however, about the asymptotic behavior of ensemble methods. In this paper, we prove convergence in L p of ensemble Kalman smoother to the Kalman smoother in the large-ensemble limit, as well as the convergence of EnKS-4DVAR, which is a Levenberg–Marquardt-like algorithm with EnKS as the linear solver, to the classical Levenberg–Marquardt algorithm in which the linearized problem is solved exactly.

[1]  S. Gratton,et al.  4DVAR by ensemble Kalman smoother , 2013, 1304.5271.

[2]  P. Billingsley,et al.  Probability and Measure , 1980 .

[3]  F. Gland,et al.  Large sample asymptotics for the ensemble Kalman filter , 2009 .

[4]  Serge Gratton,et al.  Limited‐memory preconditioners, with application to incremental four‐dimensional variational data assimilation , 2008 .

[5]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[6]  Xuguang Wang,et al.  Incorporating Ensemble Covariance in the Gridpoint Statistical Interpolation Variational Minimization: A Mathematical Framework , 2010 .

[7]  Matthew Fisher,et al.  On the equivalence between Kalman smoothing and weak‐constraint four‐dimensional variational data assimilation , 2005, Quarterly Journal of the Royal Meteorological Society.

[8]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[9]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[10]  P. Gill,et al.  Algorithms for the Solution of the Nonlinear Least-Squares Problem , 1978 .

[11]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[12]  Jan Mandel,et al.  Convergence of the Square Root Ensemble Kalman Filter in the Large Ensemble Limit , 2014, SIAM/ASA J. Uncertain. Quantification.

[13]  Marc Bocquet,et al.  An iterative ensemble Kalman smoother , 2014 .

[14]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[15]  Dean S. Oliver,et al.  An Iterative EnKF for Strongly Nonlinear Systems , 2012 .

[16]  Marc Bocquet,et al.  Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems , 2012 .

[17]  Eugenia Kalnay,et al.  Ensemble Kalman Filter: Current Status and Potential , 2010 .

[18]  A. Stuart,et al.  Well-posedness and accuracy of the ensemble Kalman filter in discrete and continuous time , 2013, 1310.3167.

[19]  M. Zupanski.  Maximum Likelihood Ensemble Filter: Theoretical Aspects , 2005 .

[20]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  M. R. Osborne.  Nonlinear least squares — the Levenberg algorithm revisited , 1976, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[22]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[23]  Y. Trémolet.  Model‐error estimation in 4D‐Var , 2007 .

[24]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[25]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part II: Observing System Simulation Experiments with Advanced Research WRF (ARW) , 2009 .

[26]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test , 2008 .

[27]  Craig J. Johns,et al.  A two-stage ensemble Kalman filter for smooth data assimilation , 2008, Environmental and Ecological Statistics.

[28]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[29]  Qingnong Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part III: Antarctic Applications with Advanced Research WRF Using Real Data , 2013 .

[30]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[31]  J. Mandel,et al.  On the convergence of the ensemble Kalman filter , 2009, Applications of mathematics.

[32]  Ionel M. Navon,et al.  Optimality of variational data assimilation and its relationship with the Kalman filter and smoother , 2001 .

[33]  F. W. Cathey,et al.  The iterated Kalman filter update as a Gauss-Newton method , 1993, IEEE Trans. Autom. Control..

[34]  G. Evensen.  Data Assimilation: The Ensemble Kalman Filter , 2006 .

[35]  Jeffrey L. Anderson,et al.  An investigation into the application of an ensemble Kalman smoother to high-dimensional geophysical systems , 2008 .