Nonlinear data assimilation in geosciences: an extremely efficient particle filter

Almost all research fields in geosciences use numerical models and observations and combine these using data‐assimilation techniques. With ever‐increasing resolution and complexity, the numerical models tend to be highly nonlinear and also observations become more complicated and their relation to the models more nonlinear. Standard data‐assimilation techniques like (ensemble) Kalman filters and variational methods like 4D‐Var rely on linearizations and are likely to fail in one way or another. Nonlinear data‐assimilation techniques are available, but are only efficient for small‐dimensional problems, hampered by the so‐called ‘curse of dimensionality’. Here we present a fully nonlinear particle filter that can be applied to higher dimensional problems by exploiting the freedom of the proposal density inherent in particle filtering. The method is illustrated for the three‐dimensional Lorenz model using three particles and the much more complex 40‐dimensional Lorenz model using 20 particles. By also applying the method to the 1000‐dimensional Lorenz model, again using only 20 particles, we demonstrate the strong scale‐invariance of the method, leading to the optimistic conjecture that the method is applicable to realistic geophysical problems. Copyright © 2010 Royal Meteorological Society

[1]  Peter Jan,et al.  Particle Filtering in Geophysical Systems , 2009 .

[2]  A. Chorin,et al.  Implicit sampling for particle filters , 2009, Proceedings of the National Academy of Sciences.

[3]  Fuqing Zhang,et al.  Coupling ensemble Kalman filter with four-dimensional variational data assimilation , 2009 .

[4]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[5]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory , 2007 .

[6]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. Ii: Numerical Results , 2007 .

[7]  Chris Snyder,et al.  Toward a nonlinear ensemble filter for high‐dimensional systems , 2003 .

[8]  Pradipta Sarkar,et al.  Sequential Monte Carlo Methods in Practice , 2003, Technometrics.

[9]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[10]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[11]  Philippe Courtier,et al.  Dual formulation of four‐dimensional variational assimilation , 1997 .

[12]  G. Evensen,et al.  Data assimilation and inverse methods in terms of a probabilistic formulation , 1996 .

[13]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[14]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[15]  A. Bennett Inverse Methods in Physical Oceanography: Frontmatter , 1992 .

[16]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[17]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[18]  G. Evensen Data Assimilation: The Ensemble Kalman Filter , 2006 .

[19]  P. Atzberger The Monte-Carlo Method , 2006 .

[20]  E. Lorenz Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[21]  under a Creative Commons License. Nonlinear Processes in Geophysics Merging particle filter for sequential data assimilation , 2022 .