An Ensemble Multiscale Filter for Large Nonlinear Data Assimilation Problems

Abstract Operational data assimilation problems tend to be very large, both in terms of the number of unknowns to be estimated and the number of measurements to be processed. This poses significant computational challenges, especially for ensemble methods, which are critically dependent on the number of replicates used to derive sample covariances and other statistics. Most efforts to deal with the related problems of computational effort and sampling error in ensemble estimation have focused on spatial localization. The ensemble multiscale Kalman filter described here offers an alternative approach that effectively replaces, at each update time, the prior (or background) sample covariance with a multiscale tree. The tree is composed of nodes distributed over a relatively small number of discrete scales. Global correlations between variables at different locations are described in terms of local relationships between nodes at adjacent scales (parents and children). The Kalman updating process can be carri...

[1]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[2]  Paul W. Fieguth,et al.  An overlapping tree approach to multiscale stochastic modeling and estimation , 1997, IEEE Trans. Image Process..

[3]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[4]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[5]  Alan S. Willsky,et al.  Computationally Efficient Stochastic Realization for Internal Multiscale Autoregressive Models , 2001, Multidimens. Syst. Signal Process..

[6]  Istvan Szunyogh,et al.  A Local Ensemble Kalman Filter for Atmospheric Data Assimilation , 2002 .

[7]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[8]  A. Willsky Multiresolution Markov models for signal and image processing , 2002, Proc. IEEE.

[9]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[10]  M. Rienecker,et al.  Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model , 2002 .

[11]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[12]  D. Entekhabi,et al.  Land data assimilation and estimation of soil moisture using measurements from the Southern Great Plains 1997 Field Experiment , 2001 .

[13]  S. Popinet Gerris: a tree-based adaptive solver for the incompressible Euler equations in complex geometries , 2003 .

[14]  Kristine L. Bell,et al.  A Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking , 2007 .

[15]  D. McLaughlin,et al.  Hydrologic Data Assimilation with the Ensemble Kalman Filter , 2002 .

[16]  D. McLaughlin,et al.  Assessing the Performance of the Ensemble Kalman Filter for Land Surface Data Assimilation , 2006 .

[17]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[18]  P. Houtekamer,et al.  Ensemble size, balance, and model-error representation in an ensemble Kalman filter , 2002 .

[19]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[20]  Randal D. Koster,et al.  Global assimilation of satellite surface soil moisture retrievals into the NASA Catchment land surface model , 2005 .

[21]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[22]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[23]  K. Singha,et al.  Subsurface Hydrology: Data Integration for Properties and Processes , 2007 .

[24]  S. Cohn,et al.  Assessing the Effects of Data Selection with the DAO Physical-Space Statistical Analysis System* , 1998 .

[25]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .