Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter

The usefulness of a distance-dependent reduction of background error covariance estimates in an ensemble Kalman filter is demonstrated. Covariances are reduced by performing an elementwise multiplication of the background error covariance matrix with a correlation function with local support. This reduces noisiness and results in an improved background error covariance estimate, which generates a reduced-error ensemble of model initial conditions. The benefits of applying the correlation function can be understood in part from examining the characteristics of simple 2 3 2 covariance matrices generated from random sample vectors with known variances and covariance. These show that noisiness in covariance estimates tends to overwhelm the signal when the ensemble size is small and/or the true covariance between the sample elements is small. Since the true covariance of forecast errors is generally related to the distance between grid points, covariance estimates generally have a higher ratio of noise to signal with increasing distance between grid points. This property is also demonstrated using a twolayer hemispheric primitive equation model and comparing covariance estimates generated by small and large ensembles. Covariances from the large ensemble are assumed to be accurate and are used a reference for measuring errors from covariances estimated from a small ensemble. The benefits of including distance-dependent reduction of covariance estimates are demonstrated with an ensemble Kalman filter data assimilation scheme. The optimal correlation length scale of the filter function depends on ensemble size; larger correlation lengths are preferable for larger ensembles. The effects of inflating background error covariance estimates are examined as a way of stabilizing the filter. It was found that more inflation was necessary for smaller ensembles than for larger ensembles.

[1]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[3]  William H. Press,et al.  Numerical Recipes: FORTRAN , 1988 .

[4]  R. Daley Atmospheric Data Analysis , 1991 .

[5]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[6]  J. Whitaker,et al.  An Adjoint Sensitivity Study of Blocking in a Two-Layer Isentropic Model , 1993 .

[7]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[8]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[9]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[10]  G. Evensen,et al.  Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with , 1996 .

[11]  E. Kalnay,et al.  Ensemble Forecasting at NCEP and the Breeding Method , 1997 .

[12]  Stephen E. Cohn,et al.  An Introduction to Estimation Theory (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice) , 1997 .

[13]  Philippe Courtier,et al.  Unified Notation for Data Assimilation : Operational, Sequential and Variational , 1997 .

[14]  S. Cohn,et al.  An Introduction to Estimation Theory , 1997 .

[15]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[16]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[17]  P. Courtier,et al.  Extended assimilation and forecast experiments with a four‐dimensional variational assimilation system , 1998 .

[18]  A. Robinson,et al.  Data Assimilation via Error Subspace Statistical Estimation.Part I: Theory and Schemes , 1999, Monthly Weather Review.

[19]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[20]  Pierre FJ Lermusiaux Data Assimilation via Error Subspace Statistical Estimation. , 1999 .

[21]  Peter Jan van Leeuwen,et al.  Comment on ''Data Assimilation Using an Ensemble Kalman Filter Technique'' , 1999 .

[22]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[23]  Christian L. Keppenne,et al.  Data Assimilation into a Primitive-Equation Model with a Parallel Ensemble Kalman Filter , 2000 .

[24]  P. Houtekamer,et al.  An Adaptive Ensemble Kalman Filter , 2000 .

[25]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[26]  T. Hamill,et al.  A Comparison of Probabilistic Forecasts from Bred, Singular-Vector, and Perturbed Observation Ensembles , 2000 .

[27]  T. Hamill Interpretation of Rank Histograms for Verifying Ensemble Forecasts , 2001 .

[28]  Jeffrey L. Anderson An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[29]  Leonard A. Smith,et al.  Probabilistic noise reduction , 2001 .

[30]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[31]  A. Segers,et al.  Variance reduced ensemble Kalman filtering , 2001 .

[32]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[33]  C.,et al.  Analysis methods for numerical weather prediction , 2022 .