A Statistical Investigation of the Sensitivity of Ensemble-Based Kalman Filters to Covariance Filtering

This paper investigates the effects of spatial filtering on the ensemble-based estimate of the background error covariance matrix in an ensemble-based Kalman filter (EnKF). In particular, a novel kernel smoothing method with variable bandwidth is introduced and its performance is compared to that of the widely used Gaspari‐Cohn filter, which uses a fifth-order kernel function with a fixed localization length. Numerical experiments are carried out with the 40-variable Lorenz-96 model. The results of the experiments show that the nonparametric approach provides a more accurate estimate of the background error covariance matrix than the Gaspari‐Cohn filter with any localization length. It is also shown that the Gaspari‐Cohn filter tends to provide more accurate estimates of the covariance with shorter localization lengths. However, the analyses obtained by using longer localization lengths tend to be more accurate than those produced by using short localization lengths or the nonparametric approach. This seemingly paradoxical result is explained by showing that localization with longer localization lengths produces filtered estimates whose time mean is the most similar to the time meanof both the unfilteredestimate and the true covariance. This result suggeststhat a better metric of covariance filtering skill would be one that combined a measure of closeness to the sample covariance matrix for a very large ensemble with a measure of similarity between the climatological averages of the filtered and sample covariance.

[1]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[2]  R. Daley.  Atmospheric Data Analysis , 1991 .

[3]  Peter Hall,et al.  Properties of nonparametric estimators of autocovariance for stationary random fields , 1994 .

[4]  D. S. Sivia,et al.  Data Analysis , 1996, Encyclopedia of Evolutionary Psychological Science.

[5]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[6]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[7]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[8]  Montserrat Fuentes,et al.  A high frequency kriging approach for non‐stationary environmental processes , 2001 .

[9]  Jeffrey L. Anderson.  An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[10]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[11]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[12]  Istvan Szunyogh,et al.  A Local Ensemble Kalman Filter for Atmospheric Data Assimilation , 2002 .

[13]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[14]  Thomas M. Hamill,et al.  Ensemble-Based Data Assimilation , 2003 .

[15]  Istvan Szunyogh,et al.  Assessing a local ensemble Kalman filter : perfect model experiments with the National Centers for Environmental Prediction global model , 2004 .

[16]  Z. Q. John Lu,et al.  Nonlinear Time Series: Nonparametric and Parametric Methods , 2004, Technometrics.

[17]  J. Whitaker,et al.  Accounting for the Error due to Unresolved Scales in Ensemble Data Assimilation: A Comparison of Different Approaches , 2005 .

[18]  P. L. Houtekamer,et al.  Ensemble Kalman filtering , 2005 .

[19]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[20]  Edward N. Lorenz,et al.  Designing Chaotic Models , 2005 .

[21]  Istvan Szunyogh,et al.  Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter , 2005, physics/0511236.

[22]  E. Lorenz.  Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[23]  Christopher J Paciorek,et al.  Spatial modelling using a new class of nonstationary covariance functions , 2006, Environmetrics.

[24]  Mikyoung Jun,et al.  An Approach to Producing Space–Time Covariance Functions on Spheres , 2007, Technometrics.

[25]  Craig H. Bishop,et al.  Flow‐adaptive moderation of spurious ensemble correlations and its use in ensemble‐based data assimilation , 2007 .

[26]  Jeffrey L. Anderson.  EXPLORING THE NEED FOR LOCALIZATION IN ENSEMBLE DATA ASSIMILATION USING A HIERARCHICAL ENSEMBLE FILTER , 2007 .

[27]  Istvan Szunyogh,et al.  A local ensemble transform Kalman filter data assimilation system for the NCEP global model , 2008 .

[28]  Daniel Hodyss,et al.  Ensemble covariances adaptively localized with ECO-RAP. Part 1: tests on simple error models , 2009 .

[29]  Craig H. Bishop,et al.  Ensemble covariances adaptively localized with ECO‐RAP. Part 2: a strategy for the atmosphere , 2009 .

[30]  Craig H. Bishop,et al.  Ensemble covariances adaptively localized with ECO-RAP. Part 1: tests on simple error models , 2009 .

[31]  Fuqing Zhang,et al.  Coupling ensemble Kalman filter with four-dimensional variational data assimilation , 2009 .

[32]  Daniel Hodyss,et al.  Ensemble covariances adaptively localized with ECO-RAP. Part 2: a strategy for the atmosphere , 2009 .

[33]  C. Bishop,et al.  Cloud-Resolving Hurricane Initialization and Prediction through Assimilation of Doppler Radar Observations with an Ensemble Kalman Filter , 2009 .

[34]  Istvan Szunyogh,et al.  On the Propagation of Information and the Use of Localization in Ensemble Kalman Filtering , 2010 .

[35]  L. Berre,et al.  Filtering of Background Error Variances and Correlations by Local Spatial Averaging: A Review , 2010 .

[36]  임규호,et al.  Optimal sites for supplementary weather observations , 2011 .