A Probabilistic Approach to Adaptive Covariance Localization for Serial Ensemble Square Root Filters

This study proposes a variational approach to adaptively determine the optimum radius of influence for ensemble covariance localization when uncorrelated observations are assimilated sequentially. The covariance localization is commonly used by various ensemble Kalman filters to limit the impact of covariance sampling errors when the ensemble size is small relative to the dimension of the state. The probabilistic approach is based on the premise of finding an optimum localization radius that minimizes the distance between the Kalman update using the localized sampling covariance versus using the true covariance, when the sequential ensemble Kalman square rootfilter method is used. The authorsfirst examine the effectiveness of the proposed method for the cases when the true covariance is known or can be approximated by a sufficiently large ensemble size. Not surprisingly, it is found that the smaller the true covariance distance or the smaller the ensemble, the smaller the localization radius that is needed. The authors further generalize the method to the more usual scenario that the true covariance is unknown but can be represented or estimated probabilistically based on the ensemble sampling covariance. The mathematical formula for this probabilistic and adaptive approach with the use of the Jeffreys prior is derived. Promising results and limitations of this new method are discussed through experiments using the Lorenz-96 system.

[1]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[2]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[3]  Jonathan Poterjoy,et al.  E3DVar: Coupling an Ensemble Kalman Filter with Three-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model and Comparison to E4DVar , 2013 .

[4]  Jeffrey L. Anderson Localization and Sampling Error Correction in Ensemble Kalman Filter Data Assimilation , 2012 .

[5]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[6]  Fuqing Zhang,et al.  Coupling ensemble Kalman filter with four-dimensional variational data assimilation , 2009 .

[7]  C. Snyder,et al.  Assimilation of Simulated Doppler Radar Observations with an Ensemble Kalman Filter , 2003 .

[8]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[9]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[10]  Jeffrey L. Anderson An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[11]  Lars Nerger,et al.  Ensemble Data Assimilation , 2009 .

[12]  Fuqing Zhang,et al.  Tests of an Ensemble Kalman Filter for Mesoscale and Regional-Scale Data Assimilation. Part I: Perfect Model Experiments , 2006 .

[13]  R. Muirhead Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[14]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[15]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[16]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[17]  Chris Snyder,et al.  A Hybrid ETKF-3DVAR Data Assimilation Scheme for the WRF Model. Part I: Observing System Simulation Experiment , 2008 .

[18]  Juanzhen Sun,et al.  Impacts of Initial Estimate and Observation Availability on Convective-Scale Data Assimilation with an Ensemble Kalman Filter , 2004 .

[19]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[20]  Mark Buehner,et al.  Efficient Ensemble Covariance Localization in Variational Data Assimilation , 2011 .

[21]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[22]  Craig H. Bishop,et al.  Flow‐adaptive moderation of spurious ensemble correlations and its use in ensemble‐based data assimilation , 2007 .

[23]  Chris Snyder,et al.  A Hybrid ETKF–3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments , 2008 .

[24]  Istvan Szunyogh,et al.  A local ensemble Kalman filter for atmospheric data assimilation , 2004 .

[25]  Roger Daley,et al.  Spectral Characteristics of Kalman Filter Systems for Atmospheric Data Assimilation , 1993 .

[26]  Istvan Szunyogh,et al.  A Statistical Investigation of the Sensitivity of Ensemble-Based Kalman Filters to Covariance Filtering , 2011 .

[27]  Jeffrey L. Anderson,et al.  Comparisons of Empirical Localization Techniques for Serial Ensemble Kalman Filters in a Simple Atmospheric General Circulation Model , 2014 .

[28]  E. Lorenz Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[29]  Lili Lei,et al.  Empirical Localization of Observation Impact in Ensemble Kalman Filters , 2013 .