Parameter and state estimation with ensemble Kalman filter based algorithms for convective‐scale applications

Representation of clouds in convection-permitting models is sensitive to numerical weather prediction (NWP) model parameters that are often very crudely known (for example roughness length). Our goal is to allow for uncertainty in these parameters and estimate them from data using the ensemble Kalman filter (EnKF) approach. However, to deal with difficulties associated with convective-scale applications, such as non-Gaussianity and constraints on state and parameter values, modifications to classical EnKF are necessary. In this article, we evaluate and extend several recently developed EnKF-based algorithms that either incorporate constraints such as mass conservation and positivity of precipitation explicitly or introduce higher order moments on the joint state and parameter estimation problem. We compare their results with the localized EnKF for a common idealized test case. The test case uses perfect model experiments with the one-dimensional modified shallow-water model, which was designed to mimic important properties of convection. We use a stochastic dynamical model for parameters, in order to prevent underdispersion in parameter space. To deal with localization for estimation of parameters, we introduce a method called global updating, which is a computationally cheap modification of spatial updating and was proven successful in this context. The sensitivity of the results to the number of ensemble members and localization, as well as observation coverage and frequency, is shown. Although all algorithms are capable of reducing the initial state and parameter errors, it is concluded that mass conservation is important when the localization radius is small and/or the observations are sparse. In addition, accounting for higher order moments in the joint space and parameter estimation problem is beneficial when the ensemble size is large enough or when applied to parameter estimation only.

[1]  Hartwig Deneke,et al.  Initial phase of the Hans-Ertel Centre for Weather Research - A virtual centre at the interface of basic and applied weather and climate research , 2014 .

[2]  G. Evensen,et al.  Sequential Data Assimilation Techniques in Oceanography , 2003 .

[3]  E. Kalnay,et al.  Effective assimilation of global precipitation: simulation experiments , 2013 .

[4]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[5]  Ibrahim Hoteit,et al.  An iterative ensemble Kalman filter with one-step-ahead smoothing for state-parameters estimation of contaminant transport models , 2015 .

[6]  Brad Weir,et al.  Implicit Estimation of Ecological Model Parameters , 2013, Bulletin of mathematical biology.

[7]  Gérald Desroziers,et al.  Improving spatial localization in 4DEnVar , 2016 .

[8]  Yuefei Zeng,et al.  Study of conservation laws with the Local Ensemble Transform Kalman Filter , 2016 .

[9]  G. Craig,et al.  A simple dynamical model of cumulus convection for data assimilation research , 2014 .

[10]  Matthias Morzfeld,et al.  Implicit particle filters for data assimilation , 2010, 1005.4002.

[11]  G. Kivman,et al.  Sequential parameter estimation for stochastic systems , 2003 .

[12]  Robert Jacob,et al.  Ensemble-Based Parameter Estimation in a Coupled GCM Using the Adaptive Spatial Average Method , 2014 .

[13]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[14]  Takemasa Miyoshi,et al.  Estimating Model Parameters with Ensemble-Based Data Assimilation: Parameter Covariance Treatment , 2013 .

[15]  Yvonne Ruckstuhl,et al.  Ensemble‐type Kalman filter algorithm conserving mass, total energy and enstrophy , 2017 .

[16]  G. Evensen,et al.  An ensemble Kalman smoother for nonlinear dynamics , 2000 .

[17]  George C. Craig,et al.  The Impact of Data Assimilation Length Scales on Analysis and Prediction of Convective Storms , 2014 .

[18]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[19]  Laurent Bertino,et al.  Gaussian anamorphosis extension of the DEnKF for combined state parameter estimation: Application to a 1D ocean ecosystem model , 2012 .

[20]  Sandrine Mouysset,et al.  Experiences in multiyear combined state-parameter estimation with an ecosystem model of the North Atlantic and Arctic Oceans using the Ensemble Kalman Filter , 2015 .

[21]  G. Evensen The ensemble Kalman filter for combined state and parameter estimation , 2009, IEEE Control Systems.

[22]  J. Poterjoy A Localized Particle Filter for High-Dimensional Nonlinear Systems , 2016 .

[23]  Derek J. Posselt,et al.  Errors in Ensemble Kalman Smoother Estimates of Cloud Microphysical Parameters , 2014 .

[24]  Daniel Hodyss Ensemble State Estimation for Nonlinear Systems Using Polynomial Expansions in the Innovation , 2011 .

[25]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[26]  Daniel Hodyss Accounting for Skewness in Ensemble Data Assimilation , 2012 .

[27]  Laurent Bertino,et al.  Application of the Gaussian anamorphosis to assimilation in a 3-D coupled physical-ecosystem model of the North Atlantic with the EnKF: a twin experiment , 2009 .

[28]  Arturo I. Quintanar,et al.  Atmospheric sensitivity to roughness length in a regional atmospheric model over the Ohio–Tennessee River Valley , 2016, Meteorology and Atmospheric Physics.

[29]  Fuqing Zhang,et al.  Ensemble‐based simultaneous state and parameter estimation with MM5 , 2006 .

[30]  Craig H. Bishop,et al.  The GIGG‐EnKF: ensemble Kalman filtering for highly skewed non‐negative uncertainty distributions , 2016 .

[31]  Marc Bocquet,et al.  An iterative ensemble Kalman smoother , 2014 .

[32]  E. Kalnay,et al.  Balance and Ensemble Kalman Filter Localization Techniques , 2011 .

[33]  Clemens Simmer,et al.  HErZ: The German Hans-Ertel Centre for Weather Research , 2016 .

[34]  Martin Verlaan,et al.  Conservation of Mass and Preservation of Positivity with Ensemble-Type Kalman Filter Algorithms , 2014 .

[35]  Marc Bocquet,et al.  Joint state and parameter estimation with an iterative ensemble Kalman smoother , 2013 .

[36]  James D. Annan,et al.  Parameter estimation in an intermediate complexity earth system model using an ensemble Kalman filter , 2005 .

[37]  Marc Bocquet,et al.  Localization and the iterative ensemble Kalman smoother , 2016 .

[38]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[39]  Jens Schröter,et al.  Sequential weak constraint parameter estimation in an ecosystem model , 2003 .

[40]  E. Wood,et al.  Data Assimilation for Estimating the Terrestrial Water Budget Using a Constrained Ensemble Kalman Filter , 2006 .

[41]  Takemasa Miyoshi,et al.  Assimilation of TRMM Multisatellite Precipitation Analysis with a Low-Resolution NCEP Global Forecast System , 2016 .

[42]  J. Kepert Covariance localisation and balance in an Ensemble Kalman Filter , 2009 .

[43]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[44]  Albert C. Reynolds,et al.  Ensemble smoother with multiple data assimilation , 2013, Comput. Geosci..

[45]  Takemasa Miyoshi,et al.  Estimating Model Parameters with Ensemble-Based Data Assimilation: A Review , 2013 .