Parallel Implementation of an Ensemble Kalman Filter

AbstractSince mid-February 2013, the ensemble Kalman filter (EnKF) in operation at the Canadian Meteorological Centre (CMC) has been using a 600 × 300 global horizontal grid and 74 vertical levels. This yields 5.4 × 107 model coordinates. The EnKF has 192 members and uses seven time levels, spaced 1 h apart, for the time interpolation in the 6-h assimilation window. It follows that over 7 × 1010 values are required to specify an ensemble of trial field trajectories. This paper focuses on numerical and computational aspects of the EnKF. In response to the increasing computational challenge posed by the ever more ambitious configurations, an ever larger fraction of the EnKF software system has gradually been parallelized over the past decade. In a strong scaling experiment, the way in which the execution time decreases as larger numbers of processes are used is investigated. In fact, using a substantial fraction of one of the CMC's computers, very short execution times are achieved. As it would thus appear ...

[1]  Istvan Szunyogh,et al.  A local ensemble transform Kalman filter data assimilation system for the NCEP global model , 2008 .

[2]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[3]  M. Buehner,et al.  Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part I: Description and Single-Observation Experiments , 2010 .

[4]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[5]  Siegfried Benkner,et al.  Experiments with Cholesky Factorization on Clusters of SMPs , 2002 .

[6]  Louis Garand,et al.  Signature of the atmospheric compressibility factor in COSMIC, CHAMP, and GRACE radio occultation data , 2009 .

[7]  Martin Fowler,et al.  Refactoring - Improving the Design of Existing Code , 1999, Addison Wesley object technology series.

[8]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[9]  M. Matricardi,et al.  An improved fast radiative transfer model for assimilation of satellite radiance observations , 1999 .

[10]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[11]  William Gropp,et al.  Skjellum using mpi: portable parallel programming with the message-passing interface , 1994 .

[12]  C. Bishop,et al.  Cloud-Resolving Hurricane Initialization and Prediction through Assimilation of Doppler Radar Observations with an Ensemble Kalman Filter , 2009 .

[13]  Rohit Chandra,et al.  Parallel programming in openMP , 2000 .

[14]  Jeffrey L. Anderson,et al.  Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation , 2007 .

[15]  Przemyslaw Stpiczynski,et al.  Book Review: Parallel Programming in OpenMP Helps Novices (A review of Parallel Programming in OpenMP by Rohit Chandra, Leonardo Dagum, Dave Kohr, Dror Maydan, Jeff McDonald, and Ramesh Menon) , 2002, IEEE Distributed Syst. Online.

[16]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[17]  Jan Mandel,et al.  Efficient Implementation of the Ensemble Kalman Filter Efficient Implementation of the Ensemble Kalman Filter , 2022 .

[18]  Jean Côté,et al.  Staggered Vertical Discretization of the Canadian Environmental Multiscale (GEM) Model Using a Coordinate of the Log-Hydrostatic-Pressure Type , 2014 .

[19]  Eugenia Kalnay,et al.  Weight interpolation for efficient data assimilation with the Local Ensemble Transform Kalman Filter , 2009 .

[20]  P. Houtekamer,et al.  Ensemble size, balance, and model-error representation in an ensemble Kalman filter , 2002 .

[21]  Seung-Jong Baek,et al.  Higher Resolution in an Operational Ensemble Kalman Filter , 2014 .

[22]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[23]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part I: Design Considerations and Formulation , 1998 .

[24]  S. Cohn,et al.  Assessing the Effects of Data Selection with the DAO Physical-Space Statistical Analysis System* , 1998 .

[25]  Gerhard Wellein,et al.  Introduction to High Performance Computing for Scientists and Engineers , 2010, Chapman and Hall / CRC computational science series.

[26]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[27]  G. Evensen,et al.  Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with , 1996 .

[28]  Thomas M. Hamill,et al.  Ensemble Data Assimilation with the NCEP Global Forecast System , 2008 .

[29]  Jeffrey L. Anderson.  An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[30]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part II: Results , 1998 .

[31]  P. L. Houtekamer,et al.  Ensemble Kalman filtering , 2005 .

[32]  M. Rienecker,et al.  Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model , 2002 .

[33]  X. Deng,et al.  Model Error Representation in an Operational Ensemble Kalman Filter , 2009 .

[34]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[35]  Lars Nerger,et al.  Software for ensemble-based data assimilation systems - Implementation strategies and scalability , 2013, Comput. Geosci..

[36]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[37]  P. L. Houtekamer,et al.  Ensemble Kalman Filter Configurations and Their Performance with the Logistic Map , 2009 .

[38]  M. Buehner,et al.  Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part II: One-Month Experiments with Real Observations , 2010 .