Using reduced-precision arithmetic in the adjoint model of MITgcm

In recent years, it has been convincingly shown that weather forecasting models can be run in single-precision arithmetic. Several models or components thereof have been tested with even lower precision than this. This previous work has largely focused on the main nonlinear `forward' model. A nonlinear model (in weather forecasting or otherwise) can have corresponding tangent linear and adjoint models, which are used in 4D variational data assimilation. The linearised models are plausibly far more sensitive to reductions in numerical precision since unbounded error growth can occur with no possibility of nonlinear saturation. In this paper, we present a geophysical experiment that makes use of an adjoint model to calculate sensitivities and perform optimisation. Using software emulation, we investigate the effect of degrading the numerical precision of the adjoint model. We find that reasonable results are obtained with as few as 10 significand bits, equal to the significand precision in the IEEE half-precision standard.

[1]  Matthew Chantry,et al.  Scale-Selective Precision for Weather and Climate Forecasting , 2019, Monthly Weather Review.

[2]  T. Palmer,et al.  Reduced‐precision parametrization: lessons from an intermediate‐complexity atmospheric model , 2020, Quarterly Journal of the Royal Meteorological Society.

[3]  Peter D. Düben,et al.  Single Precision in Weather Forecasting Models: An Evaluation with the IFS , 2017 .

[4]  Peter D. Düben,et al.  rpe v5: an emulator for reduced floating-point precision in large numerical simulations , 2016 .

[5]  Jean Utke,et al.  OpenAD/F: A Modular Open-Source Tool for Automatic Differentiation of Fortran Codes , 2008, TOMS.

[6]  Carl Wunsch,et al.  Global ocean circulation during 1992-1997, estimated from ocean observations and a general circulation model , 2002 .

[7]  C. M. Maynard,et al.  Mixed-precision arithmetic in the ENDGame dynamical core of the Unified Model, a numerical weather prediction and climate model code , 2019, Comput. Phys. Commun..

[8]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[9]  Peter D. Düben,et al.  Benchmark Tests for Numerical Weather Forecasts on Inexact Hardware , 2014 .

[10]  Simon T. K. Lang,et al.  Stochastic representations of model uncertainties at ECMWF: state of the art and future vision , 2017 .

[11]  L. Perelman,et al.  A finite-volume, incompressible Navier Stokes model for studies of the ocean on parallel computers , 1997 .

[12]  T. Palmer,et al.  More reliable forecasts with less precise computations: a fast-track route to cloud-resolved weather and climate simulators? , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  R. Giering,et al.  Construction of the adjoint MIT ocean general circulation model and application to Atlantic heat transport sensitivity , 1999 .

[14]  Ana Cortés,et al.  How to use mixed precision in ocean models: exploring a potential reduction of numerical precision in NEMO 4.0 and ROMS 3.6 , 2019, Geoscientific Model Development.

[15]  Tim Palmer,et al.  A power law for reduced precision at small spatial scales: Experiments with an SQG model , 2018 .

[16]  Andreas Griewank,et al.  Algorithm 799: revolve: an implementation of checkpointing for the reverse or adjoint mode of computational differentiation , 2000, TOMS.

[17]  Laurent Hascoët,et al.  The Tapenade automatic differentiation tool: Principles, model, and specification , 2013, TOMS.

[18]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[19]  C. Wunsch,et al.  ECCO version 4: an integrated framework for non-linear inverse modeling and global ocean state estimation , 2015 .

[20]  Hirofumi Tomita,et al.  Single Precision in the Dynamical Core of a Nonhydrostatic Global Atmospheric Model: Evaluation Using a Baroclinic Wave Test Case , 2018 .

[21]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[22]  Peter D. Düben,et al.  The use of imprecise processing to improve accuracy in weather & climate prediction , 2014, J. Comput. Phys..

[23]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. Ii: Numerical Results , 2007 .

[24]  T. Palmer,et al.  Stochastic parametrization and model uncertainty , 2009 .

[25]  Andrew T. T. McRae,et al.  Single-Precision in the Tangent-Linear and Adjoint Models of Incremental 4D-Var , 2020 .

[26]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory , 2007 .

[27]  Takemasa Miyoshi,et al.  Choosing the Optimal Numerical Precision for Data Assimilation in the Presence of Model Error , 2018, Journal of Advances in Modeling Earth Systems.