Capturing missing physics in climate model parameterizations using neural differential equations

Even with today's immense computational resources, climate models cannot resolve every cloud in the atmosphere or eddying swirl in the ocean. However, collectively these small-scale turbulent processes play a key role in setting Earth's climate. Climate models attempt to represent unresolved scales via surrogate models known as parameterizations. These have limited fidelity and can exhibit structural deficiencies. Here we demonstrate that neural differential equations (NDEs) may be trained by highly resolved fluid-dynamical models of the scales to be parameterized and those NDEs embedded in an ocean model. They can incorporate conservation laws and are stable in time. We argue that NDEs provide a new route forward to the development of surrogate models for climate science, opening up exciting new opportunities.

[1]  P. Guttorp,et al.  Uncertainty analysis in climate change assessments , 2013 .

[2]  Alan Edelman,et al.  Oceananigans.jl: Fast and friendly geophysical fluid dynamics on GPUs , 2020, J. Open Source Softw..

[3]  W. Large,et al.  Argo Observations of the Deep Mixing Band in the Southern Ocean: A Salinity Modeling Challenge , 2018, Journal of Geophysical Research: Oceans.

[4]  C. Mechoso,et al.  A global perspective on CMIP5 climate model biases , 2014 .

[5]  Ali Ramadhan,et al.  Universal Differential Equations for Scientific Machine Learning , 2020, ArXiv.

[6]  W. Large,et al.  Nonlocal Transport and Implied Viscosity and Diffusivity throughout the Boundary Layer in LES of the Southern Ocean with Surface Waves , 2019, Journal of Physical Oceanography.

[7]  G. Schmidt,et al.  Evaluating the Performance of Past Climate Model Projections , 2020, Geophysical Research Letters.

[8]  Andrew Gettelman,et al.  The Art and Science of Climate Model Tuning , 2017 .

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Kurt Keutzer,et al.  ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs , 2019, IJCAI.

[11]  K. Speer,et al.  Closure of the meridional overturning circulation through Southern Ocean upwelling , 2012 .

[12]  S. Bony,et al.  What Are Climate Models Missing? , 2013, Science.

[13]  S. SIAMJ.,et al.  FOURTH ORDER CHEBYSHEV METHODS WITH RECURRENCE RELATION∗ , 2002 .

[14]  Andrew T. Wittenberg,et al.  Impacts on Ocean Heat from Transient Mesoscale Eddies in a Hierarchy of Climate Models , 2015 .

[15]  Andre N. Souza,et al.  Uncertainty Quantification of Ocean Parameterizations: Application to the K‐Profile‐Parameterization for Penetrative Convection , 2020, Journal of Advances in Modeling Earth Systems.