Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization

Oceanographic observations are limited by sampling rates, while ocean models are limited by finite resolution and high viscosity and diffusion coefficients. Therefore, both data from observations and ocean models lack information at small and fast scales. Methods are needed to either extract information, extrapolate, or upscale existing oceanographic data sets, to account for or represent unresolved physical processes. Here we use machine learning to leverage observations and model data by predicting unresolved turbulent processes and subsurface flow fields. As a proof of concept, we train convolutional neural networks on degraded data from a high-resolution quasi-geostrophic ocean model. We demonstrate that convolutional neural networks successfully replicate the spatiotemporal variability of the subgrid eddy momentum forcing, are capable of generalizing to a range of dynamical behaviors, and can be forced to respect global momentum conservation. The training data of our convolutional neural networks can be subsampled to 10–20% of the original size without a significant decrease in accuracy. We also show that the subsurface flow field can be predicted using only information at the surface (e.g., using only satellite altimetry data). Our results indicate that data-driven approaches can be exploited to predict both subgrid and large-scale processes, while respecting physical principles, even when data are limited to a particular region or external forcing. Our in-depth study presents evidence for the successful design of ocean eddy parameterizations for implementation in coarse-resolution climate models.

[1]  Pierre Gentine,et al.  Could Machine Learning Break the Convection Parameterization Deadlock? , 2018, Geophysical Research Letters.

[2]  C. Chapman,et al.  Can we reconstruct mean and eddy fluxes from Argo floats , 2017, 1706.00937.

[3]  D. Chelton,et al.  Global observations of large oceanic eddies , 2007 .

[4]  J. Brankart,et al.  Uncertainty and scale interactions in ocean ensembles: From seasonal forecasts to multidecadal climate predictions , 2018, Quarterly Journal of the Royal Meteorological Society.

[5]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  M. Manga,et al.  Increased stream discharge after the 3 September 2016 Mw 5.8 Pawnee, Oklahoma earthquake , 2016 .

[8]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  L. Zanna,et al.  A deformation-based parametrization of ocean mesoscale eddy reynolds stresses , 2017 .

[10]  Robert B. Scott,et al.  On Eddy Viscosity, Energy Cascades, and the Horizontal Resolution of Gridded Satellite Altimeter Products* , 2013 .

[11]  P. O'Gorman,et al.  Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events , 2018, Journal of Advances in Modeling Earth Systems.

[12]  Hua Su,et al.  Retrieving Temperature Anomaly in the Global Subsurface and Deeper Ocean From Satellite Observations , 2018 .

[13]  J. Nathan Kutz,et al.  Deep learning in fluid dynamics , 2017, Journal of Fluid Mechanics.

[14]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[16]  P. Berloff On dynamically consistent eddy fluxes , 2005 .

[17]  Brendan D. Tracey,et al.  A Machine Learning Strategy to Assist Turbulence Model Development , 2015 .

[18]  Christopher Chapman,et al.  Reconstruction of Subsurface Velocities From Satellite Observations Using Iterative Self-Organizing Maps , 2016, IEEE Geoscience and Remote Sensing Letters.

[19]  PierGianLuca Porta Mana,et al.  Scale-aware deterministic and stochastic parametrizations of eddy-mean flow interaction , 2017 .

[20]  Lynne Milgram,et al.  Using Artificial Intelligence , 1999 .

[21]  Michelle Girvan,et al.  Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model , 2018, Chaos.

[22]  Donald D. Lucas,et al.  Machine Learning Predictions of a Multiresolution Climate Model Ensemble , 2018 .

[23]  R. Greatbatch,et al.  Ocean eddy momentum fluxes at the latitudes of the Gulf Stream and the Kuroshio extensions as revealed by satellite data , 2010 .

[24]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[25]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  S. Pope A more general effective-viscosity hypothesis , 1975, Journal of Fluid Mechanics.

[28]  S. E. Haupt,et al.  Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather , 2017 .

[29]  Andrew J. Majda,et al.  New Methods for Estimating Ocean Eddy Heat Transport Using Satellite Altimetry , 2012 .

[30]  Sepp Hochreiter,et al.  Self-Normalizing Neural Networks , 2017, NIPS.

[31]  P. Sagaut BOOK REVIEW: Large Eddy Simulation for Incompressible Flows. An Introduction , 2001 .

[32]  V. Lyubchich,et al.  Estimating Oxygen in the Southern Ocean Using Argo Temperature and Salinity , 2018, Journal of Geophysical Research: Oceans.

[33]  Romain Bourdallé-Badie,et al.  The impact of resolving the Rossby radius at mid-latitudes in the ocean: results from a high-resolution version of the Met Office GC2 coupled model , 2016 .

[34]  Robert Hallberg,et al.  Using a resolution function to regulate parameterizations of oceanic mesoscale eddy effects , 2013 .

[35]  D. Chelton,et al.  Surface Eddy Momentum Flux and Velocity Variances in the Southern Ocean from Geosat Altimetry , 1994 .

[36]  Jaideep Pathak,et al.  Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach. , 2018, Physical review letters.

[37]  S. Riser,et al.  The Argo Program : observing the global ocean with profiling floats , 2009 .

[38]  Jing Xu,et al.  A Deep Learning Algorithm of Neural Network for the Parameterization of Typhoon‐Ocean Feedback in Typhoon Forecast Models , 2018 .

[39]  C. Moeng A Large-Eddy-Simulation Model for the Study of Planetary Boundary-Layer Turbulence , 1984 .

[40]  PierGianLuca Porta Mana,et al.  Toward a stochastic parameterization of ocean mesoscale eddies , 2014 .

[41]  Russ E. Davis,et al.  E 2008, by the American Society of Limnology and Oceanography, Inc. Glider surveillance of physics and biology in the southern California Current System , 2022 .

[42]  Petros Koumoutsakos,et al.  Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks , 2018, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[43]  R. Scott,et al.  Direct Evidence of an Oceanic Inverse Kinetic Energy Cascade from Satellite Altimetry , 2005 .

[44]  E. Curchitser,et al.  Energetics of Eddy–Mean Flow Interactions in the Gulf Stream Region , 2015 .

[45]  David M. Fratantoni,et al.  UNDERWATER GLIDERS FOR OCEAN RESEARCH , 2004 .

[46]  Michael Durand,et al.  The Surface Water and Ocean Topography Mission: Observing Terrestrial Surface Water and Oceanic Submesoscale Eddies , 2010, Proceedings of the IEEE.

[47]  Julia Ling,et al.  Machine learning strategies for systems with invariance properties , 2016, J. Comput. Phys..

[48]  D. Menemenlis,et al.  Seasonality of submesoscale dynamics in the Kuroshio Extension , 2016 .

[49]  S. Jayne,et al.  Eddy-Mean Flow interactions in the Along-Stream Development of a Western Boundary Current Jet: An Idealized Model Study , 2011 .

[50]  J. Marshall,et al.  Global surface eddy diffusivities derived from satellite altimetry , 2013 .

[51]  Nelson G. Hogg,et al.  On the transport of the gulf stream between cape hatteras and the grand banks , 1992 .

[52]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[53]  L. Zanna,et al.  The Impact of Horizontal Resolution on Energy Transfers in Global Ocean Models , 2017 .

[54]  S. Keating,et al.  Upper ocean flow statistics estimated from superresolved sea‐surface temperature images , 2015 .

[55]  Noah D. Brenowitz,et al.  Prognostic Validation of a Neural Network Unified Physics Parameterization , 2018, Geophysical Research Letters.

[56]  R. Greatbatch,et al.  Transport driven by eddy momentum fluxes in the Gulf Stream Extension region , 2010 .

[57]  P. L. Traon,et al.  AN IMPROVED MAPPING METHOD OF MULTISATELLITE ALTIMETER DATA , 1998 .

[58]  Marika M. Holland,et al.  Ocean viscosity and climate , 2008 .

[59]  Glauco de Souza Rolim,et al.  Rainfall prediction methodology with binary multilayer perceptron neural networks , 2019, Climate Dynamics.

[60]  S. Jayne,et al.  Eddy–Mean Flow Interaction in the Kuroshio Extension Region , 2011 .