Improving Data‐Driven Global Weather Prediction Using Deep Convolutional Neural Networks on a Cubed Sphere

We present a significantly-improved data-driven global weather forecasting framework using a deep convolutional neural network (CNN) to forecast several basic atmospheric variables on a global grid. New developments in this framework include an offline volume-conservative mapping to a cubed-sphere grid, improvements to the CNN architecture, and the minimization of the loss function over multiple steps in a prediction sequence. The cubed-sphere remapping minimizes the distortion on the cube faces on which convolution operations are performed and provides natural boundary conditions for padding in the CNN. Our improved model produces weather forecasts that are indefinitely stable and produce realistic weather patterns at lead times of several weeks and longer. For short- to medium-range forecasting, our model significantly outperforms persistence, climatology, and a coarse-resolution dynamical numerical weather prediction (NWP) model. Unsurprisingly, our forecasts are worse than those from a high-resolution state-of-the-art operational NWP system. Our data-driven model is able to learn to forecast complex surface temperature patterns from few input atmospheric state variables. On annual time scales, our model produces a realistic seasonal cycle driven solely by the prescribed variation in top-of-atmosphere solar forcing. Although it is currently less accurate than operational weather forecasting models, our data-driven CNN executes much faster than those models, suggesting that machine learning could prove to be a valuable tool for large-ensemble forecasting.

[1]  Noah D. Brenowitz,et al.  Prognostic Validation of a Neural Network Unified Physics Parameterization , 2018, Geophysical Research Letters.

[2]  Chen Li,et al.  State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression , 2020, IEEE Journal of Selected Topics in Signal Processing.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Andrea Klug,et al.  Numerical Methods For Fluid Dynamics With Applications To Geophysics , 2016 .

[5]  Frederic Vitart,et al.  Monthly Forecasting at ECMWF , 2004 .

[6]  Soukayna Mouatadid,et al.  WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting , 2020, Journal of Advances in Modeling Earth Systems.

[7]  Prabhat,et al.  Exascale Deep Learning for Climate Analytics , 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis.

[8]  Matthias Nießner,et al.  Spherical CNNs on Unstructured Grids , 2019, ICLR.

[9]  Dharshi Devendran,et al.  Arbitrary-Order Conservative and Consistent Remapping and a Theory of Linear Maps: Part II , 2015 .

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Thomas Brox,et al.  Artistic Style Transfer for Videos and Spherical Images , 2017, International Journal of Computer Vision.

[12]  Min Sun,et al.  Cube Padding for Weakly-Supervised Saliency Prediction in 360° Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Wouter Boomsma,et al.  Spherical convolutions and their application in molecular modelling , 2017, NIPS.

[14]  Marco Aurélio Stelmar Netto,et al.  DeepDownscale: A Deep Learning Strategy for High-Resolution Weather Forecast , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[15]  Amy McGovern,et al.  Deep Learning for Spatially Explicit Prediction of Synoptic-Scale Fronts , 2019, Weather and Forecasting.

[16]  S. E. Haupt,et al.  Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather , 2017 .

[17]  Prabhat,et al.  Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets , 2016, ArXiv.

[18]  Andreas Geiger,et al.  SphereNet: Learning Spherical Representations for Detection and Classification in Omnidirectional Images , 2018, ECCV.

[19]  Sebastian Scher,et al.  Predicting weather forecast uncertainty with machine learning , 2018, Quarterly Journal of the Royal Meteorological Society.

[20]  Sebastian Scher,et al.  Toward Data‐Driven Weather and Climate Forecasting: Approximating a Simple General Circulation Model With Deep Learning , 2018, Geophysical Research Letters.

[21]  Peter Bauer,et al.  Challenges and design choices for global weather and climate models based on machine learning , 2018, Geoscientific Model Development.

[22]  Max Welling,et al.  Spherical CNNs , 2018, ICLR.

[23]  C. S. Bretherton,et al.  Single‐Column Emulation of Reanalysis of the Northeast Pacific Marine Boundary Layer , 2019, Geophysical Research Letters.

[24]  Jose A. Lozano,et al.  A data-driven approach to precipitation parameterizations using convolutional encoder-decoder neural networks , 2019, 1903.10274.

[25]  P. Paolucci,et al.  The “Cubed Sphere” , 1996 .

[26]  Jan-Michael Frahm,et al.  Mapped Convolutions , 2019, ArXiv.

[27]  Robert James Purser,et al.  A minor modification of the gnomonic cubed-shaped sphere grid that offers advantages in the context of implementing moving hurricane nests , 2017 .

[28]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[29]  Sebastian Scher,et al.  Supplementary material to "Weather and climate forecasting with neural networks: using GCMs with different complexity as study-ground" , 2019 .

[30]  Shian-Jiann Lin,et al.  A Two-Way Nested Global-Regional Dynamical Core on the Cubed-Sphere Grid , 2013 .

[31]  Stephan Rasp,et al.  Neural networks for post-processing ensemble weather forecasts , 2018, Monthly Weather Review.

[32]  Roberto Cipolla,et al.  Orientation-Aware Semantic Segmentation on Icosahedron Spheres , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[33]  Ashesh Chattopadhyay,et al.  Analog forecasting of extreme-causing weather patterns using deep learning , 2019, ArXiv.

[34]  Pierre Gentine,et al.  Deep learning to represent subgrid processes in climate models , 2018, Proceedings of the National Academy of Sciences.

[35]  Gregory R. Herman,et al.  Money Doesn't Grow on Trees, but Forecasts Do: Forecasting Extreme Precipitation with Random Forests , 2018 .

[36]  Kuk-Jin Yoon,et al.  SpherePHD: Applying CNNs on a Spherical PolyHeDron Representation of 360 degree Images , 2018, ArXiv.

[37]  Stephan Hoyer,et al.  xarray: N-D labeled arrays and datasets in Python , 2017 .

[38]  Rafael Monroy,et al.  SalNet360: Saliency Maps for omni-directional images with CNN , 2017, Signal Process. Image Commun..

[39]  Jonathan A. Weyn,et al.  Can Machines Learn to Predict Weather? Using Deep Learning to Predict Gridded 500‐hPa Geopotential Height From Historical Weather Data , 2019, Journal of Advances in Modeling Earth Systems.

[40]  Stephen J. Thomas,et al.  A Discontinuous Galerkin Transport Scheme on the Cubed Sphere , 2005 .