The digital revolution of Earth-system science

Computational science is crucial for delivering reliable weather and climate predictions. However, despite decades of high-performance computing experience, there is serious concern about the sustainability of this application in the post-Moore/Dennard era. Here, we discuss the present limitations in the field and propose the design of a novel infrastructure that is scalable and more adaptable to future, yet unknown computing architectures. There have been substantial developments in weather and climate prediction over the past few decades, attributable to advances in computational science. The rise of new technologies poses challenges to these developments, but also brings opportunities for new progress in the field.

[1]  Torsten Hoefler,et al.  MODESTO: Data-centric Analytic Optimization of Complex Stencil Programs on Heterogeneous Architectures , 2015, ICS.

[2]  Pierre Gentine,et al.  Deep learning to represent subgrid processes in climate models , 2018, Proceedings of the National Academy of Sciences.

[3]  Torsten Hoefler,et al.  Reflecting on the Goal and Baseline for Exascale Computing: A Roadmap Based on Weather and Climate Simulations , 2019, Computing in Science & Engineering.

[4]  G. Flato Earth system models: an overview , 2011 .

[5]  George W. Platzman,et al.  The ENIAC Computations of 1950—Gateway to Numerical Weather Prediction , 1979 .

[6]  T. Palmer Short-term tests validate long-term estimates of climate change , 2020, Nature.

[7]  Giovanni Aloisio,et al.  CPMIP: measurements of real computational performance of Earth system models in CMIP6 , 2017 .

[8]  Noah D. Brenowitz,et al.  Prognostic Validation of a Neural Network Unified Physics Parameterization , 2018, Geophysical Research Letters.

[9]  Franck Cappello,et al.  Big data and extreme-scale computing , 2018, Int. J. High Perform. Comput. Appl..

[10]  Katherine Yelick,et al.  Exascale applications: skin in the game , 2020, Philosophical Transactions of the Royal Society A.

[11]  Peter D. Düben,et al.  Benchmark Tests for Numerical Weather Forecasts on Inexact Hardware , 2014 .

[12]  Yannick Trémolet,et al.  The Joint Effort for Data Assimilation Integration (JEDI) , 2018 .

[13]  Norman A. McFarlane,et al.  Parameterizations: representing key processes in climate models without resolving them , 2011 .

[14]  Jeong-Hwan Kim,et al.  Deep learning for multi-year ENSO forecasts , 2019, Nature.

[15]  Takemasa Miyoshi,et al.  Choosing the Optimal Numerical Precision for Data Assimilation in the Presence of Model Error , 2018, Journal of Advances in Modeling Earth Systems.

[16]  Giovanni Tumolo,et al.  A semi‐implicit, semi‐Lagrangian discontinuous Galerkin framework for adaptive numerical weather prediction , 2015 .

[17]  P. Bauer,et al.  A Baseline for Global Weather and Climate Simulations at 1 km Resolution , 2020, Journal of Advances in Modeling Earth Systems.

[18]  Terry Cojean,et al.  Evaluating the Performance of NVIDIA's A100 Ampere GPU for Sparse Linear Algebra Computations , 2020, ArXiv.

[19]  Torsten Hoefler,et al.  Stateful dataflow multigraphs: a data-centric model for performance portability on heterogeneous architectures , 2019, SC.

[20]  Peter Bauer,et al.  Atlas : A library for numerical weather prediction and climate modelling , 2017, Comput. Phys. Commun..

[21]  Patrick Laloyaux,et al.  Machine Learning for Model Error Inference and Correction , 2020 .

[22]  François P. Hamon,et al.  Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere , 2019, J. Comput. Phys..

[23]  Toshiyuki Imamura,et al.  The 10,240‐member ensemble Kalman filtering with an intermediate AGCM , 2014 .

[24]  P. K. Bondyopadhyay,et al.  Moore's law governs the silicon revolution , 1998, Proc. IEEE.

[25]  Prabhat,et al.  Exascale Deep Learning for Climate Analytics , 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis.

[26]  Tobias Gysi,et al.  STELLA: a domain-specific tool for structured grid methods in weather and climate models , 2015, SC15: International Conference for High Performance Computing, Networking, Storage and Analysis.

[27]  Andrew M. Bradley,et al.  HOMMEXX 1.0: a performance-portable atmospheric dynamical core for the Energy Exascale Earth System Model , 2019, Geoscientific Model Development.

[28]  Daniel Thiemert,et al.  The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale , 2019 .

[29]  Marc Bocquet,et al.  Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: A case study with the Lorenz 96 model , 2020, J. Comput. Sci..

[30]  Sascha M. Schnepp,et al.  Pipelined, Flexible Krylov Subspace Methods , 2015, SIAM J. Sci. Comput..

[31]  Paul Voosen,et al.  Europe is building a ‘digital twin’ of Earth to revolutionize climate forecasts , 2020 .

[32]  Sophie Valcke,et al.  Crossing the chasm: how to develop weather and climate models for next generation computers? , 2017 .

[33]  Tim N. Palmer,et al.  Ensemble forecasting , 2008, J. Comput. Phys..

[34]  Eric Blayo,et al.  Advanced Data Assimilation for Geosciences , 2014 .

[35]  Torsten Hoefler,et al.  Porting the COSMO Weather Model to Manycore CPUs , 2019, PASC.

[36]  Peter D. Düben,et al.  Single Precision in Weather Forecasting Models: An Evaluation with the IFS , 2017 .

[37]  Dmitry Kangin,et al.  A review of radar-based nowcasting of precipitation and applicable machine learning techniques , 2020, ArXiv.

[38]  Alejandro Duran,et al.  Ompss: a Proposal for Programming Heterogeneous Multi-Core Architectures , 2011, Parallel Process. Lett..

[39]  Cecelia DeLuca,et al.  The architecture of the Earth System Modeling Framework , 2003, Computing in Science & Engineering.

[40]  Colin J. Cotter,et al.  A mixed finite‐element, finite‐volume, semi‐implicit discretization for atmospheric dynamics: Cartesian geometry , 2019, Quarterly Journal of the Royal Meteorological Society.

[41]  Kevin Judd,et al.  Time Step Sensitivity of Nonlinear Atmospheric Models: Numerical Convergence, Truncation Error Growth, and Ensemble Design , 2007 .

[42]  Soukayna Mouatadid,et al.  WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting , 2020, Journal of Advances in Modeling Earth Systems.

[43]  Daniel Sunderland,et al.  Kokkos Array performance-portable manycore programming model , 2012, PMAM '12.

[44]  B. Stevens,et al.  The scientific challenge of understanding and estimating climate change , 2019, Proceedings of the National Academy of Sciences.

[45]  Luca Bonaventura,et al.  Review of numerical methods for nonhydrostatic weather prediction models , 2003 .

[46]  Marco Maggioni,et al.  Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarking , 2018, ArXiv.

[47]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[48]  Marc Bocquet,et al.  Advanced Data Assimilation for Geosciences: Lecture Notes of the Les Houches School of Physics: Special Issue, June 2012 , 2014 .

[49]  Francis X. Giraldo,et al.  Current and Emerging Time-Integration Strategies in Global Numerical Weather and Climate Prediction , 2019 .

[50]  Tim Palmer,et al.  Number Formats, Error Mitigation, and Scope for 16‐Bit Arithmetics in Weather and Climate Modeling Analyzed With a Shallow Water Model , 2020, Journal of advances in modeling earth systems.

[51]  Masaki Satoh,et al.  Nonhydrostatic icosahedral atmospheric model (NICAM) for global cloud resolving simulations , 2008, J. Comput. Phys..

[52]  D. Chalikov,et al.  New Approach to Calculation of Atmospheric Model Physics: Accurate and Fast Neural Network Emulation of Longwave Radiation in a Climate Model , 2005 .

[53]  Mark Horowitz,et al.  1.1 Computing's energy problem (and what we can do about it) , 2014, 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC).

[54]  Francis W. Zwiers,et al.  Edinburgh Research Explorer Understanding, modeling and predicting weather and climate extremes: Challenges and opportunities , 2022 .

[55]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[56]  G. Schmidt,et al.  Evaluating the Performance of Past Climate Model Projections , 2020, Geophysical Research Letters.

[57]  Sangram Ganguly,et al.  DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution , 2017, KDD.

[58]  Baudouin Raoult,et al.  A High-Performance Distributed Object-Store for Exascale Numerical Weather Prediction and Climate , 2019, PASC.

[59]  Mark D. Risser,et al.  Attributable Human‐Induced Changes in the Likelihood and Magnitude of the Observed Extreme Precipitation during Hurricane Harvey , 2017 .

[60]  Qunying Huang,et al.  Using spatial principles to optimize distributed computing for enabling the physical science discoveries , 2011, Proceedings of the National Academy of Sciences.

[61]  Torsten Hoefler,et al.  Domain-Specific Multi-Level IR Rewriting for GPU , 2020, ACM Trans. Archit. Code Optim..

[62]  Yuan Taur,et al.  Device scaling limits of Si MOSFETs and their application dependencies , 2001, Proc. IEEE.

[63]  Selime Gürol,et al.  Parallelization in the time dimension of four‐dimensional variational data assimilation , 2017 .

[64]  Torsten Hoefler,et al.  StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems , 2020, ArXiv.

[65]  Stephan Rasp,et al.  Neural networks for post-processing ensemble weather forecasts , 2018, Monthly Weather Review.

[66]  D. Siskind,et al.  Middle atmosphere dynamical sources of the semiannual oscillation in the thermosphere and ionosphere , 2017 .

[67]  David A. Hounshell,et al.  Science and research policy at the end of Moore’s law , 2018, Nature Electronics.

[68]  Torsten Hoefler,et al.  Deep learning for post-processing ensemble weather forecasts , 2021, Philosophical Transactions of the Royal Society A.

[69]  Frédéric Chevallier,et al.  Use of a neural‐network‐based long‐wave radiative‐transfer scheme in the ECMWF atmospheric model , 2000 .

[70]  J. Cook,et al.  Reply to Comment on ‘Quantifying the consensus on anthropogenic global warming in the scientific literature’ , 2013 .

[71]  Eike Hermann Müller,et al.  LFRic: Meeting the challenges of scalability and performance portability in Weather and Climate models , 2018, J. Parallel Distributed Comput..

[72]  Shian-Jiann Lin,et al.  DYAMOND: the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains , 2019, Progress in Earth and Planetary Science.

[73]  Peter Lynch,et al.  The origins of computer weather prediction and climate modeling , 2008, J. Comput. Phys..

[74]  D. Williamson The Evolution of Dynamical Cores for Global Atmospheric Models(125th Anniversary Issue of the Meteorological Society of Japan) , 2007 .

[75]  A. Lorenc,et al.  Collaboration of the Weather and Climate Communities to Advance Subseasonal-to-Seasonal Prediction , 2010 .

[76]  Steve M. Easterbrook,et al.  Engineering the Software for Understanding Climate Change , 2009, Computing in Science & Engineering.

[77]  Martin J. Gander,et al.  50 Years of Time Parallel Time Integration , 2015 .

[78]  G. D. Nastrom,et al.  Kinetic energy spectrum of large-and mesoscale atmospheric processes , 1984, Nature.

[79]  Peter Bauer,et al.  A digital twin of Earth for the green transition , 2021, Nature Climate Change.

[80]  M. Buehner,et al.  Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part I: Description and Single-Observation Experiments , 2010 .

[81]  David S. Richardson,et al.  ON THE ECONOMIC VALUE OF ENSEMBLE BASED WEATHER FORECASTS , 2001 .

[82]  Guangwen Yang,et al.  Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform , 2020 .

[83]  Joanna Szmelter,et al.  FVM 1.0: a nonhydrostatic finite-volume dynamical core for the IFS , 2019, Geoscientific Model Development.

[84]  Tom Henderson,et al.  Running the NIM Next-Generation Weather Model on GPUs , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[85]  Lawrence Buja,et al.  The computational future for climate and Earth system models: on the path to petaflop and beyond , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[86]  Patrick Scholz,et al.  Scalability and some optimization of the Finite-volumE Sea ice–Ocean Model, Version 2.0 (FESOM2) , 2019, Geoscientific Model Development.

[87]  Chao Yang,et al.  10M-Core Scalable Fully-Implicit Solver for Nonhydrostatic Atmospheric Dynamics , 2016, SC16: International Conference for High Performance Computing, Networking, Storage and Analysis.

[88]  Andrew Dawson,et al.  An approach to secure weather and climate models against hardware faults , 2017 .

[89]  Torsten Hoefler,et al.  SimFS: A Simulation Data Virtualizing File System Interface , 2019, 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[90]  Mats Hamrud,et al.  A Partitioned Global Address Space implementation of the European Centre for Medium Range Weather Forecasts Integrated Forecasting System , 2015, Int. J. High Perform. Comput. Appl..

[91]  Maya Gokhale,et al.  Milestone M1 Report: HBM2/3 Evaluation on Many-core CPU WBS 2.4, Milestone ECP-MT-1000 , 2018 .

[92]  Torsten Hoefler,et al.  Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 GPUs with COSMO 5.0 , 2017 .

[93]  Mark Parsons,et al.  Exploiting the Performance Benefits of Storage Class Memory for HPC and HPDA Workflows , 2018, Supercomput. Front. Innov..

[94]  Fei Tao,et al.  Make more digital twins , 2019, Nature.

[95]  John Shalf,et al.  Trends in Data Locality Abstractions for HPC Systems , 2017, IEEE Transactions on Parallel and Distributed Systems.

[96]  Venkatramani Balaji,et al.  Coarse-grained component concurrency in Earth system modeling: parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework , 2016 .