Open weather and climate science in the digital era

Abstract. The need for open science has been recognized by the communities of meteorology and climate science. However, while these domains are mature in terms of applying digital technologies, these are lagging behind where the implementation of open science methodologies is concerned. In a session on Weather and Climate Science in the Digital Era at the 14th IEEE International eScience conference domain specialists and data and computer scientists discussed the road towards open weather and climate science. The studies presented in the conference session showed the added value of shared data, software and platforms through, for instance, combining data sets from disparate sources, increased accuracy and skill of simulations and forecasts at local scales, and improved consistency of data products. We observed that sharing data and code is important, but not sufficient to achieve open weather and climate science and that here are important issues to address. At the level of technology, the implementation of the FAIR principles to many datasets used in weather and climate science remains a challenge due to their origin, scalability, or legal barriers. Furthermore, the complexity of current software platforms limits collaboration between researchers and optimal use of open science tools and methods. The main challenges we observed, however, were non-technical and impact the system of science as a whole. There is a need for new roles and responsibilities at the interface of science and digital technology, e.g., data stewards and research software engineers. This requires the personnel portfolio of academic institutions to be more diverse, and in addition, a broader consideration of the impact of academic work, beyond publishing and teaching. Besides, new policies regarding open weather and climate science should be developed in an inclusive way to engage all stakeholders, including non-academic parties such as meteorological institutions. We acknowledge that open weather and climate science requires effort to change, but the benefits are large. As can already be observed from the studies presented in the conference it leads to much faster progress in understanding the world.

[1]  Stéphane Marchand-Maillet,et al.  Extracting Flood Maps from Social Media for Assimilation , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[2]  Peter Bauer,et al.  Challenges and design choices for global weather and climate models based on machine learning , 2018, Geoscientific Model Development.

[3]  Andrew Stuart,et al.  Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High‐Resolution Simulations , 2017, 1709.00037.

[4]  W. Collins,et al.  The Community Earth System Model: A Framework for Collaborative Research , 2013 .

[5]  Driss Bari,et al.  Visibility Prediction Based on Kilometric NWP Model Outputs Using Machine-Learning Regression , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[6]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[7]  Klaus Zimmermann,et al.  Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview , 2020, Geoscientific Model Development.

[8]  Peter Lynch,et al.  The origins of computer weather prediction and climate modeling , 2008, J. Comput. Phys..

[9]  Niels Drost,et al.  eWaterCycle II , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[10]  Lior Shamir,et al.  Practices in source code sharing in astrophysics , 2013, Astron. Comput..

[11]  J. Neumann,et al.  Numerical Integration of the Barotropic Vorticity Equation , 1950 .

[12]  Brian A. Nosek,et al.  How open science helps researchers succeed , 2016, eLife.

[13]  Steve M. Easterbrook,et al.  Engineering the Software for Understanding Climate Change , 2009, Computing in Science & Engineering.

[14]  F. Inti Pelupessy,et al.  Development of the OMUSE/AMUSE Modeling System , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[15]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[16]  Orit Hazzan,et al.  The Agile Manifesto , 2014 .

[17]  Irene Garcia Martí,et al.  Detecting Probability of Ice Formation on Overhead Lines of the Dutch Railway Network , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[18]  Valerio Lucarini,et al.  Advancing Research for Seamless Earth System Prediction , 2020, Bulletin of the American Meteorological Society.

[19]  Richard Hill,et al.  A Hybrid-Resolution Earth System Model , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[20]  Stefano Alessandrini,et al.  Machine Learning for Applied Weather Prediction , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[21]  Rob van Nieuwpoort,et al.  Poster Abstracts eScience 2018 Conference , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[22]  Luiz Olavo Bonino da Silva Santos,et al.  Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud , 2017, Inf. Serv. Use.

[23]  Jamie Kettleborough,et al.  Implementation of U.K. Earth System Models for CMIP6 , 2020, Journal of Advances in Modeling Earth Systems.

[24]  Jack J. Dongarra,et al.  Exascale computing and big data , 2015, Commun. ACM.

[25]  Benedikt Fecher,et al.  Open Science: One Term, Five Schools of Thought , 2013 .

[26]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[27]  Stephan Hoyer,et al.  xarray: N-D labeled arrays and datasets in Python , 2017 .

[28]  Alain Chedin,et al.  A Neural Network Approach for a Fast and Accurate Computation of a Longwave Radiative Budget , 1998 .

[29]  Erik Schultes,et al.  The FAIR Guiding Principles for scientific data management and stewardship , 2016, Scientific Data.

[30]  Rob Simmonds,et al.  The African Data Intensive Research Cloud , 2016, 2016 IST-Africa Week Conference.

[31]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[32]  Reynold Xin,et al.  Apache Spark , 2016 .

[33]  Mohan Ramamurthy.  Toward a Cloud Ecosystem for Modeling as a Service , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[34]  A. J. Hewitt,et al.  UKESM1: Description and Evaluation of the U.K. Earth System Model , 2019, Journal of Advances in Modeling Earth Systems.

[35]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[36]  Suzanne A. Pierce,et al.  Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance , 2016 .

[37]  Björn Hagemeier,et al.  A Web Service Architecture for Objective Station Classification Purposes , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[38]  Christine L. Borgman,et al.  The conundrum of sharing research data , 2012, J. Assoc. Inf. Sci. Technol..

[39]  Gijs Van Den Oord,et al.  Post-Processing Strategies for the ECMWF Model , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[40]  Philipp Neumann,et al.  Increasing Parallelism in Climate Models Via Additional Component Concurrency , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[41]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[42]  John P. A. Ioannidis,et al.  A manifesto for reproducible science , 2017, Nature Human Behaviour.

[43]  Dietmar Pfahl,et al.  What Do We Know about Scientific Software Development's Agile Practices? , 2012, Computing in Science & Engineering.

[44]  B Marshall,et al.  Gene Ontology Consortium: The Gene Ontology (GO) database and informatics resource , 2004, Nucleic Acids Res..

[45]  Gijs van den Oord,et al.  Resolving Clouds in a Global Atmosphere Model - A Multiscale Approach with Nested Models , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[46]  Hui Yang,et al.  Machine learning and artificial intelligence to aid climate change research and preparedness , 2019, Environmental Research Letters.

[47]  Stephen G. Penny,et al.  Coupled Data Assimilation for Integrated Earth System Analysis and Prediction: Goals, Challenges, and Recommendations , 2017 .

[48]  Ronald van Haren,et al.  Weather Reanalysis on an Urban Scale using WRF , 2018, 2018 IEEE 14th International Conference on e-Science (e-Science).

[49]  David R. Maidment,et al.  The Open Geospatial Consortium and EarthCube, An EarthCube Technology Paper , 2011 .

[50]  Karl E. Taylor,et al.  An overview of CMIP5 and the experiment design , 2012 .