Documenting numerical experiments in support of the Coupled Model Intercomparison Project Phase 6 (CMIP6)

Abstract. Numerical simulation, and in particular simulation of the earth system, relies on contributions from diverse communities, from those who develop models to those involved in devising, executing, and analysing numerical experiments. Often these people work in different institutions and may be working with significant separation in time (particularly analysts, who may be working on data produced years earlier), and they typically communicate via published information (whether journal papers, technical notes, or websites). The complexity of the models, experiments, and methodologies, along with the diversity (and sometimes inexact nature) of information sources, can easily lead to misinterpretation of what was actually intended or done. In this paper we introduce a taxonomy of terms for more clearly defining numerical experiments, put it in the context of previous work on experimental ontologies, and describe how we have used it to document the experiments of the sixth phase for the Coupled Model Intercomparison Project (CMIP6). We describe how, through iteration with a range of CMIP6 stakeholders, we rationalized multiple sources of information and improved the clarity of experimental definitions. We demonstrate how this process has added value to CMIP6 itself by (a) helping those devising experiments to be clear about their goals and their implementation, (b) making it easier for those executing experiments to know what is intended, (c) exposing interrelationships between experiments, and (d) making it clearer for third parties (data users) to understand the CMIP6 experiments. We conclude with some lessons learnt and how these may be applied to future CMIP phases as well as other modelling campaigns.

[1]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[2]  Thomas Jung,et al.  The Polar Amplification Model Intercomparison Project (PAMIP) contribution to CMIP6: investigating the causes and consequences of polar amplification , 2018, Geoscientific Model Development.

[3]  Elisa Manzini,et al.  The Dynamics and Variability Model Intercomparison Project (DynVarMIP) for CMIP6: assessing the stratosphere–troposphere system , 2016 .

[4]  Marta Mattoso,et al.  Towards supporting the life cycle of large scale scientific experiments , 2010, Int. J. Bus. Process. Integr. Manag..

[5]  Brian C. O'Neill,et al.  The Scenario Model Intercomparison Project (ScenarioMIP) for CMIP6 , 2016 .

[6]  Paul Charbonneau,et al.  Solar Forcing for CMIP6 (v3.1) , 2016 .

[7]  Robert Pincus,et al.  The Radiative Forcing Model Intercomparison Project (RFMIP): Experimental Protocol for CMIP6 , 2016 .

[8]  Pierre Friedlingstein,et al.  C4MIP – The Coupled Climate–Carbon Cycle Model Intercomparison Project: Experimental protocol for CMIP6 , 2016 .

[9]  G. Meehl,et al.  Intercomparison makes for a better climate model , 1997 .

[10]  David P. Keller,et al.  The Carbon Dioxide Removal Model Intercomparison Project (CDRMIP): rationale and experimental protocol for CMIP6 , 2018 .

[11]  Christine L Borgman,et al.  Science friction: Data, metadata, and collaboration , 2011, Social studies of science.

[12]  J. Lamarque,et al.  AerChemMIP: quantifying the effects of chemistry and aerosols in CMIP6 , 2016 .

[13]  Chris Derksen,et al.  LS3MIP (v1.0) Contribution to CMIP6: The Land Surface, Snow and Soil Moisture Model Intercomparison Project Aims, Setup and Expected Outcome. , 2016 .

[14]  Shingo Watanabe,et al.  The Geoengineering Model Intercomparison Project Phase 6 (GeoMIP6): simulation design and preliminary results , 2015 .

[15]  Geoff Holmes,et al.  Experiment databases , 2012, Machine Learning.

[16]  Michel Rixen,et al.  The CMIP6 Data Request (DREQ, version 01.00.31) , 2020, Geoscientific Model Development.

[17]  Cecelia DeLuca,et al.  Describing Earth system simulations with the Metafor CIM , 2012 .

[18]  R. Sausen,et al.  Coupled ocean-atmosphere models with flux correction , 1988 .

[19]  A. Pier Siebesma,et al.  The Cloud Feedback Model Intercomparison Project (CFMIP) contribution to CMIP6. , 2016 .

[20]  Michel Rixen,et al.  WCRP COordinated Regional Downscaling EXperiment (CORDEX): A diagnostic MIP for CMIP6 , 2016 .

[21]  Sarah Callaghan,et al.  Documenting Climate Models and Their Simulations , 2013 .

[22]  Bo Wu,et al.  GMMIP (v1.0) contribution to CMIP6: Global Monsoons Model Inter-comparisonProject , 2016 .

[23]  R. Moss,et al.  Climate model intercomparisons: Preparing for the next phase , 2014 .

[24]  Michel Crucifix,et al.  The PMIP4 contribution to CMIP6 – Part 1: Overview and over-arching analysis plan , 2018 .

[25]  J. M. English,et al.  The Interactive Stratospheric Aerosol Model Intercomparison Project (ISA-MIP): motivation and experimental design , 2018, Geoscientific Model Development.

[26]  Jonathan M. Gregory,et al.  The Flux-Anomaly-Forced Model Intercomparison Project (FAFMIP) contribution to CMIP6: investigation of sea-level and ocean climate change in response to CO 2 forcing , 2016 .

[27]  Luís Torgo,et al.  OpenML: A Collaborative Science Platform , 2013, ECML/PKDD.

[28]  Marie-Pierre Moine,et al.  Development and exploitation of a controlled vocabulary in support of climate modelling , 2014 .

[29]  Jon Blower,et al.  A data model of the Climate and Forecast metadata conventions (CF-1.6) with a software implementation (cf-python v2.1) , 2017 .

[30]  François Massonnet,et al.  The CMIP6 Sea-Ice Model Intercomparison Project (SIMIP): understanding sea ice through climate-model simulations , 2016 .

[31]  Patrick Heimbach,et al.  OMIP contribution to CMIP6: experimental and diagnostic protocol for the physical component of the Ocean Model Intercomparison Project , 2016 .

[32]  Cyril Ray,et al.  Ontology-based Design of Experiments on Big Data Solutions , 2018, SEMANTICS Posters&Demos.

[33]  Marta Mattoso,et al.  A Foundational Ontology to Support Scientific Experiments , 2012, ONTOBRAS-MOST.

[34]  Eric Larour,et al.  Ice Sheet Model Intercomparison Project (ISMIP6) contribution to CMIP6. , 2016, Geoscientific model development.

[35]  Luca Cinquini,et al.  Requirements for a global data infrastructure in support of CMIP6 , 2018, Geoscientific Model Development.

[36]  Veronika Eyring,et al.  A Summary of the CMIP5 Experiment Design , 2010 .

[37]  W. N. Borst,et al.  Construction of Engineering Ontologies for Knowledge Sharing and Reuse , 1997 .

[38]  Michel Rixen,et al.  The Decadal Climate Prediction Project (DCPP) contribution to CMIP6 , 2016 .

[39]  Reto Knutti,et al.  The Detection and Attribution Model Intercomparison Project (DAMIP v1.0)contribution to CMIP6 , 2016 .

[40]  George C. Hurtt,et al.  The Land Use Model Intercomparison Project (LUMIP) contribution to CMIP6:rationale and experimental design , 2016 .

[41]  Z. X. Li,et al.  Interpretation of Cloud-Climate Feedback as Produced by 14 Atmospheric General Circulation Models , 1989, Science.

[42]  Jian Lu,et al.  High Resolution Model Intercomparison Project (HighResMIP v1.0) for CMIP6 , 2016 .

[43]  Ross D King,et al.  An ontology of scientific experiments , 2006, Journal of The Royal Society Interface.

[44]  Fiona Tummon,et al.  The Model Intercomparison Project on the climatic response to Volcanic forcing (VolMIP) : experimental design and forcing input data for CMIP6 , 2016 .

[45]  Keywan Riahi,et al.  The Vulnerability, Impacts, Adaptation and Climate Services Advisory Board (VIACS AB V1.0) Contribution to CMIP6 , 2016 .