Multi-model ensembles in climate science: Mathematical structures and expert judgements.

Projections of future climate change cannot rely on a single model. It has become common to rely on multiple simulations generated by Multi-Model Ensembles (MMEs), especially to quantify the uncertainty about what would constitute an adequate model structure. But, as Parker points out (2018), one of the remaining philosophically interesting questions is: "How can ensemble studies be designed so that they probe uncertainty in desired ways?" This paper offers two interpretations of what General Circulation Models (GCMs) are and how MMEs made of GCMs should be designed. In the first interpretation, models are combinations of modules and parameterisations; an MME is obtained by "plugging and playing" with interchangeable modules and parameterisations. In the second interpretation, models are aggregations of expert judgements that result from a history of epistemic decisions made by scientists about the choice of representations; an MME is a sampling of expert judgements from modelling teams. We argue that, while the two interpretations involve distinct domains from philosophy of science and social epistemology, they both could be used in a complementary manner in order to explore ways of designing better MMEs.

[1]  Reto Knutti,et al.  Climate model genealogy: Generation CMIP5 and how we got there , 2013 .

[2]  Wendy S. Parker,et al.  Whose Probabilities? Predicting Climate Change with Ensembles of Models , 2010, Philosophy of Science.

[3]  S. Schroeder Using Democratic Values in Science: An Objection and (Partial) Response , 2017, Philosophy of Science.

[4]  J. Murphy,et al.  A methodology for probabilistic predictions of regional climate change from perturbed physics ensembles , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[5]  Matthew J. Brown Values in Science beyond Underdetermination and Inductive Risk , 2013, Philosophy of Science.

[6]  C. Tebaldi,et al.  Long-term Climate Change: Projections, Commitments and Irreversibility , 2013 .

[7]  Eric Winsberg,et al.  Holism, entrenchment, and the future of climate model pluralism , 2010 .

[8]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[9]  Kristen Intemann,et al.  Distinguishing between legitimate and illegitimate values in climate modeling , 2015, European Journal for Philosophy of Science.

[10]  Wendy S. Parker,et al.  Understanding Pluralism in Climate Modeling , 2006 .

[11]  Wendy S. Parker,et al.  When Climate Models Agree: The Significance of Robust Model Predictions* , 2011, Philosophy of Science.

[12]  Michael Goldstein,et al.  Climate Simulators and Climate Projections , 2014 .

[13]  Eric Winsberg Values and Uncertainties in the Predictions of Global Climate Models , 2012, Kennedy Institute of Ethics journal.

[14]  Reto Knutti,et al.  The end of model democracy? , 2010 .

[15]  Leonard A. Smith,et al.  The Myopia of Imperfect Climate Models: The Case of UKCP09 , 2013, Philosophy of Science.

[16]  Eric Winsberg Philosophy and Climate Science , 2018 .

[17]  M. Webb,et al.  Quantification of modelling uncertainties in a large ensemble of climate change simulations , 2004, Nature.

[18]  Wendy S. Parker,et al.  Ensemble modeling, uncertainty and robust predictions , 2013 .

[19]  Philip W. Jones,et al.  Overview of the Software Design of the Community Climate System Model , 2005, Int. J. High Perform. Comput. Appl..

[20]  Isaac M. Held,et al.  The Gap between Simulation and Understanding in Climate Modeling , 2005 .

[21]  Tim Palmer Global warming in a nonlinear climate - Can we be sure? , 2005 .

[22]  N. Meinshausen,et al.  Greenhouse-gas emission targets for limiting global warming to 2 °C , 2009, Nature.

[23]  Wendy S. Parker,et al.  Predicting weather and climate: Uncertainty, ensembles and probability , 2010 .

[24]  W. Wimsatt Re-Engineering Philosophy for Limited Beings: Piecewise Approximations to Reality , 2007 .

[25]  G. Meehl,et al.  Near-term climate change:projections and predictability , 2013 .

[26]  Robert Pincus,et al.  ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing , 2018, Earth System Dynamics.

[27]  W. Collins,et al.  Evaluation of climate models , 2013 .

[28]  Wendy S. Parker,et al.  The future of climate modeling , 2015, Climatic Change.

[29]  Patrick Jöckel,et al.  Atmospheric Chemistry and Physics Technical Note: the Modular Earth Submodel System (messy) – a New Approach towards Earth System Modeling , 2022 .

[30]  Reto Knutti,et al.  The use of the multi-model ensemble in probabilistic climate projections , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[31]  J. Annan,et al.  On the meaning of independence in climate science , 2016 .

[32]  Leonard A. Smith,et al.  An assessment of the foundational assumptions in high-resolution climate projections: the case of UKCP09 , 2015, Synthese.

[33]  C. Senior,et al.  Evaluating Climate Models with an African Lens , 2017 .

[34]  J. Räisänen,et al.  How reliable are climate models? , 2007 .

[35]  Eric Winsberg,et al.  Values and evidence: how models make a difference , 2018 .

[36]  Gregor Betz,et al.  Underdetermination, Model-ensembles and Surprises: On the Epistemology of Scenario-analysis in Climatology , 2009 .

[37]  Eugenia Kalnay,et al.  Rules for Interchange of Physical Parameterizations , 1989 .

[38]  Robert Sausen,et al.  Time-dependent greenhouse warming computations with a coupled ocean-atmosphere model , 1992 .

[39]  C. Werndl On Defining Climate and Climate Change , 2016, The British Journal for the Philosophy of Science.

[40]  Reto Knutti,et al.  Challenges in Combining Projections from Multiple Climate Models , 2010 .

[41]  Reto Knutti,et al.  A Representative Democracy to Reduce Interdependency in a Multimodel Ensemble , 2015 .

[42]  Jonathan Rougier,et al.  Probabilistic Inference for Future Climate Using an Ensemble of Climate Model Evaluations , 2007 .

[43]  D. Stone,et al.  Calibrating Climate Model Ensembles for Assessing Extremes in a Changing Climate , 2018, Journal of Geophysical Research: Atmospheres.

[44]  Reto Knutti,et al.  Addressing interdependency in a multimodel ensemble by interpolation of model properties , 2015 .

[45]  Henk A. Dijkstra,et al.  Assessing climate model projections: State of the art and philosophical reflections , 2012 .