Climate Models: How to Assess Their Reliability

ABSTRACT The paper discusses modelling uncertainties in climate models and how they can be addressed based on physical principles as well as based on how the models perform in light of empirical data. We argue that the reliability of climate models can be judged by three kinds of standards: striking confirmation, supplementing independent causal arguments, and judging the causal core of models by establishing model robustness. We also use model robustness for delimiting confirmational holism. We survey recent results of climate modelling and identify salient results that fulfil each of the three standards. Our conclusion is that climate models can be considered reliable for some qualitative gross features and some long-term tendencies of the climate system as well as for quantitative aspects of some smaller-scale mechanisms. The adequacy of climate models for other purposes is less convincing. Among the latter are probability estimates, in particular, those concerning rare events. On the whole, climate models suffer from important deficits and are difficult to verify, but are still better confirmed and more reliable than parts of the methodological literature suggest.

[1]  Eran Tal,et al.  Old and New Problems in Philosophy of Measurement , 2013 .

[2]  Martin L. Weitzman,et al.  Fat-Tailed Uncertainty in the Economics of Catastrophic Climate Change , 2011, Review of Environmental Economics and Policy.

[3]  M. Latif,et al.  The Arctic Sea ice in the CMIP3 climate model ensemble – variability and anthropogenic change , 2012 .

[4]  Jane Qiu,et al.  Antarctica’s sleeping ice giant could wake soon , 2017, Nature.

[5]  Steven C. Sherwood,et al.  A practical philosophy of complex climate modelling , 2015 .

[6]  P. N. Edwards GLOBAL CLIMATE SCIENCE, UNCERTAINTY AND POLITICS: DATA-LADEN MODELS, MODEL-FILTERED DATA , 1999 .

[7]  Elisabeth A. Lloyd,et al.  Confirmation and Robustness of Climate Models , 2010, Philosophy of Science.

[8]  Yen-Ting Hwang,et al.  Link between the double-Intertropical Convergence Zone problem and cloud biases over the Southern Ocean , 2013, Proceedings of the National Academy of Sciences.

[9]  Jk Joel Katzav,et al.  Severe testing of climate change hypotheses , 2013 .

[10]  Kent W. Staley Robust Evidence and Secure Evidence Claims* , 2004, Philosophy of Science.

[11]  Elisabeth A Lloyd,et al.  Model robustness as a confirmatory virtue: The case of climate science. , 2015, Studies in history and philosophy of science.

[12]  Reto Knutti,et al.  The end of model democracy? , 2010 .

[13]  D. Klocke,et al.  Tuning the climate of a global model , 2012 .

[14]  Johannes Lenhard,et al.  Computer Simulation: The Cooperation between Experimenting and Modeling* , 2007, Philosophy of Science.

[15]  Wendy S. Parker,et al.  When Climate Models Agree: The Significance of Robust Model Predictions* , 2011, Philosophy of Science.

[16]  Daniel F. Belknap,et al.  Rapid sea-level rise in the Gulf of Maine, USA, since AD 1800 , 2002 .

[17]  S. Bony,et al.  On the interpretation of inter-model spread in CMIP5 climate sensitivity estimates , 2013, Climate Dynamics.

[18]  Reto Knutti,et al.  Should we believe model predictions of future climate change? , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[19]  Roman Frigg,et al.  Philosophy of Climate Science Part II: Modelling Climate Change , 2015 .

[20]  Hauke Schmidt,et al.  Solar irradiance reduction via climate engineering: Impact of different techniques on the energy balance and the hydrological cycle , 2013 .

[21]  Kazuya Kusahara Cryosphere: Warming ocean erodes ice sheets , 2016 .

[22]  Charlotte Werndl,et al.  Climate Models, Calibration, and Confirmation , 2013, The British Journal for the Philosophy of Science.

[23]  E. Zahar Why did Einstein's Programme supersede Lorentz's? (II) , 1973, The British Journal for the Philosophy of Science.

[24]  Eve McDonald-Madden,et al.  Detecting failure of climate predictions , 2016 .

[25]  Leonard A. Smith,et al.  The Myopia of Imperfect Climate Models: The Case of UKCP09 , 2013, Philosophy of Science.

[26]  Reto Knutti,et al.  The end of model democracy ? An editorial comment , 2010 .

[27]  Byron A. Steinman,et al.  Influence of Anthropogenic Climate Change on Planetary Wave Resonance and Extreme Weather Events , 2017, Scientific Reports.

[28]  Christoph C. Raible,et al.  Medieval climate anomaly to little ice age transition as simulated by current climate models , 2011 .

[29]  Andrew S. Jones,et al.  Asymmetric forcing from stratospheric aerosols impacts Sahelian rainfall , 2013 .

[30]  Martin Carrier,et al.  Introduction: Mathematics as a Tool , 2017 .

[31]  Kevin Cowtan,et al.  Assessing recent warming using instrumentally homogeneous sea surface temperature records , 2017, Science Advances.

[32]  Gw Paltridge The Climate Caper: Facts and Fallacies of Global Warming , 2009 .

[33]  Steven E. Koonin,et al.  Climate science is not settled , 2014 .

[34]  Johannes Lenhard,et al.  Holism, or the Erosion of Modularity: A Methodological Challenge for Validation , 2018, Philosophy of Science.

[35]  W. Parker II—Wendy S. Parker: Confirmation and adequacy-for-Purpose in Climate Modelling , 2009 .

[36]  Henk A. Dijkstra,et al.  Assessing climate model projections: State of the art and philosophical reflections , 2012 .

[37]  Cr Sridhar The signal and the noise , 2016 .

[38]  W. Parker,et al.  Values and uncertainties in climate prediction, revisited. , 2014, Studies in history and philosophy of science.

[39]  P. Stott,et al.  Human contribution to the European heatwave of 2003 , 2004, Nature.

[40]  Ken Caldeira,et al.  Ecosystem Impacts of Geoengineering: A Review for Developing a Science Plan , 2011, AMBIO.

[41]  Reto Knutti,et al.  Reconciling controversies about the ‘global warming hiatus’ , 2017, Nature.

[42]  Hans Hasse,et al.  Boon and Bane: On the Role of Adjustable Parameters in Simulation Models , 2017 .

[43]  Cailin O'Connor,et al.  Simulation and Similarity: Using Models to Understand the World , 2016 .

[44]  Jk Joel Katzav,et al.  Hybrid Models, Climate Models, and Inference to the Best Explanation , 2013, The British Journal for the Philosophy of Science.

[45]  I. Lakatos,et al.  Criticism and the Growth of Knowledge: Falsification and the Methodology of Scientific Research Programmes , 1970 .

[46]  Stephen M. Griffies,et al.  Localized rapid warming of West Antarctic subsurface waters by remote winds , 2017 .

[47]  Gabriele Gramelsberger What do numerical (climate) models really represent , 2011 .

[48]  Gertrude Hirsch Hadorn,et al.  Building confidence in climate model projections: an analysis of inferences from fit , 2017 .

[49]  Mathias Frisch,et al.  Predictivism and old evidence: a critical look at climate model tuning , 2015 .

[50]  S. Seneviratne,et al.  Allowable CO2 emissions based on regional and impact-related climate targets , 2016, Nature.

[51]  D A Stainforth,et al.  Confidence, uncertainty and decision-support relevance in climate predictions , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[52]  A. P. Siebesma,et al.  Climate goals and computing the future of clouds , 2017 .

[53]  I. Lakatos Falsification and the Methodology of Scientific Research Programmes , 1976 .

[54]  Reto Knutti,et al.  Challenges in Combining Projections from Multiple Climate Models , 2010 .

[55]  Ajay Kalra,et al.  Estimating annual precipitation for the Colorado River Basin using oceanic‐atmospheric oscillations , 2012 .

[56]  S. Vavrus,et al.  Evidence for a wavier jet stream in response to rapid Arctic warming , 2015 .

[57]  John Worrall,et al.  The Ways in which the Methodology of Scientific Research Programmes Improves on Popper’s Methodology , 1978 .

[58]  Eric Winsberg,et al.  Holism, entrenchment, and the future of climate model pluralism , 2010 .

[59]  Eric Winsberg,et al.  Simulated Experiments: Methodology for a Virtual World , 2003, Philosophy of Science.

[60]  Jk Joel Katzav,et al.  The epistemology of climate models and some of its implications for climate science and the philosophy of science , 2014 .

[61]  Leonard A. Smith,et al.  Uncertainty in predictions of the climate response to rising levels of greenhouse gases , 2005, Nature.

[62]  Pierre Friedlingstein,et al.  Carbon Dioxide and Climate: Perspectives on a Scientific Assessment , 2013 .

[63]  François Massonnet,et al.  The CMIP6 Sea-Ice Model Intercomparison Project (SIMIP): understanding sea ice through climate-model simulations , 2016 .

[64]  Johannes Quaas,et al.  Climate extremes in multi-model simulations of stratospheric aerosol and marine cloud brightening climate engineering , 2014 .

[65]  Stefan Rahmstorf,et al.  Global temperature evolution: recent trends and some pitfalls , 2017 .

[66]  Wn Wybo Houkes,et al.  Robust! Handle with Care , 2012, Philosophy of Science.