How reliable are climate models?

How much can we trust model-based projections of future anthropogenic climate change? This review attempts to give an overview of this important but difficult topic by using three main lines of evidence: the skill of models in simulating present-day climate, intermodel agreement on future climate changes, and the ability of models to simulate climate changes that have already occurred. A comparison of simulated and observed present-day climates shows good agreement for many basic variables, particularly at large horizontal scales, and a tendency for biases to vary in sign between different models, but there is a risk that these features might be partly a result of tuning. Overall, the connection between model skill in simulating present-day climate and the skill in simulating future climate changes is poorly known. An intercomparison of future climate changes between models shows a better agreement for changes in temperature than that for precipitation and sea level pressure, but some aspects of change in the latter two variables are also quite consistent between models. A comparison of simulations with observed climate changes is, in principle, a good test for the models, but there are several complications. Nonetheless, models have skilfully simulated many large-scale aspects of observed climate changes, including but not limited to the evolution of the global mean surface air temperature in the 20th century. Furthermore, although there is no detailed agreement between the simulated and observed geographical patterns of change, the grid box scale temperature, precipitation and pressure changes observed during the past half-century generally fall within the range of model results. Considering the difficulties associated with other sources of information, the variation of climate changes between different models is probably the most meaningful measure of uncertainty that is presently available. In general, however, this measure is more likely to underestimate than overestimate the actual uncertainty.

[1]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[2]  André Berger,et al.  Long-Term Variations of Caloric Insolation Resulting from the Earth's Orbital Elements , 1978, Quaternary Research.

[3]  T. Wigley,et al.  Analytical solution for the effect of increasing CO2 on global mean temperature , 1985, Nature.

[4]  J. Hansen,et al.  Climate Response Times: Dependence on Climate Sensitivity and Ocean Mixing , 1985, Science.

[5]  John F. B. Mitchell,et al.  On Co2 climate sensitivity and model dependence of results , 1987 .

[6]  Syukuro Manabe,et al.  Large-Scale Changes of Soil Wetness Induced by an Increase in Atmospheric Carbon Dioxide , 1987 .

[7]  Michael E. Schlesinger,et al.  Detecting changes in global climate induced by greenhouse gases , 1987 .

[8]  R. Sausen,et al.  Coupled ocean-atmosphere models with flux correction , 1988 .

[9]  John F. B. Mitchell,et al.  Intercomparison and interpretation of climate feedback processes in 19 atmospheric general circulation models , 1990 .

[10]  Michael E. Schlesinger,et al.  Developing climate scenarios from equilibrium GCM results , 1990 .

[11]  R. Lindzen Some Coolness Concerning Global Warming , 1990 .

[12]  Syukuro Manabe,et al.  Equilib-rium climate change ? and its implications for the future , 1990 .

[13]  M. Maccracken,et al.  The Use of General Circulation Models to Predict Regional Climatic Change , 1991 .

[14]  Syukuro Manabe,et al.  Transient responses of a coupled ocean-atmosphere model to gradual changes of atmospheric CO2 , 1991 .

[15]  W. Gates AMIP: The Atmospheric Model Intercomparison Project. , 1992 .

[16]  Curt Covey,et al.  Deriving global climate sensitivity from palaeoclimate reconstructions , 1992, Nature.

[17]  The Atmospheric Model Intercomparison Project at the National Meteorological Center , 1993 .

[18]  D. Easterling,et al.  Variability and Trends of Total Precipitation and Snowfall over the United States and Canada , 1994 .

[19]  D. Hartmann Global Physical Climatology , 1994 .

[20]  G. Müller,et al.  The Scientific Basis , 1995 .

[21]  Hannu Savijärvi,et al.  Error Growth in a Large Numerical Forecast System , 1995 .

[22]  James J. Hack,et al.  Cloud feedback in atmospheric general circulation models: An update , 1996 .

[23]  M. England,et al.  Global comparison of the regional rainfall results of enhanced greenhouse coupled and mixed layer ocean experiments: Implications for climate change scenario development , 1996 .

[24]  G. Meehl,et al.  Intercomparsion of regional biases and doubled CO2-sensitivity of coupled atmosphere-ocean general circulation model experiments , 1997 .

[25]  J. Hansen,et al.  Radiative forcing and climate response , 1997 .

[26]  Atul K. Jain,et al.  An introduction to simple climate models used in the IPCC second assessment report , 1997 .

[27]  I. Watterson An analysis of the global water cycle of present and doubled CO2 climates simulated by the CSIRO general circulation model , 1998 .

[28]  Mike Hulme,et al.  Precipitation sensitivity to global warming: Comparison of observations with HadCM2 simulations , 1998 .

[29]  S. M. Marlais,et al.  An Overview of the Results of the Atmospheric Model Intercomparison Project (AMIP I) , 1999 .

[30]  Lennart Bengtsson,et al.  Transient Climate Change Simulations with a Coupled Atmosphere–Ocean GCM Including the Tropospheric Sulfur Cycle , 1999 .

[31]  J. Jouzel,et al.  Climate and atmospheric history of the past 420,000 years from the Vostok ice core, Antarctica , 1999, Nature.

[32]  John F. B. Mitchell,et al.  Towards the Construction of Climate Change Scenarios , 1999 .

[33]  T. Delworth,et al.  Simulation of early 20th century global warming , 2000, Science.

[34]  Raquel V. Francisco,et al.  Evaluating uncertainties in the prediction of regional climate change , 2000 .

[35]  John F. B. Mitchell,et al.  The time‐dependence of climate sensitivity , 2000 .

[36]  G. Meehl,et al.  The Coupled Model Intercomparison Project (CMIP) , 2000 .

[37]  Peter M. Cox,et al.  An analogue model to derive additional climate change scenarios from existing GCM simulations , 2000 .

[38]  John F. B. Mitchell,et al.  Quantifying the uncertainty in forecasts of anthropogenic climate change , 2000, Nature.

[39]  Analysis and Verification of Model Climate , 2000 .

[40]  Philip W. Mote,et al.  Numerical modeling of the global atmosphere in the climate system , 2000 .

[41]  P. Stott,et al.  External control of 20th century temperature by natural and anthropogenic forcings. , 2000, Science.

[42]  S. Levitus,et al.  Warming of the World Ocean , 2000 .

[43]  Sandy P. Harrison,et al.  How well can we simulate past climates? Evaluating the models using global palaeoenvironmental datasets , 2000 .

[44]  R. Betts,et al.  Acceleration of global warming due to carbon-cycle feedbacks in a coupled climate model , 2000, Nature.

[45]  Michael E. Schlesinger,et al.  Objective estimation of the probability density function for climate sensitivity , 2001 .

[46]  J. Räisänen CO2-Induced Climate Change in CMIP2 Experiments: Quantification of Agreement and Role of Internal Variability , 2001 .

[47]  W. Collins,et al.  The NCEP–NCAR 50-Year Reanalysis: Monthly Means CD-ROM and Documentation , 2001 .

[48]  Deliang Chen,et al.  Comparison of climate change scenarios for Sweden based on statistical and dynamical downscaling of monthly precipitation , 2001 .

[49]  R. Lindzen,et al.  Does The Earth Have an Adaptive Infrared Iris , 2013 .

[50]  T. Palmer,et al.  A Probability and Decision-Model Analysis of a Multimodel Ensemble of Climate Change Simulations , 2001 .

[51]  G. Boer,et al.  CMIP1 evaluation and intercomparison of coupled climate models , 2001 .

[52]  Raquel V. Francisco,et al.  Regional Climate Information—Evaluation and Projections , 2001 .

[53]  Thomas M. Smith,et al.  Global temperature change and its uncertainties since 1861 , 2001 .

[54]  C. Hewitt,et al.  The impact of dynamic sea-ice on the climatology and climate sensitivity of a GCM: a study of past, present, and future climates , 2001 .

[55]  J. Christensen,et al.  Evaluation of uncertainties in regional climate change simulations , 2001 .

[56]  J. Haywood,et al.  On summing the components of radiative forcing of climate change , 2001 .

[57]  M. Allen,et al.  Constraints on future changes in climate and the hydrologic cycle , 2002, Nature.

[58]  F. Giorgi,et al.  Calculation of average, uncertainty range, and reliability of regional climate changes from AOGCM simulations via the reliability ensemble averaging (REA) method , 2002 .

[59]  Joanna D. Haigh,et al.  Radiative forcing of climate change , 2002 .

[60]  R. Kaufmann,et al.  Simultaneously Constraining Climate Sensitivity and Aerosol Radiative Forcing. , 2002 .

[61]  A. Berger,et al.  Are Natural Climate Forcings Able to Counteract the Projected Anthropogenic Global Warming? , 2002 .

[62]  T. V. Ommen,et al.  Observed climate variability and change , 2002 .

[63]  Frank Lunkeit,et al.  Earth system models of intermediate complexity: closing the gap in the spectrum of climate system models , 2002 .

[64]  Andrei P. Sokolov,et al.  Quantifying Uncertainties in Climate System Properties with the Use of Recent Climate Observations , 2002, Science.

[65]  S. Raper,et al.  An Observationally Based Estimate of the Climate Sensitivity , 2002 .

[66]  P. Stott,et al.  Recent and future changes in Arctic sea ice simulated by the HadCM3 AOGCM , 2002 .

[67]  T. N. Palmer,et al.  Quantifying the risk of extreme seasonal precipitation events in a changing climate , 2002, Nature.

[68]  Christophe Soligo,et al.  Origins and estimates of uncertainty in predictions of twenty-first century temperature rise , 2002 .

[69]  R. Sausen,et al.  A comparison of climate response to different radiative forcings in three general circulation models: towards an improved metric of climate change , 2003 .

[70]  R. Stouffer,et al.  Twentieth‐century temperature and precipitation trends in ensemble climate simulations including natural and anthropogenic forcing , 2003 .

[71]  Climate sensitivity and climate state , 2003 .

[72]  Recent and future changes in Arctic sea ice simulated by the HadCM3 AOGCM (Invited Presentation) , 2003 .

[73]  F. Giorgi,et al.  Probability of regional climate change based on the Reliability Ensemble Averaging (REA) method , 2003 .

[74]  Timothy R. Carter,et al.  Future climate in world regions: an intercomparison of model-based projections for the new IPCC emissions scenarios , 2003 .

[75]  T. D. Mitchell,et al.  Pattern Scaling: An Examination of the Accuracy of the Technique for Describing Future Climates , 2003 .

[76]  Ole Einar Tveito,et al.  Temperature and precipitation scenarios for Norway: comparison of results from dynamical and empirical downscaling , 2003 .

[77]  R. Colman,et al.  A comparison of climate feedbacks in general circulation models , 2003 .

[78]  K. Taylor,et al.  An overview of results from the Coupled Model Intercomparison Project , 2003 .

[79]  David M. H. Sexton,et al.  Comparison of Modeled and Observed Trends in Indices of Daily Climate Extremes , 2003 .

[80]  Reto Knutti,et al.  Climate Forcing by Aerosols--a Hazy Picture , 2003, Science.

[81]  J. Janowiak,et al.  The Version 2 Global Precipitation Climatology Project (GPCP) Monthly Precipitation Analysis (1979-Present) , 2003 .

[82]  P. Cox,et al.  How positive is the feedback between climate change and the carbon cycle? , 2003 .

[83]  Song‐You Hong,et al.  Improvement of the K-profile Model for the Planetary Boundary Layer based on Large Eddy Simulation Data , 2003 .

[84]  Stephen E. Schwartz,et al.  Uncertainty Requirements in Radiative Forcing of Climate Change , 2004, Journal of the Air & Waste Management Association.

[85]  T. D. Mitchell,et al.  A comprehensive set of high-resolution grids of monthly climate for Europe and the globe: the observed record (1901-2000) and 16 scenarios (2001-2100). , 2004 .

[86]  G. Branstator,et al.  Tropical origins for recent and future Northern Hemisphere climate change , 2004 .

[87]  Robert Sausen,et al.  Identification of anthropogenic climate change using a second-generation reanalysis , 2004 .

[88]  David L. Williamson,et al.  Evaluating Parameterizations in General Circulation Models: Climate Simulation Meets Weather Prediction , 2004 .

[89]  J. Houghton,et al.  Global Warming: List of chemical symbols , 2004 .

[90]  S. Bony,et al.  On dynamic and thermodynamic components of cloud changes , 2004 .

[91]  U. Willén,et al.  European climate in the late twenty-first century: regional simulations with two driving global models and two forcing scenarios , 2004 .

[92]  P. Stott,et al.  Detection and attribution of changes in 20th century land precipitation , 2004 .

[93]  M. Webb,et al.  Quantification of modelling uncertainties in a large ensemble of climate change simulations , 2004, Nature.

[94]  L. Harvey Characterizing the annual-mean climatic effect of anthropogenic CO2 and aerosol emissions in eight coupled atmosphere-ocean GCMs , 2004 .

[95]  Francis W. Zwiers,et al.  Detection of volcanic influence on global precipitation , 2004 .

[96]  Aixue Hu,et al.  Factors Affecting Climate Sensitivity in Global Coupled Models , 2004 .

[97]  David J. Karoly,et al.  Diurnal temperature range as an index of global climate change during the twentieth century , 2004 .

[98]  V. Ramaswamy,et al.  The Radiative Signature of Upper Tropospheric Moistening , 2005, Science.

[99]  D. Easterling,et al.  Trends in Intense Precipitation in the Climate Record , 2005 .

[100]  D. Stone,et al.  Attribution studies of observed land precipitation changes with nine coupled models , 2005 .

[101]  J. Hansen,et al.  Efficacy of climate forcings , 2005 .

[102]  J. Gregory,et al.  The Climate Sensitivity and Its Components Diagnosed from Earth Radiation Budget Data , 2005 .

[103]  James D. Annan,et al.  Efficiently Constraining Climate Sensitivity with Ensembles of Paleoclimate Simulations , 2005 .

[104]  Ann Henderson-Sellers,et al.  A Climate Modelling Primer: McGuffie/A Climate Modelling Primer , 2005 .

[105]  Russell S. Vose,et al.  Maximum and minimum temperature trends for the globe: An update through 2004 , 2005 .

[106]  Meinrat O. Andreae,et al.  Strong present-day aerosol cooling implies a hot future , 2005, Nature.

[107]  Nathan P. Gillett,et al.  Detection of external influence on sea level pressure with a multi‐model ensemble , 2005 .

[108]  Myles R. Allen,et al.  Constraining climate forecasts: The role of prior assumptions , 2005 .

[109]  Leonard A. Smith,et al.  Uncertainty in predictions of the climate response to rising levels of greenhouse gases , 2005, Nature.

[110]  Renate Hagedorn,et al.  Representing model uncertainty in weather and climate prediction , 2005 .

[111]  J. Hansen,et al.  Earth's Energy Imbalance: Confirmation and Implications , 2005, Science.

[112]  T. Stocker,et al.  Stable Carbon Cycle–Climate Relationship During the Late Pleistocene , 2005, Science.

[113]  B. Santer,et al.  Penetration of Human-Induced Warming into the World's Oceans , 2005, Science.

[114]  R. T. Barnes,et al.  A performance comparison of coupled and uncoupled versions of the Met Office seasonal prediction general circulation model , 2005 .

[115]  Richard L. Smith,et al.  Quantifying Uncertainty in Projections of Regional Climate Change: A Bayesian Approach to the Analysis of Multimodel Ensembles , 2005 .

[116]  Kevin E. Trenberth,et al.  Trends and variability in column-integrated atmospheric water vapor , 2005 .

[117]  B. Santer,et al.  Effect of climate sensitivity on the Response to Volcanic Forcing , 2005 .

[118]  G. Meehl,et al.  The Importance of Land-Cover Change in Simulating Future Climates , 2005, Science.

[119]  R. Schnur,et al.  Climate-carbon cycle feedback analysis: Results from the C , 2006 .

[120]  John R. Christy,et al.  UNCERTAINTIES IN CLIMATE TRENDS Lessons from Upper-Air Temperature Records , 2005 .

[121]  Timothy P. Boyer,et al.  Warming of the world ocean, 1955–2003 , 2005 .

[122]  M. Allen,et al.  Constraints on climate change from a multi‐thousand member ensemble of simulations , 2005 .

[123]  Jeffrey H. Yin,et al.  A consistent poleward shift of the storm tracks in simulations of 21st century climate , 2005 .

[124]  P. Stott,et al.  Uncertainty in continental‐scale temperature predictions , 2006 .

[125]  Hermann Held,et al.  Climate sensitivity estimated from ensemble simulations of glacial climate , 2006 .

[126]  B. Santer,et al.  Anthropogenic and Natural Influences in the Evolution of Lower Stratospheric Cooling , 2006, Science.

[127]  Myles R. Allen,et al.  Observational Constraints on Past Attributable Warming and Predictions of Future Global Warming , 2006 .

[128]  C. Tebaldi,et al.  Two Approaches to Quantifying Uncertainty in Global Temperature Changes , 2006 .

[129]  Upmanu Lall,et al.  Probabilistic multimodel regional temperature change projections , 2006 .

[130]  H. Su,et al.  Tropical drying trends in global warming models and observations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[131]  R. Allan,et al.  A new globally complete monthly historical gridded mean sea level pressure dataset (HadSLP2): 1850-2004 , 2006 .

[132]  R. Stouffer,et al.  Assessment of Twentieth-Century Regional Surface Temperature Trends using the GFDL CM2 Coupled Models , 2006 .

[133]  I. Musat,et al.  On the contribution of local feedback mechanisms to the range of climate sensitivity in two GCM ensembles , 2006 .

[134]  J. Walsh,et al.  Toward a Seasonally Ice-Covered Arctic Ocean: Scenarios from the IPCC AR4 Model Simulations , 2006 .

[135]  G. Hegerl,et al.  Climate sensitivity constrained by temperature reconstructions over the past seven centuries , 2006, Nature.

[136]  Andrei P. Sokolov,et al.  Joint Program on the Science and Policy of Global Change Estimated PDFs of Climate System Properties Including Natural and Anthropogenic Forcings , 2005 .

[137]  B. Soden,et al.  An Assessment of Climate Feedbacks in Coupled Ocean–Atmosphere Models , 2006 .

[138]  J. Annan,et al.  Using multiple observationally‐based constraints to estimate climate sensitivity , 2006 .

[139]  David P. Rowell,et al.  Causes and uncertainty of future summer drying over Europe , 2006 .

[140]  G. Meehl,et al.  Constraining Climate Sensitivity from the Seasonal Cycle in Surface Temperature , 2006 .

[141]  G. Meehl,et al.  Intergovernmental Panel on Climate Change. 2007. Climate Change 2007: The Physical Science Basis, edited by , 2022 .

[142]  Matthew D. Collins,et al.  Frequency distributions of transient regional climate change from perturbed physics ensembles of general circulation model simulations , 2006 .

[143]  T. Barnett,et al.  Anthropogenic Warming of the Oceans: Observations and Model Results , 2006 .

[144]  Deliang Chen,et al.  Projections of Future Anthropogenic Climate Change , 2008 .