Evaluation of biospheric components in Earth system models using modern and palaeo observations: the state-of-the-art

Earth system models (ESMs) are increasing in complexity by incorporating more processes than their pre- decessors, making them potentially important tools for studying the evolution of climate and associated biogeo- chemical cycles. However, their coupled behaviour has only recently been examined in any detail, and has yielded a very wide range of outcomes. For example, coupled climate- carbon cycle models that represent land-use change simu- late total land carbon stores at 2100 that vary by as much as 600 Pg C, given the same emissions scenario. This large uncertainty is associated with differences in how key pro- cesses are simulated in different models, and illustrates the necessity of determining which models are most realistic us- ing rigorous methods of model evaluation. Here we assess the state-of-the-art in evaluation of ESMs, with a particular emphasis on the simulation of the carbon cycle and associ- ated biospheric processes. We examine some of the new ad- vances and remaining uncertainties relating to (i) modern and palaeodata and (ii) metrics for evaluation. We note that the practice of averaging results from many models is unreliable

[1]  K. Findell,et al.  Neural Network-Based Sensitivity Analysis of Summertime Convection over the Continental United States , 2014 .

[2]  I. Prentice,et al.  Climate model benchmarking with glacial and mid-Holocene climates , 2014, Climate Dynamics.

[3]  N. Gruber,et al.  Long-term trends in ocean plankton production and particle export between 1960–2006 , 2013 .

[4]  Christoph Heinze,et al.  Multiple stressors of ocean ecosystems in the 21st century: projections with CMIP5 models , 2013 .

[5]  P. Cox,et al.  Evaluating the Land and Ocean Components of the Global Carbon Cycle in the CMIP5 Earth System Models , 2013 .

[6]  A. Ganopolski,et al.  Asymmetry and uncertainties in biogeophysical climate–vegetation feedback over a range of CO 2 forcings , 2013 .

[7]  Pierre Friedlingstein,et al.  Twenty-First-Century Compatible CO2 Emissions and Airborne Fraction Simulated by CMIP5 Earth System Models under Four Representative Concentration Pathways , 2013, Journal of Climate.

[8]  Sönke Zaehle,et al.  Towards a more objective evaluation of modelled land-carbon trends using atmospheric CO 2 and satellite-based vegetation activity observations , 2013 .

[9]  Atul K. Jain,et al.  Forest water use and water use efficiency at elevated CO2: a model‐data intercomparison at two contrasting temperate forest FACE sites , 2013, Global change biology.

[10]  J. Kaplan,et al.  A model for global biomass burning in preindustrial time: LPJ-LMfire (v1.0) , 2013 .

[11]  S. Harrison,et al.  Consistent large‐scale temperature responses in warm and cold climates , 2013 .

[12]  Shaun A Marcott,et al.  A Reconstruction of Regional and Global Temperature for the Past 11,300 Years , 2013, Science.

[13]  J. Jouzel,et al.  Synchronous Change of Atmospheric CO2 and Antarctic Temperature During the Last Deglacial Warming , 2013, Science.

[14]  R. Fealy,et al.  Model skill measures in probabilistic regional climate projections for Ireland , 2013 .

[15]  P. Cox,et al.  Sensitivity of tropical carbon to climate change constrained by carbon dioxide variability , 2013, Nature.

[16]  Wolfgang Lucht,et al.  Contribution of permafrost soils to the global carbon budget , 2013 .

[17]  Alexander Loew,et al.  Robust identification of global greening phase patterns from remote sensing vegetation products , 2012 .

[18]  S. Zaehle,et al.  Constraints from atmospheric CO 2 and satellite-based vegetation activity observations on current land carbon cycle trends , 2012 .

[19]  Michael Goldstein,et al.  Fast linked analyses for scenario‐based hierarchies , 2012 .

[20]  Marc Simard,et al.  A comprehensive benchmarking system for evaluating global vegetation models , 2012 .

[21]  Lisa M. Kennedy,et al.  Predictability of biomass burning in response to climate changes , 2012 .

[22]  M. Väliranta,et al.  Climate-related changes in peatland carbon accumulation during the last millennium , 2012 .

[23]  L. Bopp,et al.  Marine productivity response to Heinrich events: a model-data comparison , 2012 .

[24]  Philippe Ciais,et al.  A framework for benchmarking land models , 2012 .

[25]  A. Oschlies,et al.  Enhanced carbon overconsumption in response to increasing temperatures during a mesocosm experiment , 2012 .

[26]  Kevin I. C. Oliver,et al.  Controls on the spatial distribution of oceanic δ 13 C DIC , 2012 .

[27]  J Sardans,et al.  Urgent need for a common metric to make precipitation manipulation experiments comparable. , 2012, The New phytologist.

[28]  Dieter Gerten,et al.  A model-based constraint on CO 2 fertilisation , 2012 .

[29]  S. Rasmussen,et al.  Tightened constraints on the time-lag between Antarctic temperature and CO 2 during the last deglaciation , 2012 .

[30]  Yan Zhao,et al.  Evaluation of climate models using palaeoclimatic data , 2012 .

[31]  R. Betts,et al.  High sensitivity of future global warming to land carbon cycle processes , 2012 .

[32]  P. Cox,et al.  Quantifying future climate change , 2012 .

[33]  K. Oleson,et al.  Reconciling leaf physiological traits and canopy flux data: Use of the TRY and FLUXNET databases in the Community Land Model version 4 , 2012 .

[34]  S. Levis,et al.  Evaluation of the New CNDV Option of the Community Land Model: Effects of Dynamic Vegetation and Interactive Nitrogen on CLM4 Means and Variability* , 2012 .

[35]  Forrest M Hoffman,et al.  Photoperiodic regulation of the seasonal pattern of photosynthetic capacity and the implications for carbon cycling , 2012, Proceedings of the National Academy of Sciences.

[36]  P. Clark,et al.  Global warming preceded by increasing carbon dioxide concentrations during the last deglaciation , 2012, Nature.

[37]  Leonard A. Smith,et al.  Broad range of 2050 warming from an observationally constrained large climate model ensemble , 2012 .

[38]  D. Lawrence,et al.  Simulation of Present-Day and Future Permafrost and Seasonally Frozen Ground Conditions in CCSM4 , 2012 .

[39]  A. Henderson‐sellers,et al.  The future of the world's climate , 2012 .

[40]  G. Henderson,et al.  A synthesis of marine sediment core ¡ sup ¿ 13 ¡ / sup ¿ C data over the last 150 000 years , 2012 .

[41]  S. Harrison,et al.  Records from the Past, Lessons for the Future: What the Palaeorecord Implies about Mechanisms of Global Change , 2012 .

[42]  C. Jones,et al.  Development and evaluation of an Earth-System model - HadGEM2 , 2011 .

[43]  Donald R. Zak,et al.  Ecological Lessons from Free-Air CO2 Enrichment (FACE) Experiments , 2011 .

[44]  O. Boucher,et al.  Aerosol forcing in the Climate Model Intercomparison Project (CMIP5) simulations by HadGEM2‐ES and the role of ammonium nitrate , 2011 .

[45]  Tim R. McVicar,et al.  Global evaluation of four AVHRR-NDVI data sets: Intercomparison and assessment against Landsat imagery , 2011 .

[46]  V. Radic,et al.  Evaluation of IPCC Models' Performance in Simulating Late-Twentieth-Century Climatologies and Weather Patterns over North America , 2011 .

[47]  K. Larsen,et al.  Integrating empirical studies and global models to improve climate change predictions , 2011 .

[48]  J. Rougier,et al.  Precalibrating an intermediate complexity climate model , 2018 .

[49]  P. Friedlingstein,et al.  Modeling fire and the terrestrial carbon balance , 2011 .

[50]  A. Arneth,et al.  Global patterns of land-atmosphere fluxes of carbon dioxide, latent heat, and sensible heat derived from eddy covariance, satellite, and meteorological observations , 2011 .

[51]  R. S. Thompson,et al.  Pollen-based continental climate reconstructions at 6 and 21 ka: a global synthesis , 2011 .

[52]  Filipe Aires,et al.  A Land and Ocean Microwave Cloud Classification Algorithm Derived from AMSU-A and -B, Trained Using MSG-SEVIRI Infrared and Visible Observations , 2011 .

[53]  Aurel F. Moise,et al.  New climate model metrics based on object‐orientated pattern matching of rainfall , 2011 .

[54]  R. Knutti,et al.  Analyzing precipitation projections: A comparison of different approaches to climate model evaluation , 2011 .

[55]  I. Prentice,et al.  Global vegetation and terrestrial carbon cycle changes after the last ice age. , 2011, The New phytologist.

[56]  Caspar M. Ammann,et al.  Climate forcing reconstructions for use in PMIP simulations of the last millennium (v1.0) , 2011 .

[57]  Filipe Aires,et al.  An Innovative Calibration Method for the Inversion of Satellite Observations , 2010 .

[58]  S. Los,et al.  A comprehensive set of benchmark tests for a land surface model of simultaneous fluxes of water and carbon at both the global and seasonal scale , 2010 .

[59]  C. Peng,et al.  Toward dynamic global vegetation models for simulating vegetation–climate interactions and feedbacks: recent developments, limitations, and future challenges , 2010 .

[60]  S. Harrison,et al.  Global patterns of vegetation response to millennial-scale variability and rapid climate change during the last glacial period , 2010 .

[61]  Clemens Beckstein,et al.  Characterization of ecosystem responses to climatic controls using artificial neural networks , 2010 .

[62]  Timothy M. Lenton,et al.  A probabilistic calibration of climate sensitivity and terrestrial carbon change in GENIE-1 , 2010 .

[63]  J. Loisel,et al.  Global peatland dynamics since the Last Glacial Maximum , 2010 .

[64]  Sandy P. Harrison,et al.  The influence of vegetation, fire spread and fire behaviour on biomass burning and trace gas emissions: results from a process-based model , 2010 .

[65]  E. Michel,et al.  Constraint of the CO2 rise by new atmospheric carbon isotopic measurements during the last deglaciation , 2010 .

[66]  P. Ciais,et al.  Benchmarking coupled climate‐carbon models against long‐term atmospheric CO2 measurements , 2010 .

[67]  D. Lunt,et al.  A new dust cycle model with dynamic vegetation: LPJ-dust version 1.0 , 2010 .

[68]  A. Slingo,et al.  U.K. HiGEM: Simulations of Desert Dust and Biomass Burning Aerosols with a High-Resolution Atmospheric GCM , 2010 .

[69]  G. Leduc,et al.  Holocene and Eemian sea surface temperature trends as revealed by alkenone and Mg/Ca paleothermometry , 2010 .

[70]  Andrew D. Friend,et al.  Carbon and nitrogen cycle dynamics in the O‐CN land surface model: 1. Model description, site‐scale evaluation, and sensitivity to parameter estimates , 2010 .

[71]  Scott C. Doney,et al.  Detection of anthropogenic climate change in satellite records of ocean chlorophyll and productivity , 2010 .

[72]  Pierre Friedlingstein,et al.  Terrestrial nitrogen feedbacks may accelerate future climate change , 2010 .

[73]  Valerie Trouet,et al.  Ensemble reconstruction constraints on the global carbon cycle sensitivity to climate , 2010, Nature.

[74]  S. Harrison,et al.  Fire regimes during the Last Glacial , 2009 .

[75]  G. Henderson,et al.  A synthesis of marine sediment core δ 13 C data over the last 150 000 years , 2009 .

[76]  G. Faluvegi,et al.  Global Signatures and Dynamical Origins of the Little Ice Age and Medieval Climate Anomaly , 2009, Science.

[77]  J. Randerson,et al.  Carbon-nitrogen interactions regulate climate-carbon cycle feedbacks: results from an atmosphere-ocean general circulation model , 2009 .

[78]  Filipe Aires,et al.  Cluster Analysis of Cloud Properties over the Southern European Mediterranean Area in Observations and a Model , 2009 .

[79]  Peter E. Thornton,et al.  Systematic assessment of terrestrial biogeochemistry in coupled climate–carbon models , 2009 .

[80]  F. Joos,et al.  Stable isotope constraints on Holocene carbon cycle changes from an Antarctic ice core , 2009, Nature.

[81]  H. Birks,et al.  Last nine-thousand years of temperature variability in Northern Europe , 2009 .

[82]  Scott C. Doney,et al.  Projected 21st century decrease in marine productivity: a multi-model analysis , 2009 .

[83]  J. Brigham‐Grette,et al.  Arctic amplification: can the past constrain the future? , 2009 .

[84]  F. Arnaud,et al.  Late-Holocene summer temperature reconstruction from chironomid assemblages of Lake Anterne, northern French Alps , 2009 .

[85]  Michael Goldstein,et al.  Reified Bayesian modelling and inference for physical systems , 2009 .

[86]  Michele Scardi,et al.  Assessing the Uncertainties of Model Estimates of Primary Productivity in the Tropical Pacific Ocean Revised , 2008 .

[87]  J. Kindle,et al.  Summary diagrams for coupled hydrodynamic-ecosystem model skill assessment , 2009 .

[88]  C. Stow,et al.  Skill Assessment for Coupled Biological/Physical Models of Marine Systems. , 2009, Journal of marine systems : journal of the European Association of Marine Sciences and Techniques.

[89]  Jason P. Evans,et al.  21st century climate change in the Middle East , 2009 .

[90]  A. Abe-Ouchi,et al.  A comparison of PMIP2 model simulations and the MARGO proxy reconstruction for tropical sea surface temperatures at last glacial maximum , 2009 .

[91]  M. Weinelt,et al.  Constraints on the magnitude and patterns of ocean cooling at the Last Glacial Maximum: report of the MARGO Project , 2009 .

[92]  French Alps Late-Holocene summer temperature reconstruction from chironomid assemblages of Lake Anterne, northern , 2009 .

[93]  N. M. J. Crout,et al.  Is my model too complex? Evaluating model formulation using model reduction , 2009, Environ. Model. Softw..

[94]  Margo Project Members Constraints on the magnitude and patterns of ocean cooling at the Last Glacial Maximum , 2009 .

[95]  A. Viau,et al.  Low- and high-frequency climate variability in eastern Beringia during the past 25 000 yearsThis article is one of a series of papers published in this Special Issue on the theme Polar Climate Stability Network. , 2008 .

[96]  I. C. Prentice,et al.  Evaluation of the terrestrial carbon cycle, future plant geography and climate‐carbon cycle feedbacks using five Dynamic Global Vegetation Models (DGVMs) , 2008 .

[97]  Andrei P. Sokolov,et al.  Consequences of Considering Carbon–Nitrogen Interactions on the Feedbacks between Climate and the Terrestrial Carbon Cycle , 2008 .

[98]  K. Taylor,et al.  Evaluating the present‐day simulation of clouds, precipitation, and radiation in climate models , 2008 .

[99]  Benjamin Smith,et al.  CO2 fertilization in temperate FACE experiments not representative of boreal and tropical forests , 2008 .

[100]  J. Lynch,et al.  Changes in fire regimes since the Last Glacial Maximum: an assessment based on a global synthesis and analysis of charcoal data , 2008 .

[101]  C. Hewitt,et al.  Evaluation of coupled ocean–atmosphere simulations of the mid-Holocene using palaeovegetation data from the northern hemisphere extratropics , 2008 .

[102]  Ecosystem dynamics at a productivity gradient: A study of the lower trophic dynamics around the northern atolls in the Hawaiian Archipelago , 2008 .

[103]  Charles Doutriaux,et al.  Performance metrics for climate models , 2008 .

[104]  T. Reichler,et al.  Uncertainties in the climate mean state of global observations, reanalyses, and the GFDL climate model , 2008 .

[105]  Hoshin V. Gupta,et al.  Toward a model space and model independence metric , 2008 .

[106]  S. Itch,et al.  Evaluation of the terrestrial carbon cycle, future plant geography and climate-carbon cycle feedbacks using five Dynamic Global Vegetation Models (DGVMs) , 2008 .

[107]  A. Ridgwell Interpreting transient carbonate compensation depth changes by marine sediment core modeling , 2007 .

[108]  G. Roe,et al.  Why Is Climate Sensitivity So Unpredictable? , 2007, Science.

[109]  Scott C. Doney,et al.  Impact of circulation on export production, dissolved organic matter, and dissolved oxygen in the ocean: Results from Phase II of the Ocean Carbon‐cycle Model Intercomparison Project (OCMIP‐2) , 2007 .

[110]  Andreas Hense,et al.  Hierarchical evaluation of IPCC AR4 coupled climate models with systematic consideration of model uncertainties , 2007 .

[111]  F. Joos,et al.  Modeling the relationship between 231Pa/230Th distribution in North Atlantic sediment and Atlantic meridional overturning circulation , 2007 .

[112]  B. Otto‐Bliesner,et al.  Last Glacial Maximum ocean thermohaline circulation: PMIP2 model intercomparisons and data constraints , 2007 .

[113]  Stephen Sitch,et al.  FLUXNET and modelling the global carbon cycle , 2007 .

[114]  Jonathan Rougier,et al.  Probabilistic Inference for Future Climate Using an Ensemble of Climate Model Evaluations , 2007 .

[115]  D. Randall,et al.  Climate models and their evaluation , 2007 .

[116]  F. Joos,et al.  Modeling the relationship between 231 Pa/ 230 Th distribution in North Atlantic sediment and Atlantic meridional overturning circulation , 2007 .

[117]  E. Guilyardi,et al.  Past and future polar amplification of climate change: climate model intercomparisons and ice-core constraints , 2006 .

[118]  Paul Steele,et al.  Law Dome CO2, CH4 and N2O ice core records extended to 2000 years BP , 2006 .

[119]  E. Guilyardi,et al.  Past and future polar amplification of climate change: climate model intercomparisons and ice-core constraints , 2006 .

[120]  Zhengyu Liu,et al.  Observed Vegetation–Climate Feedbacks in the United States* , 2006 .

[121]  Yi Wang,et al.  Postglacial climate reconstruction based on compound‐specific D/H ratios of fatty acids from Blood Pond, New England , 2006 .

[122]  A. Hall,et al.  Using the current seasonal cycle to constrain snow albedo feedback in future climate change , 2006 .

[123]  E. Deza Chapter 17 – Distances and Similarities in Data Analysis , 2006 .

[124]  Robert G. Sargent,et al.  Verification and validation of simulation models , 2013, Proceedings of Winter Simulation Conference.

[125]  R. Ceulemans,et al.  Forest response to elevated CO2 is conserved across a broad range of productivity. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[126]  M. Crucifix Distribution of carbon isotopes in the glacial ocean: A model study , 2005 .

[127]  S. Bony,et al.  Marine boundary layer clouds at the heart of tropical cloud feedback uncertainties in climate models , 2005 .

[128]  Stephen Sitch,et al.  Effects of parameter uncertainties on the modeling of terrestrial biosphere dynamics , 2005 .

[129]  F. Joos,et al.  231Pa/230Th fractionation by ocean transport, biogenic particle flux and particle type , 2005 .

[130]  James M. Murphy,et al.  Systematic optimisation and climate simulation of FAMOUS, a fast version of HadCM3 , 2005 .

[131]  R. Evans,et al.  Bridging ocean color observations of the 1980s and 2000s in search of long-term trends , 2005 .

[132]  A. Paul,et al.  How to combine sparse proxy data and coupled climate models , 2005 .

[133]  Corinne Le Quéré,et al.  Role of Marine Biology in Glacial-Interglacial CO2 Cycles , 2005, Science.

[134]  H. Visscher,et al.  Atmospheric CO2 during the 13th century AD: reconciliation of data from ice core measurements and stomatal frequency analysis , 2005 .

[135]  S. Long,et al.  What have we learned from 15 years of free-air CO2 enrichment (FACE)? A meta-analytic review of the responses of photosynthesis, canopy properties and plant production to rising CO2. , 2004, The New phytologist.

[136]  D. Roche,et al.  Constraints on the duration and freshwater release of Heinrich event 4 through isotope modelling , 2004, Nature.

[137]  Scott C. Doney,et al.  Response of ocean ecosystems to climate warming , 2004 .

[138]  D. Ellsworth,et al.  Functional responses of plants to elevated atmospheric CO2– do photosynthetic and productivity data from FACE experiments support early predictions? , 2004 .

[139]  J. McManus,et al.  Collapse and rapid resumption of Atlantic meridional circulation linked to deglacial climate changes , 2004, Nature.

[140]  P. Braconnot,et al.  Synergistic feedbacks between ocean and vegetation on mid- and high-latitude climates during the mid-Holocene , 2004 .

[141]  Christian Bigler,et al.  Similarities and discrepancies between chironomid- and diatom-inferred temperature reconstructions through the Holocene at Lake 850, northern Sweden , 2004 .

[142]  G. Tselioudis,et al.  Objective identification of cloud regimes in the Tropical Western Pacific , 2003 .

[143]  Sandy P. Harrison,et al.  Climate change and Arctic ecosystems: 1. Vegetation changes north of 55°N between the last glacial maximum, mid‐Holocene, and present , 2003 .

[144]  Christian Jakob,et al.  An Improved Strategy for the Evaluation of Cloud Parameterizations in GCMS , 2003 .

[145]  Watson W. Gregg,et al.  Ocean primary production and climate: Global decadal changes , 2003 .

[146]  Sandy P. Harrison,et al.  Climate and CO2 controls on global vegetation distribution at the last glacial maximum: analysis based on palaeovegetation data, biome modelling and palaeoclimate simulations , 2003 .

[147]  Simon Brewer,et al.  The temperature of Europe during the Holocene reconstructed from pollen data , 2003 .

[148]  Filipe Aires,et al.  Inferring instantaneous, multivariate and nonlinear sensitivities for the analysis of feedback processes in a dynamical system: Lorenz model case‐study , 2003 .

[149]  Corinne Le Quéré,et al.  Dust impact on marine biota and atmospheric CO2 in glacial periods , 2003 .

[150]  G. Henderson New oceanic proxies for paleoclimate , 2002 .

[151]  Jianguo Wu,et al.  A spatially explicit hierarchical approach to modeling complex ecological systems: theory and applications , 2002 .

[152]  Frank Lunkeit,et al.  Earth system models of intermediate complexity: closing the gap in the spectrum of climate system models , 2002 .

[153]  É. Monnin,et al.  Atmospheric CO2, CH4 and N2O records over the past 60 000 years based on the comparison of different polar ice cores , 2002, Annals of Glaciology.

[154]  J. Guiot,et al.  The temperature of Europe during the Holocene reconstructed from pollen data , 2002 .

[155]  K. Taylor Summarizing multiple aspects of model performance in a single diagram , 2001 .

[156]  D. Jolly,et al.  Mid‐Holocene and glacial‐maximum vegetation geography of the northern continents and Africa , 2000 .

[157]  Victor Brovkin,et al.  CLIMBER-2: a climate system model of intermediate complexity. Part I: model description and performance for present climate , 2000 .

[158]  B. Stauffer,et al.  Reconstructing past atmospheric CO2 concentration based on ice-core analyses: open questions due to in situ production of CO2 in the ice , 2000, Journal of Glaciology.

[159]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[160]  J. Guiot,et al.  Data-model comparison using fuzzy logic in paleoclimatology , 1999 .

[161]  Sandy P. Harrison,et al.  Monsoon changes for 6000 years ago: Results of 18 simulations from the Paleoclimate Modeling Intercomparison Project (PMIP) , 1999 .

[162]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[163]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[164]  P. A. Leffelaar,et al.  On scale problems in modelling: an example from soil ecology. , 1990 .

[165]  C. Leith Climate Response and Fluctuation Dissipation , 1975 .