Towards a public, standardized, diagnostic benchmarking system for land surface models

Abstract. This work examines different conceptions of land surface model benchmarking and the importance of internationally standardized evaluation experiments that specify data sets, variables, metrics and model resolutions. It additionally demonstrates how essential the definition of a priori expectations of model performance can be, based on the complexity of a model and the amount of information being provided to it, and gives an example of how these expectations might be quantified. Finally, the Protocol for the Analysis of Land Surface models (PALS) is introduced – a free, online land surface model benchmarking application that is structured to meet both of these goals.

[1]  S. Manabe.  CLIMATE AND THE OCEAN CIRCULATION1 , 1969 .

[2]  W. Collins,et al.  The Community Climate System Model Version 3 (CCSM3) , 2006 .

[3]  Syukuro Manabe,et al.  THE ATMOSPHERIC CIRCULATION AND THE HYDROLOGY OF THE EARTH ’ S SURFACE , 1969 .

[4]  Ray Leuning,et al.  Diagnosing errors in a land surface model (CABLE) in the time and frequency domains , 2011 .

[5]  I. C. Prentice,et al.  A dynamic global vegetation model for studies of the coupled atmosphere‐biosphere system , 2005 .

[6]  W. Oechel,et al.  Energy balance closure at FLUXNET sites , 2002 .

[7]  A. Pitman,et al.  Evaluating the Performance of Land Surface Models , 2008 .

[8]  Robert Clement,et al.  On the validation of models of forest CO2 exchange using eddy covariance data: some perils and pitfalls. , 2005, Tree physiology.

[9]  K. McGuffie,et al.  The Project for Intercomparison of Land-surface Parametrization Schemes (PILPS): 1992 to 1995 , 1996 .

[10]  R. Leuning,et al.  Carbon and water fluxes over a temperate Eucalyptus forest and a tropical wet/dry savanna in Australia: measurements and comparison with MODIS remote sensing estimates , 2005 .

[11]  Mariana Vertenstein,et al.  The Community Land Model's Dynamic Global Vegetation Model (CLM-DGVM): Technical description and user's guide , 2004 .

[12]  H. B. Gordon,et al.  The CSIRO Mk3 climate system model , 2002 .

[13]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[14]  Peter E. Thornton,et al.  Technical Description of the Community Land Model (CLM) , 2004 .

[15]  Lev R Ginzburg,et al.  Rules of thumb for judging ecological theories. , 2004, Trends in ecology & evolution.

[16]  T. A. Black,et al.  Energy Balance Closure Using Eddy Covariance Above Two Different Land Surfaces and Implications for CO2 Flux Measurements , 2010 .

[17]  S. Los,et al.  A comprehensive set of benchmark tests for a land surface model of simultaneous fluxes of water and carbon at both the global and seasonal scale , 2010 .

[18]  Ann Henderson-Sellers,et al.  The Project for Intercomparison of Land Surface Parameterization Schemes (PILPS): Phases 2 and 3 , 1995 .