Statistical framework for evaluation of climate model simulations by use of climate proxy data from the last millennium - Part 1: Theory

A statistical framework for comparing the output of ensemble simulations from global climate models with networks of climate proxy and instrumental records has been developed, focusing on near-surface temperatures for the last millennium. This framework includes the formulation of a joint statistical model for proxy data, instrumental data and simulation data, which is used to optimize a quadratic distance measure for ranking climate model simulations. An essential underlying assumption is that the simulations and the proxy/instrumental series have a shared component of variability that is due to temporal changes in external forcing, such as volcanic aerosol load, solar irradiance or greenhouse gas concentrations. Two statistical tests have been formulated. Firstly, a preliminary test establishes whether a significant temporal correlation exists between instrumental/proxy and simulation data. Secondly, the distance measure is expressed in the form of a test statistic of whether a forced simulation is closer to the instrumental/proxy series than unforced simulations. The proposed framework allows any number of proxy locations to be used jointly, with different seasons, record lengths and statistical precision. The goal is to objectively rank several competing climate model simulations (e.g. with alternative model parameterizations or alternative forcing histories) by means of their goodness of fit to the unobservable true past climate variations, as estimated from noisy proxy data and instrumental observations.

[1]  Michael Thompson,et al.  Regression and Calibration , 2011 .

[2]  G. Hegerl,et al.  Influence of human and natural forcing on European seasonal temperatures , 2011 .

[3]  A. H. Murphy,et al.  Skill Scores Based on the Mean Square Error and Their Relationships to the Correlation Coefficient , 1988 .

[4]  M. Webb,et al.  Quantification of modelling uncertainties in a large ensemble of climate change simulations , 2004, Nature.

[5]  Gerd Bürger,et al.  Climate reconstruction by regression – 32 variations on a theme , 2006 .

[6]  Rolf Sundberg,et al.  Statistical framework for evaluation of climate model simulations by use of climate proxy data from the last millennium , 2012 .

[7]  A. Moberg,et al.  Prediction intervals for climate reconstructions with autocorrelated noise : An analysis of ordinary least squares and measurement error methods , 2011 .

[8]  Christine Osborne,et al.  Statistical Calibration: A Review , 1991 .

[9]  Francis W. Zwiers,et al.  Detecting and attributing external influences on the climate system: a review of recent advances , 2005 .

[10]  L. Gleser.  Measurement, Regression, and Calibration , 1996 .

[11]  P. Stoffa,et al.  A multivariate empirical‐orthogonal‐function‐based measure of climate model performance , 2004 .

[12]  Martin Wilmking,et al.  Identification of linear relationships from noisy data using errors-in-variables models—relevance for reconstruction of past climate from tree-ring and other proxy information , 2009 .

[13]  Sudhir Gupta,et al.  Statistical Regression With Measurement Error , 1999, Technometrics.

[14]  Murali Haran,et al.  Piecing together the past: statistical insights into paleoclimatic reconstructions , 2010 .

[15]  H. Storch.  On the Use of “Inflation” in Statistical Downscaling , 1999 .

[16]  M. R. Allen,et al.  Checking for model consistency in optimal fingerprinting , 1999 .

[17]  G. Hegerl,et al.  Detection of Human Influence on a New, Validated 1500-Year Temperature Reconstruction , 2007 .

[18]  P. Jones,et al.  Uncertainty estimates in regional and global observed temperature changes: A new data set from 1850 , 2006 .

[19]  Alexander Kukush,et al.  Measurement Error Models , 2011, International Encyclopedia of Statistical Science.

[20]  Myles R. Allen,et al.  Estimating signal amplitudes in optimal fingerprinting. Part II: application to general circulation models , 2003 .

[21]  Leonard A. Smith,et al.  Broad range of 2050 warming from an observationally constrained large climate model ensemble , 2012 .

[22]  Bo Christiansen.  Reconstructing the NH Mean Temperature: Can Underestimation of Trends and Variability Be Avoided? , 2011 .

[23]  David Frank,et al.  Effect of scaling and regression on reconstructed temperature amplitude for the past millennium , 2005 .

[24]  Heinrich Widmann,et al.  Climate and carbon-cycle variability over the last millennium , 2010 .

[25]  A. H. Murphy,et al.  Skill Scores and Correlation Coefficients in Model Verification , 1989 .

[26]  T. N. Krishnamurti,et al.  Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble. , 1999, Science.

[27]  Axel Timmermann,et al.  Internal and forced climate variability during the last millennium: a model-data comparison using ensemble simulations , 2005 .

[28]  Hugues Goosse,et al.  Using data assimilation to study extratropical Northern Hemisphere climate over the last millennium , 2009 .

[29]  Bo Li,et al.  Technical Note: Correcting for signal attenuation from noisy proxy data in climate reconstructions , 2010 .

[30]  E. Mosley‐Thompson,et al.  High-resolution palaeoclimatology of the last millennium: a review of current status and future prospects , 2009 .

[31]  Rolf Sundberg,et al.  Statistical framework for evaluation of climate model simulations by use of climate proxy data from the last millennium – Part 2: A pseudo-proxy study addressing the amplitude of solar forcing , 2012 .

[32]  Axel Timmermann,et al.  Using paleoclimate proxy-data to select optimal realisations in an ensemble of simulations of the climate of the past millennium , 2006 .