Uncertainty in Integrated Assessment Modelling: Can Global Sensitivity Analysis Be of Help?

The complexity of integrated assessment models (IAMs) prevents the direct appreciation of the impact of uncertainty on the model predictions. However, for a full understanding and corroboration of model results, analysts might be willing, and ought to identify the model inputs that influence the model results the most (key drivers), the direction of change associated with the variation of a given input and the overall model structure (interaction analysis). We show that such information is already contained in the data set produced by Monte Carlo simulations commonly used in IAM studies and that can be extracted from it without additional calculations. Our discussion is guided by an application of the proposed methodologies to the well-known DICE model of William Nordhaus (2008). A comparison of the proposed methodology to approaches previously applied on the same model shows that robust insights concerning the dependence of future atmospheric temperature, global emissions and current carbon costs and taxes on the model's exogenous inputs can be obtained. The method avoids the fallacy of a priori deeming the important factors based on the sole intuition

[1]  Simon Dietz,et al.  High impact, low probability? An empirical analysis of risk in the economics of climate change , 2011 .

[2]  Andrei P. Sokolov,et al.  Quantifying Uncertainties in Climate System Properties with the Use of Recent Climate Observations , 2002, Science.

[3]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[4]  Bob van der Zwaan,et al.  A Sensitivity Analysis of Timing and Costs of Greenhouse Gas Emission Reductions , 2004 .

[5]  T. Virtanen,et al.  Sensitivity Analysis of Discharge in the Arctic Usa Basin, East-European Russia , 2003 .

[6]  Chris Hope,et al.  REFLECTIONS ON THE STERN REVIEW (1) A Robust Case for Strong Action to Reduce the Risks of Climate Change , 2007 .

[7]  Chris Hope,et al.  The marginal impact of CO2 from PAGE2002: An integrated assessment model incorporating the IPCC's five reasons for concern , 2006 .

[8]  Shardul Agrawala,et al.  Climate change. The limits of consensus. , 2007, Science.

[9]  N. Stern,et al.  Right for the Right Reasons , 2007 .

[10]  P. Heuberger,et al.  Conditional probabilistic estimates of 21st century greenhouse gas emissions based on the storylines of the IPCC-SRES scenarios , 2008 .

[11]  W. Pizer,et al.  Discounting the Distant Future: How Much Do Uncertain Rates Increase Valuations? , 2001 .

[12]  H Rabitz,et al.  Systems Analysis at the Molecular Scale , 1989, Science.

[13]  Soedjatmoko,et al.  Managing the global commons , 1982, International Organization.

[14]  Martin Beniston,et al.  Sensitivity Analysis of Snow Cover to Climate Change Scenarios and Their Impact on Plant Habitats in Alpine Terrain , 2005 .

[15]  D. Miller,et al.  How Certain Are Salmon Recovery Forecasts? A Watershed-scale Sensitivity Analysis , 2010 .

[16]  M. G. Garner,et al.  A Sensitivity Analysis of an Integrated Modelling Approach to Assess the Risk of Wind-borne Spread of Foot-and-mouth Disease Virus from Infected Premises , 2008 .

[17]  A. Meyer Economics Of Climate Change , 1995, Nature.

[18]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[19]  Miguel Ángel Tarancón Morán,et al.  A combined input-output and sensitivity analysis approach to analyse sector linkages and CO2 emissions , 2007 .

[20]  Saltelli Andrea,et al.  Sensitivity Analysis for Nonlinear Mathematical Models. Numerical ExperienceSensitivity Analysis for Nonlinear Mathematical Models. Numerical Experience , 1995 .

[21]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[22]  J. Kleijnen,et al.  Statistical analyses of scatterplots to identify important factors in large-scale simulations, 2: robustness of techniques , 1999 .

[23]  W. Nordhaus A Question of Balance: Weighing the Options on Global Warming Policies , 2008 .

[24]  A. Saltelli,et al.  Sensitivity analysis of an environmental model: an application of different analysis methods , 1997 .

[25]  M. Ratto,et al.  Using recursive algorithms for the efficient identification of smoothing spline ANOVA models , 2010 .

[26]  William D. Nordhaus,et al.  What is the Value of Scientific Knowledge? An Application to Global Warming Using the PRICE Model , 1997 .

[27]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[28]  Roger David Braddock,et al.  Application of the Morris algorithm for sensitivity analysis of the REALM model for the Goulburn irrigation system , 2006 .

[29]  Marc B Neumann,et al.  Global sensitivity analysis for model-based prediction of oxidative micropollutant transformation during drinking water treatment. , 2009, Water research.

[30]  Richard S. J. Tol,et al.  Is the Uncertainty about Climate Change too Large for Expected Cost-Benefit Analysis? , 2003 .

[31]  Thomas Sterner,et al.  An Even Sterner Review: Introducing Relative Prices into the Discounting Debate , 2008, Review of Environmental Economics and Policy.

[32]  Emanuele Borgonovo,et al.  Sensitivity analysis with finite changes: An application to modified EOQ models , 2010, Eur. J. Oper. Res..

[33]  N. Stern The Economics of Climate Change: Implications of Climate Change for Development , 2007 .

[34]  Samuel Buis,et al.  Global sensitivity analysis measures the quality of parameter estimation: The case of soil parameters and a crop model , 2010, Environ. Model. Softw..

[35]  M. Weitzman,et al.  On Modeling and Interpreting the Economics of Catastrophic Climate Change , 2009, The Review of Economics and Statistics.

[36]  R. Tol,et al.  The uncertainty about the social cost of carbon: A decomposition analysis using fund , 2013, Climatic Change.

[37]  B. O’Neill,et al.  The Greenhouse Externality to Childbearing: A Sensitivity Analysis , 2000 .

[38]  Paul D. Bates,et al.  Distributed Sensitivity Analysis of Flood Inundation Model Calibration , 2005 .

[39]  A. Saltelli,et al.  On the Relative Importance of Input Factors in Mathematical Models , 2002 .

[40]  Christian P. Traeger,et al.  Tipping Points and Ambiguity in the Economics of Climate Change , 2011 .

[41]  R. Prinn,et al.  Climate change. Uncertainty and climate change assessments. , 2001, Science.

[42]  Gemma Manache,et al.  Identification of reliable regression- and correlation-based sensitivity measures for importance ranking of water-quality model parameters , 2008, Environ. Model. Softw..

[43]  B. Efron,et al.  The Jackknife Estimate of Variance , 1981 .

[44]  Yeou-Koung Tung,et al.  UNCERTAINTY AND SENSITIVITY ANALYSES OF PIT-MIGRATION MODEL , 1993 .

[45]  Daiju Narita,et al.  Uncertainty in Integrated Assessment Models of Climate Change: Alternative Analytical Approaches , 2011, Environmental Modeling & Assessment.

[46]  Andrea Saltelli,et al.  Sensitivity analysis didn't help. A practitioner's critique of the Stern review , 2010 .

[47]  Bofu Yu,et al.  Analysing the sensitivity behaviour of two hydrology models , 2007 .

[48]  R. Dawson,et al.  Sensitivity Analysis for Hydraulic Models , 2009 .

[49]  David Popp,et al.  Entice: Endogenous Technological Change in the Dice Model of Global Warming , 2003 .

[50]  Stephen E. Schwartz,et al.  Feedback and sensitivity in an electrical circuit: an analog for climate models , 2011 .

[51]  F. Périé,et al.  Calibration, validation and sensitivity analysis of an ecosystem model applied to artificial streams. , 2008, Water research.

[52]  Roger D. Braddock,et al.  Sensitivity analysis of the IMAGE Greenhouse model , 1999, Environ. Model. Softw..

[53]  Terrence Iverson,et al.  Precaution and proportionality in the management of global environmental change , 2012 .

[54]  W. Nordhaus Managing the Global Commons: The Economics of Climate Change , 1994 .

[55]  W. Nordhaus Critical Assumptions in the Stern Review on Climate Change , 2007, Science.

[56]  M. Weitzman A Review of The Stern Review on the Economics of Climate Change , 2007 .

[57]  S. Tarantola,et al.  Moment independent and variance‐based sensitivity analysis with correlations: An application to the stability of a chemical reactor , 2008 .

[58]  Silvio Funtowicz,et al.  Application of a checklist for quality assistance in environmental modelling to an energy model , 2005 .

[59]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[60]  L. Parrella,et al.  Managing Uncertainty in Risk-Based Corrective Action Design: Global Sensitivity Analysis of Contaminant Fate and Exposure Models Used in the Dose Assessment , 2009 .

[61]  A. Cheng,et al.  Sensitivity Analysis of Flow in Multilayered Leaky Aquifer Systems , 1996 .

[62]  R. Iman,et al.  A measure of top-down correlation , 1987 .

[63]  Francesco Feri,et al.  Economics and Statistics , 2007 .

[64]  Emanuele Borgonovo,et al.  Sampling strategies in density-based sensitivity analysis , 2012, Environ. Model. Softw..

[65]  Arthur Petersen,et al.  Agreeing to disagree: uncertainty management in assessing climate change, impacts and responses by the IPCC , 2009 .

[66]  Detlef P. van Vuuren,et al.  Analysing the costs and benefits of climate policy: Value judgements and scientific uncertainties , 2008 .

[67]  Adrian Sandu,et al.  Application of ADIFOR for air pollution model sensitivity studies , 2000, Environ. Model. Softw..

[68]  Paola Annoni,et al.  Sixth International Conference on Sensitivity Analysis of Model Output How to avoid a perfunctory sensitivity analysis , 2010 .

[69]  V. Estrada,et al.  Global sensitivity analysis in the development of first principle-based eutrophication models , 2010, Environ. Model. Softw..

[70]  David Green,et al.  Modelling Water Blending—Sensitivity of Optimal Policies , 2008 .

[71]  A. Markandya,et al.  DICER: A tool for analyzing climate policies , 2011 .

[72]  Andrea Saltelli,et al.  From screening to quantitative sensitivity analysis. A unified approach , 2011, Comput. Phys. Commun..

[73]  R. Tol The Social Cost of Carbon: Trends, Outliers and Catastrophes , 2008 .

[74]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[75]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[76]  David B. Lobell,et al.  Why are agricultural impacts of climate change so uncertain? The importance of temperature relative to precipitation , 2008, Environmental Research Letters.

[77]  G. Apostolakis The concept of probability in safety assessments of technological systems. , 1990, Science.

[78]  Helge Bormann,et al.  Sensitivity analysis of 18 different potential evapotranspiration models to observed climatic change at German climate stations , 2011 .

[79]  Alison S. Tomlin,et al.  GUI-HDMR - A software tool for global sensitivity analysis of complex models , 2009, Environ. Model. Softw..

[80]  Stefano Tarantola,et al.  Sensitivity analysis of the rice model WARM in Europe: Exploring the effects of different locations, climates and methods of analysis on model sensitivity to crop parameters , 2010, Environ. Model. Softw..

[81]  N. Stern,et al.  Climate Change: Risk, Ethics, and the Stern Review , 2007, Science.

[82]  K. Zickfeld,et al.  Reducing the risk of Atlantic thermohaline circulation collapse: sensitivity analysis of emissions corridors , 2008 .

[83]  Antony Millner,et al.  Ambiguity and Climate Policy , 2010 .

[84]  John P. Norton,et al.  Algebraic sensitivity analysis of environmental models , 2008, Environ. Model. Softw..