Multiple rotations of Gaussian quadratures: An efficient method for uncertainty analyses in large-scale simulation models

Concerns regarding the impacts of climate change, food price volatility and uncertain macroeconomic conditions have motivated users of large-scale simulation models addressing agricultural markets to consider uncertainty in their projections. One way to incorporate uncertainty in such models is the integration of stochastic elements, thus turning the model into a problem of numerical integration. In most cases, such problems do not have analytical solutions, and researchers apply methods of numerical approximation. This article presents a novel approach to uncertainty analysis as an alternative to the computationally burdensome Monte Carlo or quasi-Monte Carlo methods, also known as probabilistic approaches. The method developed here is based on Stroud’s degree three Gaussian quadrature (GQ) formulae. It is tested in three different large-scale simulation models addressing agricultural markets. The results of this study demonstrate that the proposed approach produces highly accurate results using a fraction of the computation capacity and time required by probabilistic approaches. The findings suggest that this novel approach, called the multiple rotations of Gaussian Quadratures (MRGQ), is highly relevant to increasing the quality of the results since individual GQ-rotations tend to produce results with rather large variability/approximation errors. The MRGQ method can be applied to any simulation model, but we believe that the main beneficiaries will be users of large-scale simulation models who struggle to apply probabilistic methods for uncertainty analyses due to their high computational, data management and time requirements.

[1]  Liangzhi You,et al.  An entropy approach to spatial disaggregation of agricultural production , 2006 .

[2]  Laura Uusitalo,et al.  An overview of methods to evaluate uncertainty of deterministic models in decision support , 2015, Environ. Model. Softw..

[3]  Channing Arndt,et al.  An Introduction to Systematic Sensitivity Analysis via Gaussian Quadrature , 2000, GTAP Technical Paper Series.

[4]  E. Schmid,et al.  Climate change mitigation through livestock system transitions , 2014, Proceedings of the National Academy of Sciences.

[5]  Alison Burrell,et al.  Partial stochastic analysis with the European Commission's version of the AGLINK-COSIMO model , 2012 .

[6]  Wallace E. Tyner,et al.  Validating Energy-Oriented CGE Models , 2009, GTAP Working Paper.

[7]  David Clifford,et al.  Simple approach to emulating complex computer models for global sensitivity analysis , 2015, Environ. Model. Softw..

[8]  E. Schmid,et al.  Global land-use implications of first and second generation biofuel targets , 2011 .

[9]  T. Hertel,et al.  Potential Implications of a Special Safeguard Mechanism in the World Trade Organization: the Case of Wheat , 2012 .

[10]  Paul V. Preckel,et al.  Efficient survey sampling of households via Gaussian quadrature , 2006 .

[11]  Jan H. Kwakkel,et al.  How Robust is a Robust Policy? Comparing Alternative Robustness Metrics for Robust Decision-Making , 2016 .

[12]  Seymour Haber,et al.  Numerical Evaluation of Multiple Integrals , 1970 .

[13]  Paola Annoni,et al.  Sixth International Conference on Sensitivity Analysis of Model Output How to avoid a perfunctory sensitivity analysis , 2010 .

[14]  H. Gupta,et al.  A new framework for comprehensive, robust, and efficient global sensitivity analysis: 1. Theory , 2016 .

[15]  Jonas Luckmann,et al.  Is Bhutan destined for 100% organic? Assessing the economy-wide effects of a large-scale conversion policy , 2018, PloS one.

[16]  Jim W. Hall,et al.  Sensitivity analysis of environmental models: A systematic review with practical workflow , 2014, Environ. Model. Softw..

[17]  Roman Keeney,et al.  Assessing Global Computable General Equilibrium Model Validity Using Agricultural Price Volatility , 2007 .

[18]  Rudolf Schürer Parallel High-Dimensional Integration: Quasi-Monte Carlo versus Adaptive Cubature Rules , 2001, International Conference on Computational Science.

[19]  C. Hart,et al.  When Point Estimates Miss the Point: Stochastic Modeling of WTO Restrictions , 2006 .

[20]  Jimmy R. Williams,et al.  Simulating soil C dynamics with EPIC: Model description and testing against long-term data , 2006 .

[21]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[22]  John Norton,et al.  An introduction to sensitivity assessment of simulation models , 2015, Environ. Model. Softw..

[23]  Francesca Pianosi,et al.  Global Sensitivity Analysis of environmental models: Convergence and validation , 2016, Environ. Model. Softw..

[24]  Richard E. Howitt,et al.  Positive Mathematical Programming , 1995 .

[25]  Tae-Young Heo,et al.  Modeling metal-sediment interaction processes: Parameter sensitivity assessment and uncertainty analysis , 2016, Environ. Model. Softw..

[26]  William Becker,et al.  Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices , 2017, Environ. Model. Softw..

[27]  J. Thurlow,et al.  A recursive dynamic computable general equilibrium model. , 2012 .

[28]  Rudolf Schürer,et al.  A comparison between (quasi-)Monte Carlo and cubature rule based methods for solving high-dimensional integration problems , 2003, Math. Comput. Simul..

[29]  Hermann Engles,et al.  Numerical quadrature and cubature , 1980 .

[30]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[31]  H. Gupta,et al.  A new framework for comprehensive, robust, and efficient global sensitivity analysis: 2. Application , 2016 .

[32]  ChoEunju,et al.  Modeling metal-sediment interaction processes , 2016 .

[33]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[34]  K. Siddig,et al.  A Post-Separation Social Accounting Matrix for the Sudan , 2016 .

[35]  Sherman Robinson,et al.  The International Model for Policy Analysis of Agricultural Commodities and Trade (IMPACT): Model Description for Version 3 , 2015 .

[36]  C. Folberth,et al.  Global wheat production potentials and management flexibility under the representative concentration pathways , 2014 .

[37]  A. Stroud Remarks on the disposition of points in numerical integration formulas. , 1957 .

[38]  C. Arndt,et al.  Climate uncertainty and economic development: evaluating the case of Mozambique to 2050 , 2015, Climatic Change.

[39]  A. OHagan,et al.  Bayesian analysis of computer code outputs: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[40]  Paul V. Preckel,et al.  Implications of Broader Sampling Strategy in the Contest of the Special Safeguard Mechanism , 2011 .

[41]  Anthony O'Hagan,et al.  Probabilistic uncertainty specification: Overview, elaboration techniques and their application to a mechanistic model of carbon flux , 2012, Environ. Model. Softw..

[42]  V. Singh,et al.  The EPIC model. , 1995 .

[43]  Paul V. Preckel,et al.  Gaussian cubature: A practitioner's guide , 2007, Math. Comput. Model..

[44]  Saman Razavi,et al.  Global sensitivity analysis for high-dimensional problems: How to objectively group factors and measure robustness and convergence while reducing computational cost , 2019, Environ. Model. Softw..

[45]  Will Yield Improvements on the Forest Frontier Reduce Greenhouse Gas Emissions? A Global Analysis of Oil Palm , 2013 .

[46]  P. Preckel,et al.  Gaussian Quadratures vs. Monte Carlo Experiments for Systematic Sensitivity Analysis of Computable General Equilibrium Model Results , 2017 .

[47]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[48]  Jing Yang,et al.  Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis , 2011, Environ. Model. Softw..

[49]  Saman Razavi,et al.  VARS-TOOL: A toolbox for comprehensive, efficient, and robust sensitivity and uncertainty analysis , 2019, Environ. Model. Softw..

[50]  L. Shawn Matott,et al.  Evaluating uncertainty in integrated environmental models: A review of concepts and tools , 2009 .

[51]  Wei Chu,et al.  A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model , 2014, Environ. Model. Softw..

[52]  T. Hertel,et al.  Are the Poverty Effects of Trade Policies Invisible , 2011 .

[53]  Sébastien Mary,et al.  A Monte Carlo filtering application for systematic sensitivity analysis of computable general equilibrium results , 2018, Economic Systems Research.

[54]  Takuya Iwanaga,et al.  Certain trends in uncertainty and sensitivity analysis: An overview of software tools and techniques , 2020, Environ. Model. Softw..

[55]  Jun Xia,et al.  Integration of a statistical emulator approach with the SCE-UA method for parameter optimization of a hydrological model , 2012 .

[56]  Daniel P. Loucks,et al.  System Sensitivity and Uncertainty Analysis , 2017 .

[57]  H. Grethe,et al.  A 2012 Social Accounting Matrix (SAM) for Bhutan with a detailed representation of the agricultural sector (technical documentation). , 2017 .

[58]  G. Zimmermann,et al.  Stochastic market modeling with Gaussian Quadratures: Do rotations of Stroud's octahedron matter? , 2015 .

[59]  Jun Xia,et al.  An efficient integrated approach for global sensitivity analysis of hydrological model parameters , 2013, Environ. Model. Softw..

[60]  C. Fortuin,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory , 1973 .

[61]  K. Strzepek,et al.  Informed selection of future climates , 2014, Climatic Change.