Sensitivity Analysis of Normative Economic Models: Theoretical Framework and Practical Strategies

The parameter values and assumptions of any economic model are subject to change and error. Sensitivity analysis (SA), broadly defined, is the investigation of these potential changes and errors and their impacts on conclusions to be drawn from the model. There is a very large literature on procedures and techniques for SA, but it includes almost nothing from economists. This paper is a selective review and overview of theoretical and methodological issues in SA. There are many possible uses of SA, described here within the categories of decision support, communication, increased understanding or quantification of the system, and model development. The paper focuses somewhat on decision support. It is argued that even the simplest approaches to SA can be theoretically respectable in decision support if they are applied and interpreted in a way consistent with Bayesian decision theory. This is not to say that SA results should be formally subjected to a Bayesian decision analysis, but that an understanding of Bayesian probability revision will help the modeller plan and interpret an SA. Many different approaches to SA are described, varying in the experimental design used and in the way results are processed. Possible overall strategies for conducting SA are suggested. It is proposed that when using SA for decision support, it can be very helpful to attempt to identify which of the following forms of recommendation is most appropriate: (a) do X, (b) do either X or Y depending on the circumstances, (c) do either X or Y, whichever you like, (d) if in doubt, do X. A system for reporting and discussing SA results is recommended. © 1997 Elsevier Science B.V. (This abstract was borrowed from another version of this item.)

[1]  Kevin J. Lomas,et al.  Sensitivity analysis techniques for building thermal simulation programs , 1992 .

[2]  Jack P. C. Kleijnen,et al.  Sensitivity analysis of simulation experiments: regression analysis and statistical design , 1992 .

[3]  Terry Andres Sampling methods and sensitivity analysis for large parameter sets , 1997 .

[4]  David J. Pannell,et al.  MIDAS, a bioeconomic model of a dryland farm system. , 1987 .

[5]  John E. Till,et al.  Radiological assessment : a textbook on environmental dose analysis , 1983 .

[6]  Jack P. C. Kleijnen,et al.  Searching for important factors in simulation models with many factors: Sequential bifurcation , 1997 .

[7]  Jaroslaw Sobieszczanski-Sobieski,et al.  Sensitivity analysis and multidisciplinary optimization for aircraft design - Recent advances and results , 1990 .

[8]  Glenn W. Harrison,et al.  The Sensitivity Analysis of Applied General Equilibrium Models: Completely Randomized Factorial Sampling Designs , 1992 .

[9]  Fabio Canova,et al.  SENSITIVITY ANALYSIS AND MODEL EVALUATION IN SIMULATED DYNAMIC GENERAL EQUILIBRIUM ECONOMIES , 1995 .

[10]  Spyros G. Tzafestas,et al.  Recent advances in the stability analysis of multidimensional systems , 1988 .

[11]  J. Kleijnen Five-stage procedure for the evaluation of simulation models through statistical techniques , 1996, Proceedings Winter Simulation Conference.

[12]  Simon French,et al.  Mathematical Programming Approaches to Sensitivity Calculations in Decision Analysis , 1992 .

[13]  D. Pannell,et al.  From Weed to Wealth? Prospects for Medic Pastures in the Mediterranean Farming System of North-West Syria , 1994 .

[14]  Jack P. C. Kleijnen,et al.  Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments , 1995 .

[15]  Resit Unal,et al.  Efficient methods for sensitivity analysis , 1995 .

[16]  Ted G. Eschenbach,et al.  Stochastic Sensitivity Analysis , 1990 .

[17]  Dean Uyeno Monte Carlo simulation on microcomputers , 1992, Simul..

[18]  David Ríos Insua,et al.  Sensitivity analysis in multi-objective decision making , 1990 .

[19]  Michael D. McKay,et al.  Evaluating Prediction Uncertainty , 1995 .

[20]  Bruce F. Baird,et al.  Managerial Decisions Under Uncertainty: An Introduction to the Analysis of Decision Making , 1989 .

[21]  Kenneth M. Menz,et al.  Product Supply Elasticities for the Australian Broadacre Industries, Estimated with a Programming Model , 1985 .

[22]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[23]  Jack P. C. Kleijnen Sensitivity analysis and optimization in simulation: design of experiments and case studies , 1995, WSC '95.

[24]  D. Hamby A review of techniques for parameter sensitivity analysis of environmental models , 1994, Environmental monitoring and assessment.

[25]  Ernest R. Alexander,et al.  Sensitivity Analysis in Complex Decision Models , 1989 .

[26]  D. Hamby A comparison of sensitivity analysis techniques. , 1995, Health physics.

[27]  David J. Pannell,et al.  A mathematical programming model of a crop-livestock farm system , 1986 .

[28]  Thomas A. Wilson,et al.  Macroeconomic effects and sensitivity analysis , 1991 .

[29]  Ted G. Eschenbach,et al.  Exposition on Using Graphs for Sensitivity Analysis , 1989 .