Sensitivity analysis for models with multiple behavior modes: a method based on behavior pattern measures

Sensitivity analysis of system dynamics models is essentially about sensitivity of patterns of output behaviors to inputs, since system dynamics modeling is behavior pattern oriented. In this study, a regression-based procedure for pattern sensitivity analysis is developed, by defining behavior pattern measures such as equilibrium level, trend, inflection point, or oscillation amplitude. A unique feature of the procedure is that it takes into account the possibility of a model generating multiple behavior modes. This pattern-oriented procedure is next applied to the tipping point project management model and a generic supply line model. These test applications yield sensitivity results that are meaningful, and also consistent with previously available sensitivity information about the parameters of these models. Finally, our pattern sensitivity analysis is shown to be a useful and effective method also for oscillatory system dynamics models, an unsolved sensitivity problem previously in the literature. Copyright © 2017 System Dynamics Society

[1]  Yaman Barlas,et al.  An autocorrelation function test for out put validation , 1990, Simul..

[2]  Timothy R. B. Taylor,et al.  Improving model understanding using statistical screening , 2010 .

[3]  Jack P. C. Kleijnen,et al.  Robust Optimization in Simulation: Taguchi and Krige Combined , 2009, INFORMS J. Comput..

[4]  Jack P. C. Kleijnen,et al.  Factor Screening for Simulation with Multiple Responses: Sequential Bifurcation , 2013, Eur. J. Oper. Res..

[5]  Yaman Barlas,et al.  Automated parameter specification in dynamic feedback models based on behavior pattern features , 2011 .

[6]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[7]  Burak Güneralp.  Towards coherent loop dominance analysis: progress in eigenvalue elasticity analysis , 2006 .

[8]  Jack P. C. Kleijnen,et al.  Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments , 1995 .

[9]  Andrew Ford,et al.  Statistical screening of system dynamics models , 2005 .

[10]  Andreas Hadjis.  Bringing economy and robustness in parameter testing: a Taguchi methods‐based approach to model validation , 2011 .

[11]  David N. Ford.  A behavioral approach to feedback loop dominance analysis , 1999 .

[12]  David N. Ford,et al.  Quantifying the impacts of rework, schedule pressure, and ripple effect loops on project schedule performance , 2016 .

[13]  Y. Barlas.  Multiple tests for validation of system dynamics type of simulation models , 1989 .

[14]  Rogelio Oliva,et al.  A comprehensive analytical approach for policy analysis of system dynamics models , 2010, Eur. J. Oper. Res..

[15]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[16]  J.P.C. Kleijnen,et al.  Risk analysis : Frequentist and Bayesians unite! , 2007 .

[17]  Yaman Barlas,et al.  A generalized stock control formulation for stock management problems involving composite delays and secondary stocks , 2005 .

[18]  Andrew Ford,et al.  Estimating the Impact of Efficiency Standards on the Uncertainty of the Northwest Electric System , 1990, Oper. Res..

[19]  Resit Unal,et al.  Efficient methods for sensitivity analysis , 1995 .

[20]  David N. Ford,et al.  Tipping point failure and robustness in single development projects , 2006 .

[21]  Gönenç Yücel,et al.  Sensitivity analysis of graphical functions , 2014 .