Sensitivity analysis of censored output through polynomial, logistic, and tobit regression meta-models: theory and case study

The paper focuses on simulation output that may be censored; that is, the output has a limited range (examples are simulations that have as output the time to occurrence of a specific event, such as a 'rare' event, within a fixed time horizon). For sensitivity analysis of such simulations we discuss three alternatives: (i) traditional polynomial regression models, (ii) logistic or logit regression, and (iii) tobit analysis. The case study concerns the control of a specific animal disease (namely, IBR) in The Netherlands. The simulation experiment has 31 environmental factors or inputs, combined into 64 scenarios, each replicated twice. Traditional polynomial regression gives some estimated main effects with wrong signs. Logit regression correctly predicts whether simulation output is censored or not for 92% of the scenarios. Tobit analysis does not give effects with wrong signs; it correctly predicts censoring for 89% of the scenarios.

[1]  Jack P. C. Kleijnen,et al.  Strategic directions in verification, validation, and accreditation research , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[2]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[3]  Jack P. C. Kleijnen,et al.  Sensitivity analysis by experimental design and metamodelling: Case study on simulation in national animal disease control , 2003, Eur. J. Oper. Res..

[4]  H. S. Horst,et al.  Monte Carlo simulation of virus introduction into the Netherlands. , 1999, Preventive veterinary medicine.

[5]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[6]  T. Amemiya Tobit models: A survey , 1984 .

[7]  J. A. Calvin Regression Models for Categorical and Limited Dependent Variables , 1998 .

[8]  J. S. Long,et al.  Regression Models for Categorical and Limited Dependent Variables , 1997 .

[9]  J. Kleijnen Statistical tools for simulation practitioners , 1986 .

[10]  Jack P. C. Kleijnen,et al.  Measurement scales and resolution IV designs : A note (Version 3) , 1990 .

[11]  Jack P. C. Kleijnen,et al.  A methodology for fitting and validating metamodels in simulation , 2000, Eur. J. Oper. Res..

[12]  Jack P. C. Kleijnen,et al.  A methodology for the fitting and validation of metamodels in simulation , 2000 .

[13]  Jack P. C. Kleijnen,et al.  Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models , 1997 .