Using subsystem linear regression metamodels in stochastic simulation

This article explores the use of metamodels as simulation building blocks. The metamodel replaces a part of the simulation model with a mathematical function that mimics the input-output behavior of that part, with respect to some measure of interest to the designer. The integration of metamodels as components of the simulation model simplifies the model and reduces the simulation time. Such use of the metamodels also gives the designer a better understanding of the behavior of those parts of the model, making the simulation model as a whole more intelligible. The metamodel-based simulation model building process is examined, step by step, and the designer options are explored. This process includes the identification of the metamodel candidates and the construction of the metamodels themselves. The assessment of the proposed approach includes the evaluation of the integration effort of the metamodel into the metamodel-based simulation model, and the accuracy of the output data when compared to the original system. A metamodel-based simulation model validation test, based on a simulation model validation test, is developed to ensure that the response conforms to the original simulation model. The proposed test comprises the cases when the simulation response variance varies with the experimental point and when it is constant. A message routing and processing example, with a fourth-degree polynomial regression metamodel, is used to illustrate the proposed procedure. An integrated simulation system is used to integrate the metamodel-based simulation model as well as the original simulation model.

[1]  M. I. R. D. Santos,et al.  ESTIMATION OF NONLINEAR SIMULATION METAMODELS USING CONTROL VARIATES , 2005 .

[2]  Jack P. C. Kleijnen,et al.  A methodology for fitting and validating metamodels in simulation , 2000, Eur. J. Oper. Res..

[3]  Robert G. Sargent Research issues in metamodeling , 1991, 1991 Winter Simulation Conference Proceedings..

[4]  Robert W. Blanning,et al.  The construction and implementation of metamodels , 1975 .

[5]  Jack P. C. Kleijnen,et al.  Improved Design of Queueing Simulation Experiments with Highly Heteroscedastic Responses , 1999, Oper. Res..

[6]  J. Kleijnen Statistical tools for simulation practitioners , 1986 .

[7]  Isabel R. Santos,et al.  Simulation metamodels for modeling output distribution parameters , 2007, 2007 Winter Simulation Conference.

[8]  Heather Fry,et al.  A user’s guide , 2003 .

[9]  Jack P. C. Kleijnen,et al.  Robustness of Kriging when interpolating in random simulation with heterogeneous variances: Some experiments , 2005, Eur. J. Oper. Res..

[10]  Hershey H. Friedman,et al.  Validating the simulation metamodel: Some practical approaches , 1985 .

[11]  Russell R. Barton,et al.  Simulation metamodels , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[12]  A. Alan B. Pritsker,et al.  Simulation with Visual SLAM and AweSim , 1997 .

[13]  Russell R. Barton,et al.  Metamodels for simulation input-output relations , 1992, WSC '92.

[14]  M. Isabel Reis dos Santos,et al.  Statistical fitting and validation of non-linear simulation metamodels: A case study , 2006, Eur. J. Oper. Res..

[15]  Adedeji B. Badiru,et al.  Neural network as a simulation metamodel in economic analysis of risky projects , 1998, Eur. J. Oper. Res..

[16]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[17]  Michael Pidd,et al.  Critical issues in the development of component-based discrete simulation , 2004, Simul. Model. Pract. Theory.

[18]  Jack P. C. Kleijnen,et al.  Validation of trace-driven simulation models: more on bootstrap tests , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[19]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[20]  Jack P. C. Kleijnen,et al.  State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments , 2005, INFORMS J. Comput..

[21]  M. Isabel Reis dos Santos,et al.  The main issues in nonlinear simulation metamodel estimation , 1999, WSC '99.

[22]  Dep. Matemática,et al.  Validation of nonlinear simulation metamodels , 2022 .

[23]  Jack P. C. Kleijnen,et al.  A Comment on Blanning's “Metamodel for Sensitivity Analysis: The Regression Metamodel in Simulation” , 1975 .

[24]  Raymond H. Myers,et al.  Combining regression diagnostics with simulation metamodels , 1994 .

[25]  Jack P. C. Kleijnen,et al.  Simulation: A Statistical Perspective , 1992 .

[26]  Kerrie N. Paige,et al.  Learning SIMUL8: The Complete Guide , 2002 .

[27]  Russell R. Barton Design of experiments for fitting subsystem metamodels , 1997, WSC '97.

[28]  Randall P. Sadowski,et al.  Simulation with Arena , 1998 .

[29]  Clark A. Mount-Campbell,et al.  Process optimization via neural network metamodeling , 2002 .

[30]  M. E. Johnson,et al.  A Comparative Study of Tests for Homogeneity of Variances, with Applications to the Outer Continental Shelf Bidding Data , 1981 .

[31]  Jack P. C. Kleijnen,et al.  Validation of Trace-Driven Simulation Models: A Novel Regression Test , 1998 .

[32]  Calmet Meteorological Model A User's Guide for the , 1999 .