Computing budget allocation for simulation experiments with different system structures

Simulation plays a vital role in analyzing discrete event systems, particularly in comparing alternative system designs with a view to optimize system performance. Using simulation to analyze complex systems, however, can be both prohibitively expensive and time consuming. We present effective algorithms to intelligently allocate computing budget for discrete event simulation experiments with different system structures. These algorithms dynamically determine the best simulation lengths for all simulation experiments and thus significantly reduce the total computation cost for a desired confidence level. Numerical illustrations are included. We also compare our algorithms with our earlier approach in which different system structures are not considered. Numerical testing shows that we can further improve simulation efficiency.

[1]  Chun-Hung Chen,et al.  A gradient approach for smartly allocating computing budget for discrete event simulation , 1996, Winter Simulation Conference.

[2]  Stephen E. Chick.  Selecting the best system: a decision-theoretic approach , 1997, WSC '97.

[3]  A. Tamhane.  Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[4]  D. Berry.  Statistical Decision Theory, Foundations, Concepts, and Methods , 1982 .

[5]  Mingyuan Chen,et al.  A mathematical programming model for system reconfiguration in a dynamic cellular manufacturing environment , 1998, Ann. Oper. Res..

[6]  Barry L. Nelson,et al.  Methods for selecting the best system (for simulation) , 1991, 1991 Winter Simulation Conference Proceedings..

[7]  Chun-Hung Chen,et al.  New development of optimal computing budget allocation for discrete event simulation , 1997, WSC '97.

[8]  Barry L. Nelson,et al.  Two-Stage Multiple Comparisons with the Best for Computer Simulation , 1995, Oper. Res..

[9]  S. Panchapakesan,et al.  Multiple Decision Procedures: Theory and Methology of Selecting and Ranking Populations. John Wiley, Chichester (1979), £20.00 , 1980 .

[10]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[11]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[12]  Chun-Hung Chen.  A lower bound for the correct subset-selection probability and its application to discrete-event system simulations , 1996, IEEE Trans. Autom. Control..

[13]  Bruce W. Schmeiser,et al.  Batch Size Effects in the Analysis of Simulation Output , 1982, Oper. Res..

[14]  Barry L. Nelson,et al.  Simultaneous Ranking, Selection and Multiple Comparisons for Simulation , 1993, Proceedings of 1993 Winter Simulation Conference - (WSC '93).

[15]  Stephen E. Chick,et al.  Comparison of Bayesian and frequentist assessments of uncertainty for selecting the best system , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[16]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[17]  W. Chiu.  The ranking of means of normal populations for a generalized selection goal , 1974 .

[18]  Chun-Hung Chen,et al.  An effective approach to smartly allocate computing budget for discrete event simulation , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[19]  Barry L. Nelson,et al.  Ranking, selection and multiple comparisons in computer simulation , 1994, Proceedings of Winter Simulation Conference.

[20]  Barry L. Nelson,et al.  Methods for selecting the best system , 1991, WSC '91.

[21]  S. Gupta,et al.  Statistical decision theory and related topics IV , 1988 .

[22]  J. Berger,et al.  A Bayesian Approach to Ranking and Selection of Related Means with Alternatives to Analysis-of-Variance Methodology , 1988 .

[23]  Peter R. Nelson,et al.  Multiple Comparisons: Theory and Methods , 1997 .