An asymptotic allocation for simultaneous simulation experiments

Considers the allocation of a fixed total number of simulation replications among competing design alternatives in order to (i) identify the best simulated design, (ii) intelligently determine the best simulation run lengths for all simulation experiments, and (iii) significantly reduce the total computation cost. An asymptotically optimal allocation rule for maximizing a lower bound of the probability of correct selection is presented. Moreover, we illustrate the efficiency of our method with a series of generic numerical experiments. The simulation cost is significantly reduced with our sequential approach.

[1]  C. Stein.  A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance , 1945 .

[2]  C. Dunnett,et al.  A BIVARIATE GENERALIZATION OF STUDENT'S t-DISTRIBUTION, WITH TABLES FOR CERTAIN SPECIAL CASES , 1954 .

[3]  C. Dunnett,et al.  A TOW-SAMPLE MULTIPLE DECISION PROCEDURE FOR RANKING MEANS OF NORMAL POPULATIONS WITH A COMMON UNKNOWN VARIANCE , 1954 .

[4]  David Lindley,et al.  Optimal Statistical Decisions , 1971 .

[5]  Bruce W. Turnbull,et al.  Optimal Allocation of Observations When Comparing Several Treatments with a Control. III: Globally Best One-Sided Intervals for Unequal Variances. , 1971 .

[6]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[7]  W. Chiu.  SELECTING THE m POPULATIONS WITH LARGEST MEANS FROM k NORMAL POPULATIONS WITH UNKNOWN VARIANCES , 1974 .

[8]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[9]  John S. Carson,et al.  Multiple Decision Procedures: Theory and Methodology of Selecting and Ranking Populations , 1981 .

[10]  S. Gupta,et al.  Statistical decision theory and related topics IV , 1988 .

[11]  Averill M. Law,et al.  Simulation Modeling & Analysis , 1991 .

[12]  Barry L. Nelson,et al.  Methods for selecting the best system , 1991, WSC '91.

[13]  Barry L. Nelson,et al.  Ranking, selection and multiple comparisons in computer simulation , 1994, Proceedings of Winter Simulation Conference.

[14]  Chun-Hung Chen,et al.  An effective approach to smartly allocate computing budget for discrete event simulation , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[15]  Barry L. Nelson,et al.  Two-Stage Multiple Comparisons with the Best for Computer Simulation , 1995, Oper. Res..

[16]  Chun-Hung Chen,et al.  A gradient approach for smartly allocating computing budget for discrete event simulation , 1996, Proceedings Winter Simulation Conference.

[17]  Chun-Hung Chen.  A lower bound for the correct subset-selection probability and its application to discrete-event system simulations , 1996, IEEE Trans. Autom. Control..

[18]  Chun-Hung Chen,et al.  SIMD parallel discrete-event dynamic system simulation , 1996, IEEE Trans. Control. Syst. Technol..

[19]  J. Hsu.  Multiple Comparisons: Theory and Methods , 1996 .

[20]  Chun-Hung Chen,et al.  New development of optimal computing budget allocation for discrete event simulation , 1997, WSC '97.

[21]  G. Pflug,et al.  Optimal allocation of simulation experiments in discrete stochastic optimization and approximative algorithms , 1997 .

[22]  Stephen E. Chick.  Selecting the best system: a decision-theoretic approach , 1997, WSC '97.

[23]  S. Chick.  Bayesian Analysis For Simulation Input And Output , 1997, Winter Simulation Conference Proceedings,.

[24]  Stephen E. Chick,et al.  Comparison of Bayesian and frequentist assessments of uncertainty for selecting the best system , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[25]  Chun-Hung Chen,et al.  Computing budget allocation for simulation experiments with different system structures , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[26]  Chun-Hung Chen,et al.  Ordinal comparison of heuristic algorithms using stochastic optimization , 1999, IEEE Trans. Robotics Autom..

[27]  Chun-Hung Chen,et al.  Computing efforts allocation for ordinal optimization and discrete event simulation , 2000, IEEE Trans. Autom. Control..