An asymptotic allocation for simultaneous simulation experiments

Considers the allocation of a fixed total number of simulation replications among competing design alternatives in order to (i) identify the best simulated design, (ii) intelligently determine the best simulation run lengths for all simulation experiments, and (iii) significantly reduce the total computation cost. An asymptotically optimal allocation rule for maximizing a lower bound of the probability of correct selection is presented. Moreover, we illustrate the efficiency of our method with a series of generic numerical experiments. The simulation cost is significantly reduced with our sequential approach.

[1]  C. Stein.  A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance , 1945 .

[2]  C. Dunnett,et al.  A BIVARIATE GENERALIZATION OF STUDENT'S t-DISTRIBUTION, WITH TABLES FOR CERTAIN SPECIAL CASES , 1954 .

[3]  C. Dunnett,et al.  A TOW-SAMPLE MULTIPLE DECISION PROCEDURE FOR RANKING MEANS OF NORMAL POPULATIONS WITH A COMMON UNKNOWN VARIANCE , 1954 .

[4]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[5]  David Lindley,et al.  Optimal Statistical Decisions , 1971 .

[6]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[7]  R. Bechhofer,et al.  Optimal Allocation of Observations when Comparing Several Treatments with a Control, II: 2-Sided Comparisons , 1972 .

[8]  W. Chiu.  SELECTING THE m POPULATIONS WITH LARGEST MEANS FROM k NORMAL POPULATIONS WITH UNKNOWN VARIANCES , 1974 .

[9]  S. Ross.  A First Course in Probability , 1977 .

[10]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[11]  J. Kleijnen.  Statistical tools for simulation practitioners , 1986 .

[12]  J. Berger,et al.  A Bayesian Approach to Ranking and Selection of Related Means with Alternatives to Analysis-of-Variance Methodology , 1988 .

[13]  S. Gupta,et al.  Statistical decision theory and related topics IV , 1988 .

[14]  Averill M. Law,et al.  Simulation Modeling & Analysis , 1991 .

[15]  Barry L. Nelson,et al.  Methods for selecting the best system , 1991, WSC '91.

[16]  Barry L. Nelson,et al.  Methods for selecting the best system (for simulation) , 1991, 1991 Winter Simulation Conference Proceedings..

[17]  Barry L. Nelson,et al.  Ranking, selection and multiple comparisons in computer simulation , 1994, Proceedings of Winter Simulation Conference.

[18]  Chun-Hung Chen,et al.  An effective approach to smartly allocate computing budget for discrete event simulation , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[19]  A. Tamhane.  Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[20]  Barry L. Nelson,et al.  Two-Stage Multiple Comparisons with the Best for Computer Simulation , 1995, Oper. Res..

[21]  Chun-Hung Chen,et al.  A gradient approach for smartly allocating computing budget for discrete event simulation , 1996, Winter Simulation Conference.

[22]  Chun-Hung Chen.  A lower bound for the correct subset-selection probability and its application to discrete-event system simulations , 1996, IEEE Trans. Autom. Control..

[23]  Chun-Hung Chen,et al.  SIMD parallel discrete-event dynamic system simulation , 1996, IEEE Trans. Control. Syst. Technol..

[24]  J. Hsu.  Multiple Comparisons: Theory and Methods , 1996 .

[25]  Chun-Hung Chen,et al.  New development of optimal computing budget allocation for discrete event simulation , 1997, WSC '97.

[26]  G. Pflug,et al.  Optimal allocation of simulation experiments in discrete stochastic optimization and approximative algorithms , 1997 .

[27]  Stephen E. Chick.  Selecting the best system: a decision-theoretic approach , 1997, WSC '97.

[28]  Stephen E. Chick,et al.  Bayesian analysis for simulation input and output , 1997, WSC '97.

[29]  Stephen E. Chick,et al.  Comparison of Bayesian and frequentist assessments of uncertainty for selecting the best system , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[30]  Chun-Hung Chen,et al.  Computing budget allocation for simulation experiments with different system structures , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[31]  Chun-Hung Chen,et al.  Ordinal comparison of heuristic algorithms using stochastic optimization , 1999, IEEE Trans. Robotics Autom..

[32]  Chun-Hung Chen,et al.  Computing efforts allocation for ordinal optimization and discrete event simulation , 2000, IEEE Trans. Autom. Control..