New procedures for selection among (simulated) alternatives

“Ranking and selection” procedures were developed for use in situations where the experimenter's goal is to “select the best” (selection) or to “rank competing alternatives” (ranking). These are typical goals when a simulation study is performed, often in order to select that one of several procedures (for running a real-world system) which is best (with regard to a specified criterion of goodness). Therefore these procedures have become a standard analysis method in simulation work in recent years (e.g., see the references in (8)). In this paper we: review some of the selection procedures most often found useful in design and analysis of simulation experiments; discuss some other important procedures and related problems; and state some unsolved statistical problems of importance in simulation work.

[1]  Jason C. Hsu,et al.  Subset selection procedures with special reference to the analysis of two-way layout: Application to motor-vehicle fatality data , 1977, WSC '77.

[2]  Edward J. Dudewicz,et al.  Statistics in simulation: How to design for selecting the best alternative , 1976, WSC '76.

[3]  Robert E. Bechhofer,et al.  Selection in factorial experiments , 1977, WSC '77.

[4]  E. Ziegel.  Introduction to Statistics and Probability , 1978 .

[5]  V. S. Bawa.  Asymptotic Efficiency of One R-Factor Experiment Relative to R One-Factor Experiments for Selecting the Best Normal Population , 1972 .

[6]  Milton Sobel,et al.  Nonparametric Procedures for Selecting the $t$ Population with the Largest $\alpha$-Quantiles , 1967 .

[7]  E. Dudewicz,et al.  Introduction to statistics and probability , 1977 .

[8]  Milton Sobel.  Selecting the population with the smallest dispersion in a nonparametric setting , 1977, WSC '77.

[9]  R. Bechhofer.  A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with known Variances , 1954 .

[10]  E. Dudewicz,et al.  New Tables for Multiple Comparisons With a Control (Unknown Variances) , 1975 .

[11]  Sandra A. Mamrak,et al.  Statistical Methods for Comparing Computer Services , 1977, Computer.

[12]  Gary C. McDonald.  Nonparametric selection procedures applied to state traffic fatality rates , 1978, SIML.

[13]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[14]  Hubert J. Chen.  Estimation of the best alternative , 1977, WSC '77.

[15]  Young Jack Lee.  Winner selection , 1977, WSC '77.