Selecting the optimum by searching and ranking procedures in simulation based optimization

Given a set of competing system alternatives to be evaluated and compared via simulation, Ranking and Selection (R&S) procedures are commonly applied to select the best system with respect to a predefined performance measure. In this paper we focus on two major classes of R&S techniques usually referred to as the subset selection and indifference-zone formulations. In particular, we discuss the performance of primitive and combined procedures that, at every iteration, evaluate different system configurations by sampling multiple or single additional simulation output observations to deal with complex systems. Procedure application is presented for different test cases in which either a small number of system configurations are known a priori or a large number of configurations are actually generated during simulation run by means of simulation-based optimization algorithms. Preliminary numerical results are given with reference to performance measures within the sub-systems of a realworld complex logistic system.

[1]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[2]  Andrei A. Prudius.  Adaptive Random Search Methods for Simulation Optimization , 2007 .

[3]  Ward Whitt,et al.  Estimating the asymptotic variance with batch means , 1991, Oper. Res. Lett..

[4]  Sigurdur Olafsson,et al.  Simulation optimization , 2002, Proceedings of the Winter Simulation Conference.

[5]  Barry L. Nelson,et al.  Selecting the best system: theory and methods , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[6]  Pasquale Legato,et al.  An Integrated Simulation Model For Channel Contention And Berth Management At A Maritime Container Terminal , 2007 .

[7]  Roberto Musmanno,et al.  A queuing network model for the management of berth crane operations , 2008, Comput. Oper. Res..

[8]  L. Schruben,et al.  Properties of standardized time series weighted area variance estimators , 1990 .

[9]  R. Wilcox.  A Table for Rinott's Selection Procedure , 1984 .

[10]  van der,et al.  Proceedings of the 2012 winter simulation conference , 2001, WSC 2008.

[11]  M. Bartlett.  Properties of Sufficiency and Statistical Tests , 1992 .

[12]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[13]  Halim Damerdji,et al.  Strong Consistency of the Variance Estimator in Steady-State Simulation Output Analysis , 1994, Math. Oper. Res..

[14]  李幼升,et al.  Ph , 1989 .

[15]  Pasquale Legato,et al.  Yard Crane Management by Simulation and Optimisation , 2009 .

[16]  Ingram Olkin,et al.  An Introduction to Ranking and Selection , 1979 .

[17]  Barry L. Nelson,et al.  Ranking and Selection for Steady-State Simulation: Procedures and Perspectives , 2002, INFORMS J. Comput..

[18]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[19]  Sigrún Andradóttir,et al.  A review of simulation optimization techniques , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[20]  A. Tamhane.  Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[21]  Natalie M. Steiger,et al.  Output analysis: ASAP2: an improved batch means procedure for simulation output analysis , 2002, WSC '02.

[22]  Bruce W. Schmeiser,et al.  Overlapping batch means: something for nothing? , 1984, WSC '84.

[23]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[24]  Demetrio Laganà,et al.  Solving simulation optimization problems on grid computing systems , 2006, Parallel Comput..

[25]  Barry L. Nelson,et al.  Selecting the best system when systems are revealed sequentially , 2007 .

[26]  J. Susan Milton,et al.  Probability and statistics in the engineering and computing sciences , 1986 .

[27]  J. Banks,et al.  Handbook of Simulation , 1998 .

[28]  B. Schmeiser,et al.  Optimal mean-squared-error batch sizes , 1995 .

[29]  Pasquale Legato,et al.  Simulation-based optimization for the quay crane scheduling problem , 2008, 2008 Winter Simulation Conference.

[30]  S. Gupta.  On Some Multiple Decision (Selection and Ranking) Rules , 1965 .

[31]  W. David Kelton,et al.  Sequential selection procedures: Using sample means to improve efficiency , 2005, Eur. J. Oper. Res..

[32]  Sigrún Andradóttir,et al.  Simulation optimization using balanced explorative and exploitative search , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[33]  Talal M. Alkhamis,et al.  Simulation-based optimization using simulated annealing with ranking and selection , 2002, Comput. Oper. Res..

[34]  Sigrún Andradóttir,et al.  Two simulated annealing algorithms for noisy objective functions , 2005, Proceedings of the Winter Simulation Conference, 2005..