An efficient simulation procedure for ranking the top simulated designs in the presence of stochastic constraints

This research considers the problem of ranking the top simulated designs in the presence of stochastic constraints. The objective and constraint measures of each design must be estimated via simulation. Given a fixed simulation budget, the ranking of the top feasible designs cannot be determined with certainty. The objective of this research is to derive an efficient simulation budget allocation strategy such that the probability of correct ranking (PCR) can be maximized. To deal with this problem, we propose a lower bound on the PCR and develop an asymptotically optimal allocation rule based on the lower bound. Useful insights on characterizing the allocation rule are provided, and numerical experiments are carried out to demonstrate the efficiency of the suggested simulation procedure.

[1]  Susan R. Hunter,et al.  Optimal Sampling Laws for Stochastically Constrained Simulation Optimization on Finite Sets , 2013, INFORMS J. Comput..

[2]  Weiwei Chen,et al.  Efficient Feasibility Determination With Multiple Performance Measure Constraints , 2017, IEEE Transactions on Automatic Control.

[3]  Hui Xiao,et al.  Simulation optimization using genetic algorithms with optimal computing budget allocation , 2014, Simul..

[4]  Hui Xiao,et al.  Optimal Computing Budget Allocation for Complete Ranking , 2014, IEEE Transactions on Automation Science and Engineering.

[5]  A. Tamhane Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[6]  Weiwei Chen,et al.  Efficient subset selection for the expected opportunity cost , 2015, Autom..

[7]  Yijie Peng,et al.  Efficient Simulation Resource Sharing and Allocation for Selecting the Best , 2013, IEEE Transactions on Automatic Control.

[8]  Jürgen Branke,et al.  Selecting a Selection Procedure , 2007, Manag. Sci..

[9]  Lee W. Schruben,et al.  Analysis methodology: are we done? [discrete-event simulation] , 2005, Proceedings of the Winter Simulation Conference, 2005..

[10]  Weiwei Chen,et al.  A new budget allocation framework for selecting top simulated designs , 2016 .

[11]  Seong-Hee Kim,et al.  Finding feasible systems in the presence of constraints on multiple performance measures , 2010, TOMC.

[12]  Loo Hay Lee,et al.  A Simulation Budget Allocation Procedure for Enhancing the Efficiency of Optimal Subset Selection , 2016, IEEE Transactions on Automatic Control.

[13]  Jun Luo,et al.  Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments , 2015, Oper. Res..

[14]  Loo Hay Lee,et al.  Approximate Simulation Budget Allocation for Selecting the Best Design in the Presence of Stochastic Constraints , 2012, IEEE Transactions on Automatic Control.

[15]  Loo Hay Lee,et al.  Simulation optimization in the era of Industrial 4.0 and the Industrial Internet , 2016, J. Simulation.

[16]  Loo Hay Lee,et al.  Simulation Optimization: A Review and Exploration in the New Era of Cloud Computing and Big Data , 2015, Asia Pac. J. Oper. Res..

[17]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[18]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[19]  Hui Xiao,et al.  Optimal computing budget allocation for ranking the top designs with stochastic constraints , 2017, 2017 Winter Simulation Conference (WSC).

[20]  Qing-Shan Jia,et al.  Efficient computing budget allocation for finding simplest good designs , 2013, IIE transactions : industrial engineering research & development.

[21]  Barry L. Nelson,et al.  A fully sequential procedure for indifference-zone selection in simulation , 2001, TOMC.

[22]  Sigrún Andradóttir,et al.  Selection Procedures for Simulations with Multiple Constraints under Independent and Correlated Sampling , 2014, TOMC.

[23]  Enver Yücesan,et al.  A new perspective on feasibility determination , 2008, 2008 Winter Simulation Conference.

[24]  Leyuan Shi,et al.  Selecting the Best Simulated Design With the Expected Opportunity Cost Bound , 2015, IEEE Transactions on Automatic Control.

[25]  S. Andradóttir,et al.  Fully sequential procedures for comparing constrained systems via simulation , 2010 .

[26]  Loo Hay Lee,et al.  Stochastically Constrained Ranking and Selection via SCORE , 2014, ACM Trans. Model. Comput. Simul..