A Simulation Budget Allocation Procedure for Finding Both Extreme Designs Simultaneously in Discrete-Event Simulation

Although discrete-event simulation has been widely used in various engineering fields, its efficiency remains an issue. Ranking and selection (R&S) procedures can solve this efficiency problem by allocating a limited simulation budget intelligently. While the existing R&S procedures mostly aim to find only the best simulation input design, practitioners sometimes require the worst design as well to analyze systems requiring high reliability, such as military systems, municipal waste management, etc. Motivated by these practical needs, we propose a simulation budget allocation procedure for selecting both extreme designs simultaneously in the presence of large stochastic noise. To maximize the accuracy of the selections under a limited budget, the proposed procedure sequentially allocates a small budget and updates the simulation results such that they can be used as significant evidence for the correct selections. Our experimental results on benchmark and practical problems demonstrate improved efficiency compared to previous works. It is expected that the proposed procedure will be effectively utilized in the fields of the fourth industrial revolution, such as digital twins that demand quickly finding both extreme designs to maintain synchronization with the corresponding real systems.

[1]  MengChu Zhou,et al.  Approximate Simulation Budget Allocation for Subset Ranking , 2017, IEEE Transactions on Control Systems Technology.

[2]  Loo Hay Lee,et al.  Simulation optimization using the Particle Swarm Optimization with optimal computing budget allocation , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[3]  T. Peters,et al.  Best--worst scaling: What it can do for health care research and how to do it. , 2007, Journal of health economics.

[4]  Guangli Zhu,et al.  Stochastic Process and Simulation of Traction Load for High Speed Railways , 2019, IEEE Access.

[5]  Hui Xiao,et al.  Optimal Computing Budget Allocation for Complete Ranking , 2014, IEEE Transactions on Automation Science and Engineering.

[6]  Marina Schmid,et al.  Design And Analysis Of Experiments For Statistical Selection Screening And Multiple Comparisons , 2016 .

[7]  Hui Xiao,et al.  An efficient simulation procedure for ranking the top simulated designs in the presence of stochastic constraints , 2019, Autom..

[8]  Leyuan Shi,et al.  A Sequential Budget Allocation Framework for Simulation Optimization , 2017, IEEE Transactions on Automation Science and Engineering.

[9]  Tag Gon Kim,et al.  Enhancing the Noise Robustness of the Optimal Computing Budget Allocation Approach , 2020, IEEE Access.

[10]  Tag Gon Kim,et al.  An Improved Budget Allocation Procedure for Selecting the Best-Simulated Design in the Presence of Large Stochastic Noise , 2019, IEEE Access.

[11]  Rajesh Devaraj,et al.  A hybrid offline-online approach to adaptive downlink resource allocation over LTE , 2019, IEEE/CAA Journal of Automatica Sinica.

[12]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[13]  Jingde Cheng,et al.  Adaptive Evaluation of Virtual Machine Placement and Migration Scheduling Algorithms Using Stochastic Petri Nets , 2019, IEEE Access.

[14]  Alexander M. Wyglinski,et al.  Vehicular Network Simulation Environment via Discrete Event System Modeling , 2019, IEEE Access.

[15]  Tag Gon Kim,et al.  Model-Based Design of Defense Cyber-Physical Systems to Analyze Mission Effectiveness and Network Performance , 2019, IEEE Access.

[16]  MengChu Zhou,et al.  Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs , 2017, IEEE Transactions on Automatic Control.

[17]  Barry L. Nelson,et al.  A fully sequential procedure for indifference-zone selection in simulation , 2001, TOMC.

[18]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[19]  Loo Hay Lee,et al.  Simulation Optimization: A Review and Exploration in the New Era of Cloud Computing and Big Data , 2015, Asia Pac. J. Oper. Res..

[20]  MengChu Zhou,et al.  Incorporation of Optimal Computing Budget Allocation for Ordinal Optimization Into Learning Automata , 2016, IEEE Transactions on Automation Science and Engineering.

[21]  Jürgen Branke,et al.  Selecting a Selection Procedure , 2007, Manag. Sci..

[22]  Hui Xiao,et al.  Simulation budget allocation for simultaneously selecting the best and worst subsets , 2017, Autom..

[23]  Tag Gon Kim,et al.  Accelerated Simulation of Discrete Event Dynamic Systems via a Multi-Fidelity Modeling Framework , 2017 .

[24]  Tag Gon Kim,et al.  Efficient Ranking and Selection for Stochastic Simulation Model Based on Hypothesis Test , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.