On Computing Budget Allocation for Finding the Simplest Good Enough Design

Abstract Many systems in nowadays follow not only physical laws but also man-made rules. These systems are known as discrete-event dynamic systems (DEDS's). Due to various advantages in practice, designs (or solution candidates) with low descriptive complexities (called simple designs) are usually preferred than complex ones when their performances are close. However, the descriptive complexity is usually nonlinear and takes discrete value, which makes traditional methods such as linear programming and gradient-based local search not applicable. Existing methods for simulation-based optimization (SBO) barely explore the preference on descriptive complexity and thus do not solve the problem efficiently. In this paper, the problem of computing budget allocation for finding the simplest good enough design is considered. Equal allocation (EA), optimal computing budget allocation (OCBA), and OCBA-m are compared over multiple numerical examples. Surprisingly, EA has good performance in general, though not necessarily optimal. All three methods are then applied to solve a node activation policy optimization problem in a wireless sensor network. EA again has good performance. We hope this work can shed some insight on how to find simple and good designs in general.

[1]  R. Bechhofer A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with known Variances , 1954 .

[2]  S. Gupta On Some Multiple Decision (Selection and Ranking) Rules , 1965 .

[3]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[4]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[5]  M. Degroot Optimal Statistical Decisions , 1970 .

[6]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[7]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[8]  Yu-Chi Ho,et al.  Ordinal optimization of DEDS , 1992, Discret. Event Dyn. Syst..

[9]  L. Dai Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems , 1995 .

[10]  A. Tamhane Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[11]  Chun-Hung Chen A lower bound for the correct subset-selection probability and its application to discrete-event system simulations , 1996, IEEE Trans. Autom. Control..

[12]  Xiaolan Xie Dynamics and convergence rate of ordinal comparison of stochastic discrete-event systems , 1997, IEEE Trans. Autom. Control..

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[15]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[16]  Michael C. Fu,et al.  Feature Article: Optimization for simulation: Theory vs. Practice , 2002, INFORMS J. Comput..

[17]  Sigurdur Olafsson,et al.  Simulation optimization , 2002, Proceedings of the Winter Simulation Conference.

[18]  Michael C. Fu,et al.  Optimization for Simulation: Theory vs. Practice , 2002 .

[19]  Barry L. Nelson,et al.  Selecting the best system: theory and methods , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[20]  Enver Yücesan,et al.  Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey , 2003, TOMC.

[21]  Lee W. Schruben,et al.  A survey of recent advances in discrete input parameter discrete-event simulation optimization , 2004 .

[22]  Ihsan Sabuncuoglu,et al.  Simulation optimization: A comprehensive review on theory and applications , 2004 .

[23]  Chun-Hung Chen,et al.  An alternative simulation budget allocation scheme for efficient simulation , 2005, Int. J. Simul. Process. Model..

[24]  Marcus Hutter,et al.  Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability (Texts in Theoretical Computer Science. An EATCS Series) , 2006 .

[25]  Y. Ho,et al.  Ordinal Optimization: Soft Optimization for Hard Problems , 2007 .

[26]  Loo Hay Lee,et al.  Efficient Simulation Budget Allocation for Selecting an Optimal Subset , 2008, INFORMS J. Comput..

[27]  Leyuan Shi,et al.  Some topics for simulation optimization , 2008, 2008 Winter Simulation Conference.

[28]  Koushik Kar,et al.  Near-optimal activation policies in rechargeable sensor networks under spatial correlations , 2008, TOSN.

[29]  Qing-Shan Jia,et al.  Strategy optimization for controlled Markov process with descriptive complexity constraint , 2009, Science in China Series F: Information Sciences.

[30]  Qing-Shan Jia,et al.  An adaptive sampling algorithm for simulation-based optimization with descriptive complexity constraints , 2009, 2009 IEEE Youth Conference on Information, Computing and Telecommunication.

[31]  Chun-Hung Chen,et al.  Efficient simulation budget allocation for selecting the best set of simplest good enough designs , 2010, Proceedings of the 2010 Winter Simulation Conference.

[32]  Qing-Shan Jia,et al.  On State Aggregation to Approximate Complex Value Functions in Large-Scale Markov Decision Processes , 2011, IEEE Transactions on Automatic Control.