A new approach to discrete stochastic optimization problems

Solving a discrete stochastic optimization problem involves two efforts: one is to sample and search the design space; and the other is to estimate the performance values of the sampled designs. When the amount of computational resources is limited, we need to know how to balance these two efforts in order to obtain the best result. In this paper, two performance measures which quantify the marginal contribution of the searching process as well as the performance evaluation process are proposed. Using these two measures, we recommend a framework that can dynamically allocate the computational resources to the search process and the performance evaluation process. Two algorithms based on the proposed framework are tested on several scenarios, and the results produced are very promising.

[1]  Yu-Chi Ho,et al.  The no free lunch theorems: complexity and security , 2003, IEEE Trans. Autom. Control..

[2]  Leyuan Shi,et al.  Nested Partitions Method for Global Optimization , 2000, Oper. Res..

[3]  Loo Hay Lee,et al.  Explanation of goal softening in ordinal optimization , 1999, IEEE Trans. Autom. Control..

[4]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[5]  S. Mitter,et al.  Simulated annealing with noisy or imprecise energy measurements , 1989 .

[6]  Yu-Chi Ho,et al.  An ordinal optimization approach to optimal control problems , 1999, Autom..

[7]  Mahmoud H. Alrefaei,et al.  A modification of the stochastic ruler method for discrete stochastic optimization , 2001, Eur. J. Oper. Res..

[8]  Chun-Hung Chen,et al.  Computing efforts allocation for ordinal optimization and discrete event simulation , 2000, IEEE Trans. Autom. Control..

[9]  Leyuan Shi A New Algorithm for Stochastic Discrete Resource Allocation Optimization , 2000, Discret. Event Dyn. Syst..

[10]  C. Cassandras,et al.  Ordinal optimization for a class of deterministic and stochastic discrete resource allocation problems , 1998, IEEE Trans. Autom. Control..

[11]  Chun-Hung Chen,et al.  Ordinal comparison of heuristic algorithms using stochastic optimization , 1999, IEEE Trans. Robotics Autom..

[12]  L. Dai Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems , 1995 .

[13]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Yu-Chi Ho,et al.  An Explanation of Ordinal Optimization: Soft Computing for hard Problems , 1999, Inf. Sci..

[16]  Yu-Chi Ho,et al.  Stochastic Comparison Algorithm for Discrete Optimization with Estimation , 1999, SIAM J. Optim..

[17]  Yu-Chi Ho,et al.  On the numerical solutions of stochastic optimization problem , 1997, IEEE Trans. Autom. Control..