论文信息 - A Stochastic Minimum Cross-Entropy Method for Combinatorial Optimization and Rare-event Estimation*

A Stochastic Minimum Cross-Entropy Method for Combinatorial Optimization and Rare-event Estimation*

We present a new method, called the minimum cross-entropy (MCE) method for approximating the optimal solution of NP-hard combinatorial optimization problems and rare-event probability estimation, which can be viewed as an alternative to the standard cross entropy (CE) method. The MCE method presents a generic adaptive stochastic version of Kull-back’s classic MinxEnt method. We discuss its similarities and differences with the standard cross-entropy (CE) method and prove its convergence. We show numerically that MCE is a little more accurate than CE, but at the same time a little slower than CE. We also present a new method for trajectory generation for TSP and some related problems. We finally give some numerical results using MCE for rare-events probability estimation for simple static models, the maximal cut problem and the TSP, and point out some new areas of possible applications.

R. Rubinstein

[1] J. Shore,et al. Minimum cross-entropy spectral analysis of multiple signals , 1983 .

[2] David E. Goldberg,et al. Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3] D. E. Goldberg,et al. Genetic Algorithms in Search , 1989 .

[4] Thomas M. Cover,et al. Elements of Information Theory , 2005 .

[5] Reuven Y. Rubinstein,et al. Modern simulation and modeling , 1998 .

[6] R. Rubinstein. The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[7] Jun S. Liu,et al. Monte Carlo strategies in scientific computing , 2001 .

[8] Reuven Y. Rubinstein,et al. Cross-entropy and rare events for maximal cut and partition problems , 2002, TOMC.

[9] Ehl Emile Aarts,et al. Simulated annealing and Boltzmann machines , 2003 .

[10] David H. Wolpert,et al. Information Theory - The Bridge Connecting Bounded Rational Game Theory and Statistical Physics , 2004, ArXiv.

[11] Shie Mannor,et al. A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[12] Lih-Yuan Deng,et al. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.