The Cross-Entropy Method

The cross-entropy method is a recent versatile Monte Carlo technique. This article provides a brief introduction to the cross-entropy method and discusses how it can be used for rare-event probability estimation and for solving combinatorial, continuous, constrained and noisy optimization problems. A comprehensive list of references on cross-entropy methods and applications is included.

[1]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[2]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[3]  M. R. Rao,et al.  Combinatorial Optimization , 1997, The Computer Science and Engineering Handbook.

[4]  Reuven Y. Rubinstein,et al.  Modern simulation and modeling , 1998 .

[5]  R. Rubinstein The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[6]  Pieter Tjerk de Boer,et al.  Analysis and efficient simulation of queueing models of telecommunications systems , 2000 .

[7]  Bjarne E. Helvik,et al.  Using the Cross-Entropy Method to Guide/Govern Mobile Agent's Path Finding in Networks , 2001, MATA.

[8]  R. Rubinstein Combinatorial Optimization, Cross-Entropy, Ants and Rare Events , 2001 .

[9]  Dirk P. Kroese,et al.  Sequence alignment by rare event simulation , 2002, Proceedings of the Winter Simulation Conference.

[10]  Shie Mannor,et al.  The Cross Entropy Method for Fast Policy Search , 2003, ICML.

[11]  Tim Hesterberg,et al.  Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control , 2004, Technometrics.

[12]  Dirk P. Kroese,et al.  Global likelihood optimization via the cross-entropy method with an application to mixture models , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[13]  Dirk P. Kroese,et al.  The Transform Likelihood Ratio Method for Rare Event Simulation with Heavy Tails , 2004, Queueing Syst. Theory Appl..

[14]  Dirk P. Kroese,et al.  Combinatorial Optimization via Cross-Entropy , 2004 .

[15]  Arnaud Doucet,et al.  The cross-entropy method for blind multiuser detection , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[16]  Dirk P. Kroese,et al.  A Fast Cross-Entropy Method for Estimating Buffer Overflows in Queueing Networks , 2004, Manag. Sci..

[17]  Dirk P. Kroese,et al.  HEAVY TAILS, IMPORTANCE SAMPLING AND CROSS–ENTROPY , 2005 .

[18]  Dirk P. Kroese,et al.  Application of the Cross-Entropy Method to the Buffer Allocation Problem in a Simulation-Based Environment , 2005, Ann. Oper. Res..

[19]  Avraham Shtub,et al.  Managing Stochastic, Finite Capacity, Multi-Project Systems through the Cross-Entropy Methodology , 2005, Ann. Oper. Res..

[20]  Ad Ridder,et al.  Importance Sampling Simulations of Markovian Reliability Systems Using Cross-Entropy , 2005, Ann. Oper. Res..

[21]  Shie Mannor,et al.  Basis Function Adaptation in Temporal Difference Reinforcement Learning , 2005, Ann. Oper. Res..

[22]  L. Margolin,et al.  On the Convergence of the Cross-Entropy Method , 2005, Ann. Oper. Res..

[23]  Dirk P. Kroese,et al.  Designing an Optimal Network Using the Cross-Entropy Method , 2005, IDEAL.

[24]  Miro Kraetzl,et al.  The Cross-Entropy Method for Network Reliability Estimation , 2005, Ann. Oper. Res..

[25]  M. Caserta,et al.  A Cross-Entropy Based Algorithm for Combinatorial Optimization Problems , 2005 .

[26]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[27]  S. Nariai,et al.  On the design of multi-type networks via the cross-entropy method , 2005, DRCN 2005). Proceedings.5th International Workshop on Design of Reliable Communication Networks, 2005..

[28]  Tito Homem-de-Mello,et al.  Solving the Vehicle Routing Problem with Stochastic Demands using the Cross-Entropy Method , 2005, Ann. Oper. Res..

[29]  Lih-Yuan Deng,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.

[30]  Dirk P. Kroese,et al.  The Cross-Entropy Method for Continuous Multi-Extremal Optimization , 2006 .