The Cross-Entropy Method for Continuous Multi-Extremal Optimization

In recent years, the cross-entropy method has been successfully applied to a wide range of discrete optimization tasks. In this paper we consider the cross-entropy method in the context of continuous optimization. We demonstrate the effectiveness of the cross-entropy method for solving difficult continuous multi-extremal optimization problems, including those with non-linear constraints.

[1]  G. McCormick,et al.  Selected applications of nonlinear programming , 1968 .

[2]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[3]  B. Sheela,et al.  Swift A New constrained optimization technique , 1975 .

[4]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[5]  Klaus Schittkowski,et al.  Nonlinear programming codes , 1980 .

[6]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[7]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[8]  G. Milliken.  Nonlinear Regression Analysis and Its Applications , 1990 .

[9]  R. Kass.  Nonlinear Regression Analysis and its Applications , 1990 .

[10]  Gerhard W. Dueck,et al.  Threshold accepting: a general purpose optimization algorithm appearing superior to simulated anneal , 1990 .

[11]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[12]  Stephen P. Brooks,et al.  Markov Decision Processes. , 1995 .

[13]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[15]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[16]  R. Rubinstein.  The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[17]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[18]  Yu-Chi Ho,et al.  Stochastic Comparison Algorithm for Discrete Optimization with Estimation , 1999, SIAM J. Optim..

[19]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[20]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .

[21]  R. G. Ingalls,et al.  PROCEEDINGS OF THE 2002 WINTER SIMULATION CONFERENCE , 2002 .

[22]  Dirk P. Kroese,et al.  Global likelihood optimization via the cross-entropy method with an application to mixture models , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[23]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[24]  David G. Stork,et al.  Computer Manual in MATLAB to Accompany Pattern Classification, Second Edition , 2004 .

[25]  L. Margolin,et al.  On the Convergence of the Cross-Entropy Method , 2005, Ann. Oper. Res..

[26]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[27]  Dirk P. Kroese,et al.  Application of the cross-entropy method to clustering and vector quantization , 2007, J. Glob. Optim..