An Improved Cross-Entropy Method Applied to Inverse Problems

An improved cross-entropy method for global optimizations of inverse problems with continuous variables is proposed. To enhance the convergence speed, improvements on both algorithm development and iterative process are introduced. To monitor and guide the searching process, the design space is divided into subdomains and three indicators are assigned for each subdomain in order to evaluate its performances. To balance exploitation and exploration searches, the whole iterative process is divided a diversification and an intensification phase. In the diversification phase, a novel mechanism is introduced to increase the sampling diversity to avoid the solution being trapped onto a local optimum; in the intensification phase, the strategy of shifting away from the worst subdomains equips the algorithm with enhanced convergence rates. The proposed method is applied to a mathematical function and the TEAM Workshop problem 22. Comparisons with its counterparts are made to demonstrate the effectiveness of the proposed work.

[1]  S. Brisset,et al.  A new tabu search method for optimization with continuous parameters , 2004, IEEE Transactions on Magnetics.

[2]  Xianyi Zeng,et al.  A learning automata based algorithm for optimization of continuous complex functions , 2005, Inf. Sci..

[3]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[4]  Dirk P. Kroese,et al.  The Cross-Entropy Method for Continuous Multi-Extremal Optimization , 2006 .

[5]  Dirk P. Kroese,et al.  Network Reliability Optimization via the Cross-Entropy Method , 2007, IEEE Transactions on Reliability.

[6]  Adnan Acan,et al.  Multi-objective optimization with cross entropy method: Stochastic learning with clustered pareto fronts , 2007, 2007 IEEE Congress on Evolutionary Computation.

[7]  K.W.E. Cheng,et al.  An Efficient Tabu Search Algorithm for Robust Solutions of Electromagnetic Design Problems , 2008, IEEE Transactions on Magnetics.

[8]  Margareta Stefanovic,et al.  Cross Entropy Accelerated Ant Routing in satellite networks , 2010, Proceedings of the 2010 American Control Conference.

[9]  M. Repetto,et al.  Multiobjective optimization in magnetostatics: a proposal for benchmark problems , 1996 .

[10]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[11]  Jianguo Zhu,et al.  Sequential Optimization Method for the Design of Electromagnetic Device , 2008, IEEE Transactions on Magnetics.

[12]  Shiyou Yang,et al.  The Cross-Entropy Method and Its Application to Inverse Problems , 2010, IEEE Transactions on Magnetics.