A Simple Multi-Objective Optimization Based on the Cross-Entropy Method

A simple multi-objective cross-entropy method is presented in this paper, with only four parameters that facilitate the initial setting and tuning of the proposed strategy. The effects of these parameters on improved performance are analyzed on the basis of well-known test suites. The histogram interval number and the elite fraction had no significant influence on the execution time, so their respective values could be selected to maximize the quality of the Pareto front. On the contrary, the epoch number and the working population size had an impact on both the execution time and the quality of the Pareto front. Studying the rationale behind this behavior, we obtained clear guidelines for setting the most appropriate values, according to the characteristics of the problem under consideration. Moreover, the suitability of this method is analyzed based on a comparative study with other multi-objective optimization strategies. While the behavior of simple test suites was similar to all methods under consideration, the proposed algorithm outperformed the other methods considered in this paper in complex problems, with many decision variables. Finally, the efficiency of the proposed method is corroborated in a real case study represented by a two-objective optimization of the microdrilling process. The proposed strategy performed better than the other methods with a higher hyperarea and a shorter execution time.

[1]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[2]  Gary B. Lamont,et al.  Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art , 2000, Evolutionary Computation.

[3]  Noureddine Henini,et al.  Multiobjective Optimization Using Cross-Entropy Approach , 2013 .

[4]  Lajos Hanzo,et al.  Quantum-Assisted Routing Optimization for Self-Organizing Networks , 2014, IEEE Access.

[5]  Gerardo Beruvides,et al.  Artificial cognitive control with self-x capabilities: A case study of a micro-manufacturing process , 2015, Comput. Ind..

[6]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[7]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[8]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[9]  Dirk P. Kroese,et al.  The Cross-Entropy Method for Continuous Multi-Extremal Optimization , 2006 .

[10]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[11]  Orizon Pereira Ferreira,et al.  A subgradient method for multiobjective optimization , 2013, Comput. Optim. Appl..

[12]  Miguel A. Olivares-Méndez,et al.  Cross-Entropy Optimization for Scaling Factors of a Fuzzy Controller: A See-and-Avoid Approach for Unmanned Aerial Systems , 2013, J. Intell. Robotic Syst..

[13]  Stefan Preitl,et al.  Adaptive GSA-Based Optimal Tuning of PI Controlled Servo Systems With Reduced Process Parametric Sensitivity, Robust Stability and Controller Robustness , 2014, IEEE Transactions on Cybernetics.

[14]  Aihua Zhou,et al.  Distributed Mining for Content Filtering Function Based on Simulated Annealing and Gene Expression Programming in Active Distribution Network , 2017, IEEE Access.

[15]  Gerardo Beruvides,et al.  Sensoring systems and signal analysis to monitor tool wear in microdrilling operations on a sintered tungsten–copper composite material , 2013 .

[16]  Liu Liu,et al.  A fast steady-state ε-dominance multi-objective evolutionary algorithm , 2011, Comput. Optim. Appl..

[17]  Charlotte Hauman,et al.  The application of the cross-entropy method for multi-objective optimisation to combinatorial problems , 2012 .

[18]  Puneet Tandon,et al.  Mathematical modeling of cutting forces in microdrilling , 2013 .

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  Jan-Ming Ho,et al.  Query-Based Learning for Dynamic Particle Swarm Optimization , 2017, IEEE Access.

[21]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[22]  Kirill Chernyshov,et al.  Entropy Criteria in the Econometric Model Identification , 2016 .

[23]  Xin-She Yang,et al.  Computational Optimization, Modelling and Simulation: Past, Present and Future , 2014, ICCS.

[24]  Radu-Emil Precup,et al.  Iterative Data-Driven Tuning of Controllers for Nonlinear Systems With Constraints , 2014, IEEE Transactions on Industrial Electronics.

[25]  Chris Aldrich,et al.  The cross-entropy method in multi-objective optimisation: An assessment , 2011, Eur. J. Oper. Res..

[26]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[27]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Gerardo Beruvides,et al.  Multi-objective optimization based on an improved cross-entropy method. A case study of a micro-scale manufacturing process , 2016, Inf. Sci..

[29]  Layne T. Watson,et al.  Pareto Front Approximation Using a Hybrid Approach , 2013, ICCS.

[30]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[31]  Tung-Kuan Liu,et al.  Developing a Multiobjective Optimization Scheduling System for a Screw Manufacturer: A Refined Genetic Algorithm Approach , 2014, IEEE Access.

[32]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[33]  Peter J. Fleming,et al.  An analysis of parameter sensitivities of preference-inspired co-evolutionary algorithms , 2015, Int. J. Syst. Sci..