Hybrid non-dominated sorting genetic algorithm with adaptive operators selection

Graphical abstractThe main goal of this paper is to investigate the effect of the multiple search operators with adaptive selection strategy and to develop hybrid version of non-dominated sorting genetic algorithm (HNSGA) for solving recently developed complicated multi-objective optimization test suit for multi-objective evolutionary algorithms (MOEAs) competition in the special session of the congress on evolutionary computing held at Norway in 2009 (CEC09). The Inverted generational distance (IGD) has been used performance indicator to establish valuable comparison between the suggested algorithm and NSGA-II as shown in the figure below. A set of Pareto optimal solutions with smaller is the IGD values confirm that approximated Pareto front (PF) will cover whole part of true PF in term of proximity and diversity. The average IGD-metric values evolution obtained by HNSGA versus NSGA-II for UF1-UF5 within allowable resources of 300,000 function evaluations. Display Omitted HighlightsA novel hybrid non-dominated sorting genetic algorithm (HNSGA) for multiobjective optimization with continuous variables is developed.HNSGA includes adaptive operator selection to allocate resources to multiple search operators based on their individual performance at the subpopulation level.HNSGA is tested in classical benchmark problems taken from the ZDT and CEC09 suites.Inverted generational distance (IGD), relative hypervolume (RHV), Gamma and Delta functions are used as performance indicators.The new algorithm is very competitive with other state-of-the-art optimizers such as AMALGAM, NSGA-II, MOEA/D, Hybrid AMGA, OMOEA, PA-DDS, etc. Multiobjective optimization entails minimizing or maximizing multiple objective functions subject to a set of constraints. Many real world applications can be formulated as multi-objective optimization problems (MOPs), which often involve multiple conflicting objectives to be optimized simultaneously. Recently, a number of multi-objective evolutionary algorithms (MOEAs) were developed suggested for these MOPs as they do not require problem specific information. They find a set of non-dominated solutions in a single run. The evolutionary process on which they are based, typically relies on a single genetic operator. Here, we suggest an algorithm which uses a basket of search operators. This is because it is never easy to choose the most suitable operator for a given problem. The novel hybrid non-dominated sorting genetic algorithm (HNSGA) introduced here in this paper and tested on the ZDT (Zitzler-Deb-Thiele) and CEC09 (2009 IEEE Conference on Evolutionary Computations) benchmark problems specifically formulated for MOEAs. Numerical results prove that the proposed algorithm is competitive with state-of-the-art MOEAs.

[1]  Andrzej Jaszkiewicz,et al.  Genetic local search for multi-objective combinatorial optimization , 2022 .

[2]  Jasper A Vrugt,et al.  Improved evolutionary optimization from genetically adaptive multimethod search , 2007, Proceedings of the National Academy of Sciences.

[3]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[4]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[5]  Ricardo Landa Becerra,et al.  Evolutionary Multiobjective Optimization in Materials Science and Engineering , 2009 .

[6]  Markus Wagner,et al.  Efficient optimization of many objectives by approximation-guided evolution , 2015, Eur. J. Oper. Res..

[7]  Johannes Bader,et al.  Hypervolume-based search for multiobjective optimization: Theory and methods , 2010 .

[8]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[10]  Wali Khan Mashwani MOEA/D with DE and PSO: MOEA/D-DE+PSO , 2011, SGAI Conf..

[11]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[12]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[13]  Wali Khan Mashwani Enhanced versions of differential evolution: state-of-the-art survey , 2014, Int. J. Comput. Sci. Math..

[14]  Janez Brest,et al.  Differential Evolution with Self-adaptation and Local Search for Constrained Multiobjective Optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[15]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[16]  Qingfu Zhang,et al.  MOEA/D-DRA with two crossover operators , 2010, 2010 UK Workshop on Computational Intelligence (UKCI).

[17]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Wali Khan Mashwani,et al.  Multiobjective memetic algorithm based on decomposition , 2014, Appl. Soft Comput..

[19]  Wali Khan Mashwani,et al.  Impact analysis of crossovers in a multi-objective evolutionary algorithm , 2015 .

[20]  Bryan A. Tolson,et al.  Pareto archived dynamically dimensioned search with hypervolume-based selection for multi-objective optimization , 2013 .

[21]  Qing Li,et al.  Multiobjective optimization for crash safety design of vehicles using stepwise regression model , 2008 .

[22]  Carlos A. Coello Coello,et al.  A Comprehensive Survey of Evolutionary-Based Multiobjective Optimization Techniques , 1999, Knowledge and Information Systems.

[23]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[24]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[25]  Wali Khan Mashwani,et al.  A decomposition-based hybrid multiobjective evolutionary algorithm with dynamic resource allocation , 2012, Appl. Soft Comput..

[26]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[27]  Eckart Zitzler,et al.  Evolutionary multi-objective optimization , 2007, Eur. J. Oper. Res..

[28]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[29]  Shigeyoshi Tsutsui,et al.  Multi-parent Recombination in Genetic Algorithms with Search Space Boundary Extension by Mirroring , 1998, PPSN.

[30]  Muhammad Asif,et al.  Enhanced Version of Multi-algorithm Genetically Adaptive for Multiobjective optimization , 2015 .

[31]  Andrzej Jaszkiewicz,et al.  On the computational efficiency of multiple objective metaheuristics. The knapsack problem case study , 2004, Eur. J. Oper. Res..

[32]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[33]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[34]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[35]  Wali Khan Mashwani Integration of NSGA-II and MOEA/D in multimethod search approach: algorithms , 2011, GECCO '11.

[36]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[37]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[38]  Wali Khan Mashwani,et al.  Comprehensive Survey of the Hybrid Evolutionary Algorithms , 2013, Int. J. Appl. Evol. Comput..

[39]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[40]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[41]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[42]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[43]  Andreas Schuster About traveling salesmen and telephone networks—Combinatorial optimization problems at high school , 2004 .

[44]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[45]  Kalyanmoy Deb,et al.  Local search based evolutionary multi-objective optimization algorithm for constrained and unconstrained problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[46]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[47]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[48]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[49]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[50]  Wali Khan Mashwani A multimethod search approach based on adaptive generations level , 2011, 2011 Seventh International Conference on Natural Computation.

[51]  Lei Zhang,et al.  An orthogonal multi-objective evolutionary algorithm with lower-dimensional crossover , 2009, 2009 IEEE Congress on Evolutionary Computation.

[52]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[53]  A. E. Eiben,et al.  Multiobjective Evolutionary Algorithms , 2015 .

[54]  Wali Khan Mashwani,et al.  Evolutionary Algorithms Based on Decomposition and Indicator Functions: State-of-the-art Survey , 2016 .

[55]  Junichi Suzuki,et al.  R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[56]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[57]  Kalyanmoy Deb,et al.  Performance assessment of the hybrid Archive-based Micro Genetic Algorithm (AMGA) on the CEC09 test problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[58]  Gary B. Lamont,et al.  Applications Of Multi-Objective Evolutionary Algorithms , 2004 .

[59]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[60]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.