Coevolutionary Multiobjective Evolutionary Algorithms: Survey of the State-of-the-Art

In the last 20 years, evolutionary algorithms (EAs) have shown to be an effective method to solve multiobjective optimization problems (MOPs). Due to their population-based nature, multiobjective EAs (MOEAs) are able to generate a set of tradeoff solutions (called nondominated solutions) in a single algorithmic execution instead of having to perform a series of independent executions, as normally done with mathematical programming techniques. Additionally, MOEAs can be successfully applied to problems with difficult features such as multifrontality, discontinuity and disjoint feasible regions, among others. On the other hand, coevolutionary algorithms (CAs) are extensions of traditional EAs which have become subject of numerous studies in the last few years, particularly for dealing with large-scale global optimization problems. CAs have also been applied to the solution of MOPs, motivating the development of new algorithmic and analytical formulations that have advanced the state-of-the-art in CAs research, while simultaneously opening a new research path within MOEAs. This paper presents a critical review of the most representative coevolutionary MOEAs (CMOEAs) that have been reported in the specialized literature. This survey includes a taxonomy of approaches together with a brief description of their main features. In the final part of this paper, we also identify what we believe to be promising areas of future research in the field of CMOEAs.

[1]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[2]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[3]  Carlos A. Coello Coello,et al.  A coevolutionary multi-objective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[5]  Christian Grimme,et al.  The Parallel Predator-Prey Model: A Step towards Practical Application , 2008, PPSN.

[6]  Kittipong Boonlong,et al.  Multi-objective Optimisation by Co-operative Co-evolution , 2004, PPSN.

[7]  Jian-guo Liu Competitive Coevolutionary Genetic Algorithms for Multiobjective Optimization Problems , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[8]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[9]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[10]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[11]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 1998, Artificial Life.

[12]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  L. Lebensztajn,et al.  Multiobjective Biogeography-Based Optimization Based on Predator-Prey Approach , 2012, IEEE Transactions on Magnetics.

[14]  S. Luke,et al.  When Coevolutionary Algorithms Exhibit Evolutionary Dyna mics , 2002 .

[15]  J. Pollack,et al.  Challenges in coevolutionary learning: arms-race dynamics, open-endedness, and medicocre stable states , 1998 .

[16]  Jason Teo,et al.  Competitive Coevolution with K-Random Opponents for Pareto Multiobjective Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[17]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[18]  Yujun Zheng,et al.  Cooperative particle swarm optimization for multiobjective transportation planning , 2012, Applied Intelligence.

[19]  Maoguo Gong,et al.  A Multiobjective Cooperative Coevolutionary Algorithm for Hyperspectral Sparse Unmixing , 2017, IEEE Transactions on Evolutionary Computation.

[20]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[21]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[22]  Gary B. Lamont,et al.  Coevolutionary Multi-Objective EAs: The Next Frontier? , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Edwin D. de Jong,et al.  Intransitivity in Coevolution , 2004, PPSN.

[24]  Jong-Shi Pang,et al.  Foreword: Special issue on nonlinear programming, variational inequalities, and stochastic programming , 2008, Math. Program..

[25]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[26]  Pascal Bouvry,et al.  Multi-objective Cooperative Coevolutionary Evolutionary Algorithms for Continuous and Combinatorial Optimization , 2011, Intelligent Decision Systems in Large-Scale Distributed Environments.

[27]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[28]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[29]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[30]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.

[31]  Jason Teo,et al.  Evolving Opposition-Based Pareto Solutions: Multiobjective Optimization Using Competitive Coevolution , 2008, Oppositional Concepts in Computational Intelligence.

[32]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[33]  Jörn Mehnen,et al.  Using predators and preys in evolution strategies , 2005, GECCO '05.

[34]  Yang Yang,et al.  A distributed cooperative coevolutionary algorithm for multiobjective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[35]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[36]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[37]  Tse Guan Tan,et al.  Cooperative coevolution for pareto multiobjective optimization: An empirical study using SPEA2 , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[38]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[39]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[40]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[41]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[42]  Sevan G. Ficici,et al.  Multiobjective Optimization and Coevolution , 2008, Multiobjective Problem Solving from Nature.

[43]  Jongsoo Lee,et al.  A method of genetic algorithm based multiobjective optimization via cooperative coevolution , 2006 .

[44]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[45]  Helio J. C. Barbosa,et al.  An interactive genetic algorithm with co-evolution of weights for multiobjective problems , 2001 .

[46]  Seth Bullock,et al.  Combating Coevolutionary Disengagement by Reducing Parasite Virulence , 2004, Evolutionary Computation.

[47]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[48]  P. Raven,et al.  BUTTERFLIES AND PLANTS: A STUDY IN COEVOLUTION , 1964 .

[49]  Frederico G. Guimarães,et al.  Competitive coevolutionary algorithm for robust multi-objective optimization: The worst case minimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[50]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[51]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[52]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[53]  Jianguo Liu,et al.  Multiobjective optimization with competitive coevolutionary genetic algorithms , 2010, Proceedings of the 29th Chinese Control Conference.

[54]  Nachol Chaiyaratana,et al.  Multi-objective Co-operative Co-evolutionary Genetic Algorithm , 2002, PPSN.

[55]  Jason Teo,et al.  Performance Scalability of a Cooperative Coevolution Multiobjective Evolutionary Algorithm , 2007, 2007 International Conference on Computational Intelligence and Security (CIS 2007).

[56]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[57]  Xiaodong Li,et al.  A Real-Coded Predator-Prey Genetic Algorithm for Multiobjective Optimization , 2003, EMO.

[58]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[59]  Jason Teo,et al.  Improving the Performance of Multiobjective Evolutionary Optimization Algorithms Using Coevolutionary Learning , 2009, Nature-Inspired Algorithms for Optimisation.

[60]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[61]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[62]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[63]  Xiaodong Li,et al.  A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting , 2004, GECCO.

[64]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[65]  Ziad Kobti,et al.  A new strategy to detect variable interactions in large scale global optimization , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[66]  Ian C. Parmee,et al.  Preliminary airframe design using co-evolutionary multiobjective genetic algorithms , 1999 .

[67]  Jan Paredis,et al.  Coevolutionary Computation , 1995, Artificial Life.

[68]  Weiwei Zhang,et al.  Cooperative Differential Evolution With Multiple Populations for Multiobjective Optimization , 2016, IEEE Transactions on Cybernetics.

[69]  Carlos A. Coello Coello,et al.  A non-cooperative game for faster convergence in cooperative coevolution for multi-objective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[70]  Tong Heng Lee,et al.  A cooperative coevolutionary algorithm for multiobjective optimization , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[71]  Christian Grimme,et al.  Inside a predator-prey model for multi-objective optimization: a second study , 2006, GECCO '06.

[72]  Carlos A. Coello Coello,et al.  A Micro-Genetic Algorithm for Multiobjective Optimization , 2001, EMO.

[73]  Hussein A. Abbass,et al.  MOCCA-II: A multi-objective co-operative co-evolutionary algorithm , 2014, Appl. Soft Comput..

[74]  Leszek Siwik,et al.  Co-evolutionary Multi-agent System with Predator-Prey Mechanism for Multi-objective Optimization , 2007, ICANNGA.

[75]  R. Paul Wiegand,et al.  A Sensitivity Analysis of a Cooperative Coevolutionary Algorithm Biased for Optimization , 2004, GECCO.

[76]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[77]  Yi Liu,et al.  Multiobjective nondominated neighbor coevolutionary algorithm with elite population , 2015, Soft Comput..

[78]  Kwee-Bo Sim,et al.  Game Theory Based Coevolutionary Algorithm: A New Computational Coevolutionary Approach , 2004 .

[79]  Gary L. Haith,et al.  Comparing a coevolutionary genetic algorithm for multiobjective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[80]  Jason Teo,et al.  Cooperative Versus Competitive Coevolution for Pareto Multiobjective Optimization , 2007, LSMS.

[81]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[82]  J. Pollack,et al.  Coevolutionary dynamics in a minimal substrate , 2001 .

[83]  Kalyanmoy Deb,et al.  Investigating Predator-Prey Algorithms for Multi-Objective Optimization , 2002 .

[84]  Souma Chowdhury,et al.  Predator-Prey Evolutionary Multi-Objective Optimization Algorithm : Performance and Improvements , 2009 .

[85]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[86]  Man Leung Wong,et al.  Data Mining Using Parallel Multi-objective Evolutionary Algorithms on Graphics Processing Units , 2013, Massively Parallel Evolutionary Computation on GPGPUs.

[87]  Carlos A. Coello Coello,et al.  Indicator-based cooperative coevolution for multi-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[88]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[89]  George S. Dulikravich,et al.  MODIFIED PREDATOR-PREY ( MPP ) ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION , 2009 .