Multimodal Optimization Enhanced Cooperative Coevolution for Large-Scale Optimization

Cooperative coevolutionary (CC) algorithms decompose a problem into several subcomponents and optimize them separately. Such a divide-and-conquer strategy makes CC algorithms potentially well suited for large-scale optimization. However, decomposition may be inaccurate, resulting in a wrong division of the interacting decision variables into different subcomponents and thereby a loss of important information about the topology of the overall fitness landscape. In this paper, we suggest an idea that concurrently searches for multiple optima and uses them as informative representatives to be exchanged among subcomponents for compensation. To this end, we incorporate a multimodal optimization procedure into each subcomponent, which is adaptively triggered by the status of subcomponent optimizers. In addition, a nondominance-based selection scheme is proposed to adaptively select one complete solution for evaluation from the ones that are constructed by combining informative representatives from each subcomponent with a given solution. The performance of the proposed algorithm has been demonstrated by comparing five popular CC algorithms on a set of selected problems that are recognized to be hard for traditional CC algorithms. The superior performance of the proposed algorithm is further confirmed by a comprehensive study that compares 17 state-of-the-art CC algorithms and other metaheuristic algorithms on 20 1000-dimensional benchmark functions.

[1]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[2]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[3]  Antonio LaTorre de la Fuente,et al.  A framework for hybrid dynamic evolutionary algorithms : multiple offspring sampling (MOS) , 2009 .

[4]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[5]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[6]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[7]  Nikolaus Hansen,et al.  Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[8]  Jing Liu,et al.  A Dynamic Multiagent Genetic Algorithm for Gene Regulatory Network Reconstruction Based on Fuzzy Cognitive Maps , 2016, IEEE Transactions on Fuzzy Systems.

[9]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[10]  Sean Luke,et al.  Time-dependent Collaboration Schemes for Cooperative Coevolutionary Algorithms , 2005, AAAI Fall Symposium: Coevolutionary and Coadaptive Systems.

[11]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[12]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[13]  Yong Wang,et al.  MOMMOP: Multiobjective Optimization for Locating Multiple Optimal Solutions of Multimodal Optimization Problems , 2015, IEEE Transactions on Cybernetics.

[14]  Sean Luke,et al.  Archive-based cooperative coevolutionary algorithms , 2006, GECCO '06.

[15]  Lily Rachmawati,et al.  Dynamic resizing for grid-based archiving in evolutionary multi objective optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[17]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[18]  David W. Corne,et al.  Properties of an adaptive archiving algorithm for storing nondominated vectors , 2003, IEEE Trans. Evol. Comput..

[19]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[20]  Xiaodong Li,et al.  Cooperative Coevolution With Route Distance Grouping for Large-Scale Capacitated Arc Routing Problems , 2014, IEEE Transactions on Evolutionary Computation.

[21]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[22]  Ponnuthurai N. Suganthan,et al.  Dynamic multi-swarm particle swarm optimizer with sub-regional harmony search , 2010, IEEE Congress on Evolutionary Computation.

[23]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[24]  Antonio LaTorre,et al.  Multiple Offspring Sampling in Large Scale Global Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[25]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[26]  Xiaodong Li,et al.  Designing benchmark problems for large-scale continuous optimization , 2015, Inf. Sci..

[27]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Ata Kabán,et al.  Toward Large-Scale Continuous EDA: A Random Matrix Theory Perspective , 2013, Evolutionary Computation.

[29]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[30]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[31]  Yuhui Shi,et al.  Diversity control in particle swarm optimization , 2011, 2011 IEEE Symposium on Swarm Intelligence.

[32]  Pascal Bouvry,et al.  Achieving super-linear performance in parallel multi-objective evolutionary algorithms by means of cooperative coevolution , 2013, Comput. Oper. Res..

[33]  Yaochu Jin,et al.  A dynamic optimization approach to the design of cooperative co-evolutionary algorithms , 2016, Knowl. Based Syst..

[34]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[35]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[36]  Jürgen Teich,et al.  Covering Pareto Sets by Multilevel Evolutionary Subdivision Techniques , 2003, EMO.

[37]  Francisco Herrera,et al.  Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains , 2011, Soft Comput..

[38]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[39]  Juan Julián Merelo Guervós,et al.  Addressing High Dimensional Multi-objective Optimization Problems by Coevolutionary Islands with Overlapping Search Spaces , 2016, EvoApplications.

[40]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[41]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[42]  Liviu Panait,et al.  Theoretical Convergence Guarantees for Cooperative Coevolutionary Algorithms , 2010, Evolutionary Computation.

[43]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[44]  Jeffrey K. Bassett,et al.  An Analysis of Cooperative Coevolutionary Algorithms A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2003 .

[45]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[46]  Dervis Karaboga,et al.  Artificial bee colony algorithm for large-scale problems and engineering design optimization , 2012, J. Intell. Manuf..

[47]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[48]  Tyson R. Browning,et al.  Applying the design structure matrix to system decomposition and integration problems: a review and new directions , 2001, IEEE Trans. Engineering Management.

[49]  Ke Tang,et al.  Scaling Up Covariance Matrix Adaptation Evolution Strategy Using Cooperative Coevolution , 2013, IDEAL.

[50]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[51]  Janez Brest,et al.  Self-adaptive differential evolution algorithm using population size reduction and three strategies , 2011, Soft Comput..

[52]  Antonio LaTorre,et al.  Large scale global optimization: Experimental results with MOS-based hybrid algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[53]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[54]  R. Paul Wiegand,et al.  Biasing Coevolutionary Search for Optimal Multiagent Behaviors , 2006, IEEE Transactions on Evolutionary Computation.

[55]  Carlos García-Martínez,et al.  Memetic Algorithms for Continuous Optimisation Based on Local Search Chains , 2010, Evolutionary Computation.

[56]  Antonio LaTorre,et al.  A comprehensive comparison of large scale global optimizers , 2015, Inf. Sci..

[57]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[58]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[59]  Francisco Herrera,et al.  Variable mesh optimization for continuous optimization problems , 2012, Soft Comput..

[60]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[61]  Jürgen Teich,et al.  Covering Pareto-optimal fronts by subswarms in multi-objective particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[62]  Kalyanmoy Deb,et al.  Multimodal Optimization Using a Bi-Objective Evolutionary Algorithm , 2012, Evolutionary Computation.

[63]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[64]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.