Coevolutionary multitasking for concurrent global optimization: With case studies in complex engineering design

Abstract Recent research efforts have provided hints towards the innate ability of population-based evolutionary algorithms to tackle multiple distinct optimization tasks at once by combining them into a single unified search space. On the occasion that there emerges some form of complementarity between the tasks in the unified space, multitask optimization can bring about favourable leaps in the genetic lineage through automated gene transfer, thereby leading to notably accelerated convergence characteristics. In this paper, we further emphasize the efficacy of multitasking across problems through an algorithmic realization based on a coevolutionary framework. It is contended that the mechanics of cooperative coevolution are particularly well suited for exploiting the commonalities and/or complementarities between different (yet possibly related) optimization tasks in a single multitasking environment. To this end, we label the resultant approach as coevolutionary multitasking for concurrent global optimization. Further, in order to effectively navigate continuous search spaces of varying degrees of complexity, we employ the particle swarm algorithm as a sample instantiation of a base optimizer for a real-parameter unification scheme. Based on a series of numerical experiments carried out for synthetic functions as well as real-world optimization settings in engineering design, we demonstrate the efficacy of multitask optimization as a paradigm promising enhanced productivity in future decision making processes.

[1]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[2]  Xiao-Feng Xie,et al.  Handling boundary constraints for numerical optimization by particle swarm flying in periodic search space , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[3]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[4]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  Ivor W. Tsang,et al.  Memes as building blocks: a case study on evolutionary optimization + transfer learning for routing problems , 2015, Memetic Comput..

[6]  Fei Han,et al.  An Improved PSO Algorithm Encoding a priori Information for Nonlinear Approximation , 2009, ICIC.

[7]  M. Ehrgott,et al.  A surrogate model based evolutionary game-theoretic approach for optimizing non-isothermal compression RTM processes , 2013 .

[8]  Stephen C. Stearns,et al.  Evolution: An Introduction , 2000 .

[9]  Zbigniew Michalewicz,et al.  Evolutionary computation for multicomponent problems: opportunities and future directions , 2016, Optimization in Industry.

[10]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[11]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[12]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[13]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[14]  Marco Dorigo,et al.  Implicit Parallelism in Genetic Algorithms , 1993, Artif. Intell..

[15]  Rolls-Royce,et al.  Measuring Complementarity between Function Landscapes in Evolutionary Multitasking , 2016 .

[16]  Yew-Soon Ong,et al.  Evolutionary multitasking in bi-level optimization , 2015 .

[17]  Narasimhan Sundararajan,et al.  Dynamic mentoring and self-regulation based particle swarm optimization algorithm for solving complex real-world optimization problems , 2016, Inf. Sci..

[18]  Chi-Keong Goh,et al.  Co-evolutionary multi-task learning with predictive recurrence for multi-step chaotic time series prediction , 2017, Neurocomputing.

[19]  C. Robert Cloninger,et al.  Multifactorial inheritance with cultural transmission and assortative mating. II. a general model of combined polygenic and cultural inheritance. , 1979, American journal of human genetics.

[20]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[21]  Rich Caruana A Dozen Tricks with Multitask Learning , 1996, Neural Networks: Tricks of the Trade.

[22]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[23]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[24]  K. C. Tan,et al.  Continuous Optimization A competitive and cooperative coevolutionary approach to multi-objective particle swarm optimization algorithm design , 2009 .

[25]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[26]  Piaras Kelly,et al.  Simulating the effect of temperature elevation on clamping force requirements during rigid-tool Liquid Composite Moulding processes , 2012 .

[27]  M. M. Ali,et al.  Integrated crossover rules in real coded genetic algorithms , 2007, Eur. J. Oper. Res..

[28]  David H. Wolpert,et al.  Coevolutionary free lunches , 2005, IEEE Transactions on Evolutionary Computation.

[29]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[30]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[31]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization with crossover: a review and empirical analysis , 2015, Artificial Intelligence Review.

[32]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[33]  Lin Dan A GA-Based Method for Solving Constrained Optimization Problems , 2001 .

[34]  Lars Nolle,et al.  On a Hill-Climbing Algorithm with Adaptive Step Size: Towards a Control Parameter-Less Black-Box Optimisation Algorithm , 2006 .

[35]  T Reich,et al.  Multifactorial inheritance with cultural transmission and assortative mating. I. Description and basic properties of the unitary models. , 1978, American journal of human genetics.

[36]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[37]  Carlos A. Coello Coello,et al.  Solving Engineering Optimization Problems with the Simple Constrained Particle Swarm Optimizer , 2008, Informatica.

[38]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[39]  A Nguyen,et al.  Understanding Innovation Engines: Automated Creativity and Improved Stochastic Optimization via Deep Learning , 2016, Evolutionary Computation.

[40]  Ong Yew-Soon,et al.  Genetic transfer or population diversification? Deciphering the secret ingredients of evolutionary multitask optimization , 2016 .

[41]  Jasper Snoek,et al.  Multi-Task Bayesian Optimization , 2013, NIPS.

[42]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[43]  Narasimhan Sundararajan,et al.  Self regulating particle swarm optimization algorithm , 2015, Inf. Sci..

[44]  Ivor W. Tsang,et al.  Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP , 2015, IEEE Transactions on Evolutionary Computation.

[45]  K.A. De Jong,et al.  Analyzing cooperative coevolution with evolutionary game theory , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[46]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[47]  Thomas Stützle,et al.  Ant Colony Optimization for Mixed-Variable Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.