Underestimation-Assisted Global-Local Cooperative Differential Evolution and the Application to Protein Structure Prediction

Various mutation strategies show distinct advantages in differential evolution (DE). The cooperation of multiple strategies in the evolutionary process may be effective. This article presents an underestimation-assisted global and local cooperative DE to simultaneously enhance the effectiveness and efficiency. In the proposed algorithm, two phases, namely, the global exploration and the local exploitation, are performed in each generation. In the global phase, a set of trial vectors is produced for each target individual by employing multiple strategies with strong exploration capability. Afterward, an adaptive underestimation model with an self-adapted slope control parameter is proposed to evaluate these trial vectors, the best of which is selected as the candidate. In the local phase, the better-based strategies guided by individuals that are better than the target individual are designed. For each individual accepted in the global phase, multiple trial vectors are generated by using these strategies and filtered by the underestimation value. The cooperation between the global and local phases includes two aspects. First, both of them concentrate on generating better individuals for the next generation. Second, the global phase aims to locate promising regions quickly while the local phase serves as a local search for enhancing convergence. Moreover, a simple mechanism is designed to determine the parameter of DE adaptively in the searching process. Finally, the proposed approach is applied to predict the protein 3-D structure. The experimental studies on classical benchmark functions, CEC test sets, and protein structure prediction problem show that the proposed approach is superior to the competitors.

[1]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Liang Gao,et al.  A differential evolution algorithm with self-adapting strategy and control parameters , 2011, Comput. Oper. Res..

[3]  Li Yu,et al.  Enhancing Protein Conformational Space Sampling Using Distance Profile-Guided Differential Evolution , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[4]  Hussein A. Abbass,et al.  Adaptive Cross-Generation Differential Evolution Operators for Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[5]  Ali Wagdy Mohamed,et al.  Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation , 2017, Soft Computing.

[6]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[7]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[9]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Petr Bujok,et al.  Enhanced individual-dependent differential evolution with population size adaptation , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[11]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[12]  Ponnuthurai N. Suganthan,et al.  An improved differential evolution algorithm using efficient adapted surrogate model for numerical optimization , 2018, Inf. Sci..

[13]  Aimin Zhou,et al.  A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[14]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[15]  Lynn Margaret Batten,et al.  Fast Algorithm for the Cutting Angle Method of Global Optimization , 2002, J. Glob. Optim..

[16]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[17]  Gui-Jun Zhang,et al.  Abstract Convex Underestimation Assisted Multistage Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[18]  Janez Brest,et al.  iL-SHADE: Improved L-SHADE algorithm for single objective real-parameter optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[19]  Yang Zhang Progress and challenges in protein structure prediction. , 2008, Current opinion in structural biology.

[20]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[21]  Ruhul A. Sarker,et al.  Testing united multi-operator evolutionary algorithms on the CEC2014 real-parameter numerical optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[22]  Li Yu,et al.  Enhanced differential evolution using local Lipschitz underestimate strategy for computationally expensive optimization problems , 2016, Appl. Soft Comput..

[23]  Robert G. Reynolds,et al.  An Adaptive Multipopulation Differential Evolution With Dynamic Population Reduction , 2017, IEEE Transactions on Cybernetics.

[24]  Min-Yuan Cheng,et al.  Two-Phase Differential Evolution for the Multiobjective Optimization of Time–Cost Tradeoffs in Resource-Constrained Construction Projects , 2014, IEEE Transactions on Engineering Management.

[25]  Shao Yong Zheng,et al.  An Efficient Multiple Variants Coordination Framework for Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[26]  Ponnuthurai N. Suganthan,et al.  Ensemble of parameters in a sinusoidal differential evolution with niching-based population reduction , 2017, Swarm Evol. Comput..

[27]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[28]  Anas A. Hadi,et al.  LSHADE with semi-parameter adaptation hybrid with CMA-ES for solving CEC 2017 benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[29]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[30]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[32]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[34]  A. Tramontano,et al.  Critical assessment of methods of protein structure prediction (CASP)—Round XII , 2018, Proteins.

[35]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[36]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[37]  Michal Pluhacek,et al.  Success-history based adaptive differential evolution algorithm with multi-chaotic framework for parent selection performance on CEC2014 benchmark set , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[38]  Zhijian Wu,et al.  Enhancing differential evolution with role assignment scheme , 2014, Soft Comput..

[39]  Ruhul A. Sarker,et al.  Neurodynamic differential evolution algorithm and solving CEC2015 competition problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[40]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[41]  John Doherty,et al.  Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems , 2017, IEEE Transactions on Cybernetics.

[42]  Alfredo Milani,et al.  Algebraic Differential Evolution Algorithm for the Permutation Flowshop Scheduling Problem With Total Flowtime Criterion , 2016, IEEE Transactions on Evolutionary Computation.

[43]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[44]  G. Beliakov Extended cutting angle method of global optimization , 2008 .

[45]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[46]  Rammohan Mallipeddi,et al.  An evolving surrogate model-based differential evolution algorithm , 2015, Appl. Soft Comput..

[47]  Gui-Jun Zhang,et al.  Differential Evolution With Underestimation-Based Multimutation Strategy , 2019, IEEE Transactions on Cybernetics.

[48]  Hui Li,et al.  Adaptive strategy selection in differential evolution for numerical optimization: An empirical study , 2011, Inf. Sci..

[49]  Xuefeng Yan,et al.  Self-adaptive differential evolution algorithm with discrete mutation control parameters , 2015, Expert Syst. Appl..

[50]  Luís C. Lamb,et al.  Three-dimensional protein structure prediction: Methods and computational strategies , 2014, Comput. Biol. Chem..

[51]  Ruhul A. Sarker,et al.  A new genetic algorithm for solving optimization problems , 2014, Eng. Appl. Artif. Intell..

[52]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[53]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[54]  Gleb Beliakov,et al.  Geometry and combinatorics of the cutting angle method , 2003 .

[55]  Vasileios A. Tatsis,et al.  Dynamic parameter adaptation in metaheuristics using gradient approximation and line search , 2019, Appl. Soft Comput..

[56]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[57]  Kay Chen Tan,et al.  Multiple Exponential Recombination for Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[58]  Li Yu,et al.  A novel differential evolution algorithm using local abstract convex underestimate strategy for global optimization , 2016, Comput. Oper. Res..

[59]  Liang Gao,et al.  A new differential evolution algorithm with a hybrid mutation operator and self-adapting control parameters for global optimization problems , 2014, Applied Intelligence.

[60]  Athanasios V. Vasilakos,et al.  Differential Evolution With Event-Triggered Impulsive Control , 2015, IEEE Transactions on Cybernetics.

[61]  C. Anfinsen Principles that govern the folding of protein chains. , 1973, Science.

[62]  A. Rubinov,et al.  Abstract convexity:examples and applications , 2000 .

[63]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[64]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[65]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[66]  Li Yu,et al.  Differential evolution with multi-stage strategies for global optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[67]  Yang Zhang Protein structure prediction: when is it useful? , 2009, Current opinion in structural biology.

[68]  Michael G. Epitropakis,et al.  Balancing the exploration and exploitation capabilities of the Differential Evolution Algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[69]  A. Tramontano,et al.  Critical assessment of methods of protein structure prediction (CASP)—round IX , 2011, Proteins.

[70]  Ruhul A. Sarker,et al.  Differential evolution with multiple strategies for solving CEC2011 real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[71]  Ruhul A. Sarker,et al.  Testing united multi-operator evolutionary algorithms-II on single objective optimization problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[72]  Ponnuthurai N. Suganthan,et al.  Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[73]  Yong Wang,et al.  Global and Local Surrogate-Assisted Differential Evolution for Expensive Constrained Optimization Problems With Inequality Constraints , 2019, IEEE Transactions on Cybernetics.

[74]  Janez Brest,et al.  Real Parameter Single Objective Optimization using self-adaptive differential evolution algorithm with more strategies , 2013, 2013 IEEE Congress on Evolutionary Computation.

[75]  Tong Heng Lee,et al.  Evolutionary algorithms with dynamic population size and local exploration for multiobjective optimization , 2001, IEEE Trans. Evol. Comput..

[76]  Yang Zhang,et al.  Scoring function for automated assessment of protein structure template quality , 2004, Proteins.

[77]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[78]  Robert G. Reynolds,et al.  An ensemble sinusoidal parameter adaptation incorporated with L-SHADE for solving CEC2014 benchmark problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[79]  Xuefeng Yan,et al.  Self-Adaptive Differential Evolution Algorithm With Zoning Evolution of Control Parameters and Adaptive Mutation Strategies , 2016, IEEE Transactions on Cybernetics.

[80]  Vasileios A. Tatsis,et al.  Differential Evolution with Grid-Based Parameter Adaptation , 2017, Soft Comput..

[81]  Lixin Tang,et al.  An Improved Differential Evolution Algorithm for Practical Dynamic Scheduling in Steelmaking-Continuous Casting Production , 2014, IEEE Transactions on Evolutionary Computation.

[82]  Kay Chen Tan,et al.  A New Differential Evolution Algorithm for Minimax Optimization in Robust Design , 2018, IEEE Transactions on Cybernetics.

[83]  Dong Xu,et al.  Toward optimal fragment generations for ab initio protein structure assembly , 2013, Proteins.

[84]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[85]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[86]  Ponnuthurai N. Suganthan,et al.  Minimizing harmonic distortion in power system with optimal design of hybrid active power filter using differential evolution , 2017, Appl. Soft Comput..

[87]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[88]  Ye Tian,et al.  A Classification-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[89]  David Baker,et al.  Protein Structure Prediction Using Rosetta , 2004, Numerical Computer Methods, Part D.