Multi-objectivization, fitness landscape transformation and search performance: A case of study on the hp model for protein structure prediction

Multi-objectivization represents a current and promising research direction which has led to the development of more competitive search mechanisms. This concept involves the restatement of a single-objective problem in an alternative multi-objective form, which can facilitate the process of finding a solution to the original problem. Recently, this transformation was applied with success to the HP model, a simplified yet challenging representation of the protein structure prediction problem. The use of alternative multi-objective formulations, based on the decomposition of the original objective function of the problem, has significantly increased the performance of search algorithms. The present study goes further on this topic. With the primary aim of understanding and quantifying the potential effects of multi-objectivization, a detailed analysis is first conducted to evaluate the extent to which this problem transformation impacts on an important characteristic of the fitness landscape, neutrality. To the authors’ knowledge, the effects of multi-objectivization have not been previously investigated by explicitly sampling and evaluating the neutrality of the fitness landscape. Although focused on the HP model, most of the findings of such an analysis can be extrapolated to other problem domains, contributing thus to the general understanding of multi-objectivization. Finally, this study presents a comparative analysis where the advantages of multi-objectivization are evaluated in terms of the performance of a basic evolutionary algorithm. Both the two- and three-dimensional variants of the HP model (based on the square and cubic lattices, respectively) are considered.

[1]  Sébastien Vérel,et al.  Fitness landscape of the cellular automata majority problem: View from the "Olympus" , 2007, Theor. Comput. Sci..

[2]  Eduardo Segredo,et al.  Memetic algorithms and hyperheuristics applied to a multiobjectivised two-dimensional packing problem , 2014, J. Glob. Optim..

[3]  Frank W. Ciarallo,et al.  An analysis of decomposition approaches in multi-objectivization via segmentation , 2014, Appl. Soft Comput..

[4]  K. Dill,et al.  A lattice statistical mechanics model of the conformational and sequence spaces of proteins , 1989 .

[5]  Heitor Silvério Lopes Evolutionary Algorithms for the Protein Folding Problem: A Review and Current Trends , 2008, Computational Intelligence in Biomedicine and Bioinformatics.

[6]  Vincenzo Cutello,et al.  A Class of Pareto Archived Evolution Strategy Algorithms Using Immune Inspired Operators for Ab-Initio Protein Structure Prediction , 2005, EvoWorkshops.

[7]  Holger H. Hoos,et al.  An ant colony optimisation algorithm for the 2D and 3D hydrophobic polar protein folding problem , 2005, BMC Bioinformatics.

[8]  S. Baskar,et al.  Multi-Objective Approach for Protein Structure Prediction , 2013, SEMCCO.

[9]  J. Santos,et al.  Differential Evolution for Protein Structure Prediction Using the HP Model , 2011, IWINAC.

[10]  K. Dill,et al.  From Levinthal to pathways to funnels , 1997, Nature Structural Biology.

[11]  Michael Affenzeller,et al.  A Comprehensive Survey on Fitness Landscape Analysis , 2012, Recent Advances in Intelligent Engineering Systems.

[12]  Lionel Barnett,et al.  Netcrawling-optimal evolutionary search with neutral networks , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[13]  Edmund K. Burke,et al.  Multimeme Algorithms for Protein Structure Prediction , 2002, PPSN.

[14]  Carolina P. de Almeida,et al.  A Hybrid Immune-Based System for the Protein Folding Problem , 2007, EvoCOP.

[15]  M. Loomes,et al.  A Firefly-Inspired Method for Protein Structure Prediction in Lattice Models , 2014, Biomolecules.

[16]  Gregorio Toscano Pulido,et al.  Handling constraints in the HP model for protein structure prediction by multiobjective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[17]  C. Anfinsen Principles that govern the folding of protein chains. , 1973, Science.

[18]  Yaochu Jin,et al.  Single and Multi-objective in Silico Evolution of Tunable Genetic Oscillators , 2013, EMO.

[19]  Qidi Wu,et al.  Hydrophobic-Polar Model Structure Prediction with Binary-Coded Artificial Plant Optimization Algorithm , 2013 .

[20]  Eduardo Segredo,et al.  Scalability and robustness of parallel hyperheuristics applied to a multiobjectivised frequency assignment problem , 2013, Soft Comput..

[21]  Madhu Chetty,et al.  Clustered Memetic Algorithm With Local Heuristics for Ab Initio Protein Structure Prediction , 2013, IEEE Transactions on Evolutionary Computation.

[22]  Frank Neumann,et al.  Do additional objectives make a problem harder? , 2007, GECCO '07.

[23]  D. Landau,et al.  Unraveling the Beautiful Complexity of Simple Lattice Model Polymers and Proteins Using Wang-Landau Sampling , 2013, 1301.3466.

[24]  Hussein A. Abbass,et al.  Tackling Dynamic Problems with Multiobjective Evolutionary Algorithms , 2008, Multiobjective Problem Solving from Nature.

[25]  Gara Miranda,et al.  Using multi-objective evolutionary algorithms for single-objective optimization , 2013, 4OR.

[26]  José R. Álvarez,et al.  Artificial Neural Nets Problem Solving Methods , 2003, Lecture Notes in Computer Science.

[27]  Gregorio Toscano Pulido,et al.  Multiobjectivizing the HP Model for Protein Structure Prediction , 2012, EvoCOP.

[28]  Andrew Philippides,et al.  Multi-objectivization of the Tool Selection Problem on a Budget of Evaluations , 2013, EMO.

[29]  Joshua D. Knowles,et al.  Investigations into the Effect of Multiobjectivization in Protein Structure Prediction , 2008, PPSN.

[30]  Tapabrata Ray,et al.  Optimum Oil Production Planning Using Infeasibility Driven Evolutionary Algorithm , 2013, Evolutionary Computation.

[31]  Joshua D. Knowles,et al.  Multiobjectivization by Decomposition of Scalar Cost Functions , 2008, PPSN.

[32]  Xiaodong Li,et al.  Evolutionary algorithms and multi-objectivization for the travelling salesman problem , 2009, GECCO.

[33]  Ingo Wegener,et al.  Can Single-Objective Optimization Profit from Multiobjective Optimization? , 2008, Multiobjective Problem Solving from Nature.

[34]  Xin Liu,et al.  Protein Conformation of a Lattice Model Using Tabu Search , 1997, J. Glob. Optim..

[35]  Eduardo Segredo,et al.  A multiobjectivised memetic algorithm for the Frequency Assignment Problem , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[36]  Thomas Bäck,et al.  Selective Pressure in Evolutionary Algorithms: A Characterization of Selection Mechanisms , 1994, International Conference on Evolutionary Computation.

[37]  Günter Rudolph,et al.  Niching by multiobjectivization with neighbor information: Trade-offs and benefits , 2013, 2013 IEEE Congress on Evolutionary Computation.

[38]  Long Li,et al.  A novel EDAs based method for HP model protein folding , 2009, 2009 IEEE Congress on Evolutionary Computation.

[39]  Nashat Mansour,et al.  Protein structure prediction in the 3D HP model , 2009, 2009 IEEE/ACS International Conference on Computer Systems and Applications.

[40]  Yuri Pirola,et al.  A Comprehensive View of Fitness Landscapes with Neutrality and Fitness Clouds , 2007, EuroGP.

[41]  P. Stadler Fitness Landscapes , 1993 .

[42]  V. Cutello,et al.  A multi-objective evolutionary approach to the protein structure prediction problem , 2006, Journal of The Royal Society Interface.

[43]  Yuri Pirola,et al.  A study of the neutrality of Boolean function landscapes in genetic programming , 2012, Theor. Comput. Sci..

[44]  Bilel Derbel,et al.  Multiobjectivization with NSGA-ii on the noiseless BBOB testbed , 2013, GECCO.

[45]  Frank W. Ciarallo,et al.  Helper-objective optimization strategies for the Job-Shop Scheduling Problem , 2011, Appl. Soft Comput..

[46]  Sébastien Vérel,et al.  On the Neutrality of Flowshop Scheduling Fitness Landscapes , 2011, LION.

[47]  David Becerra,et al.  A parallel multi-objective ab initio approach for protein structure prediction , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[48]  David W. Corne,et al.  Quantifying the Effects of Objective Space Dimension in Evolutionary Multiobjective Optimization , 2007, EMO.

[49]  Eduardo Rodriguez-Tello,et al.  An Improved Multiobjectivization Strategy for HP Model-Based Protein Structure Prediction , 2012, PPSN.

[50]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[51]  Mihalis Yannakakis,et al.  On the Complexity of Protein Folding , 1998, J. Comput. Biol..

[52]  L. Barnett Ruggedness and neutrality—the NKp family of fitness landscapes , 1998 .

[53]  Vincenzo Cutello,et al.  An Immune Algorithm for Protein Structure Prediction on Lattice Models , 2007, IEEE Transactions on Evolutionary Computation.

[54]  Helio J. C. Barbosa,et al.  A multiple minima genetic algorithm for protein structure prediction , 2014, Appl. Soft Comput..

[55]  Vesselin K. Vassilev,et al.  Smoothness, ruggedness and neutrality of fitness landscapes: from theory to application , 2003 .

[56]  Gregorio Toscano Pulido,et al.  Optimal Triangulation in 3D Computer Vision Using a Multi-objective Evolutionary Algorithm , 2007, EvoWorkshops.

[57]  Mikkel T. Jensen,et al.  Helper-objectives: Using multi-objective evolutionary algorithms for single-objective optimisation , 2004, J. Math. Model. Algorithms.

[58]  Qiang Zhang,et al.  Enhanced hybrid search algorithm for protein structure prediction using the 3D-HP lattice model , 2013, Journal of Molecular Modeling.

[59]  Frank W. Ciarallo,et al.  Multiobjectivization via Helper-Objectives With the Tunable Objectives Problem , 2012, IEEE Transactions on Evolutionary Computation.

[60]  Frank Thomson Leighton,et al.  Protein folding in the hydrophobic-hydrophilic (HP) is NP-complete , 1998, RECOMB '98.

[61]  Kalyanmoy Deb,et al.  Customized evolutionary optimization procedure for generating minimum weight compliant mechanisms , 2014 .

[62]  David Greiner,et al.  Improving Computational Mechanics Optimum Design Using Helper Objectives: An Application in Frame Bar Structures , 2007, EMO.

[63]  Jean-Baptiste Mouret Novelty-Based Multiobjectivization , 2011 .

[64]  Amarda Shehu,et al.  Multi-Objective Stochastic Search for Sampling Local Minima in the Protein Energy Surface , 2013, BCB.

[65]  Alexandre C. B. Delbem,et al.  Investigating relevant aspects of MOEAs for protein structures prediction , 2011, GECCO.

[66]  Pedro Larrañaga,et al.  Protein Folding in Simplified Models With Estimation of Distribution Algorithms , 2008, IEEE Transactions on Evolutionary Computation.

[67]  Gary B. Lamont,et al.  Solving the Protein Structure Prediction Problem Through a Multiobjective Genetic Algorithm , 2002 .

[68]  Charles Gide,et al.  Cours d'économie politique , 1911 .

[69]  Andries Petrus Engelbrecht,et al.  A survey of techniques for characterising fitness landscapes and some possible ways forward , 2013, Inf. Sci..

[70]  T. Stützle,et al.  Iterated Local Search: Framework and Applications , 2018, Handbook of Metaheuristics.

[71]  Kazutoshi Sakakibara,et al.  A Multiobjectivization Approach for Vehicle Routing Problems , 2007, EMO.

[72]  Jun S. Liu,et al.  Biopolymer structure simulation and optimization via fragment regrowth Monte Carlo. , 2007, The Journal of chemical physics.

[73]  Abdul Sattar,et al.  Spiral search: a hydrophobic-core directed local search for simplified PSP on 3D FCC lattice , 2013, BMC Bioinformatics.

[74]  K. Dill Theory for the folding and stability of globular proteins. , 1985, Biochemistry.

[75]  Eduardo Segredo,et al.  Parallel island-based multiobjectivised memetic algorithms for a 2D packing problem , 2011, GECCO '11.

[76]  Holger H. Hoos,et al.  A replica exchange Monte Carlo algorithm for protein folding in the HP model , 2007, BMC Bioinformatics.

[77]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[78]  J. Marchal Cours d'economie politique , 1950 .

[79]  Vincenzo Cutello,et al.  Computational Studies of Peptide and Protein Structure Prediction Problems via Multiobjective Evolutionary Algorithms , 2008, Multiobjective Problem Solving from Nature.

[80]  Heitor Silvério Lopes,et al.  A Differential Evolution Approach for Protein Folding Using a Lattice Model , 2007, Journal of Computer Science and Technology.

[81]  Gregorio Toscano Pulido,et al.  Locality-based multiobjectivization for the HP model of protein structure prediction , 2012, GECCO '12.

[82]  Sushil J. Louis,et al.  Pareto OptimalityGA-Easiness and Deception (Extended Abstract) , 1993, International Conference on Genetic Algorithms.

[83]  Carlos Cotta,et al.  Protein Structure Prediction Using Evolutionary Algorithms Hybridized with Backtracking , 2009, IWANN.

[84]  Camelia Chira,et al.  A hybrid evolutionary approach to protein structure prediction with lattice models , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[85]  Gregorio Toscano Pulido,et al.  Comparative Analysis of Different Evaluation Functions for Protein Structure Prediction Under the HP Model , 2013, Journal of Computer Science and Technology.

[86]  Eduardo Segredo,et al.  Multiobjectivisation of the Antenna Positioning Problem , 2011, DCAI.

[87]  Mimma Nardelli,et al.  Cross-lattice behavior of general ACO folding for proteins in the HP model , 2013, SAC '13.

[88]  Dipti Srinivasan,et al.  Multi-objectivization of short-term unit commitment under uncertainty using evolutionary algorithm , 2012, 2012 IEEE Congress on Evolutionary Computation.

[89]  Jean-Paul Watson,et al.  An Introduction to Fitness Landscape Analysis and Cost Models for Local Search , 2010 .

[90]  N. Eldredge,et al.  Punctuated equilibrium comes of age , 1993, Nature.

[91]  Ralph Arnote,et al.  Hong Kong (China) , 1996, OECD/G20 Base Erosion and Profit Shifting Project.