Parallel execution combinatorics with metaheuristics: Comparative study

Abstract Optimization arises everywhere in industrial and engineering fields, with complex and time-consuming problems to be solved. Exact search techniques cannot afford practical solutions for most of the real-life problems in reasonable time-bound. Metaheuristics proved to be numerically efficient solvers for such problems in terms of solution quality, however, they could require large time and energy to get the optimal solution. Parallelization (i.e., distributed) is a promising approach for overcoming the overwhelming energy and time consumption values of these methods. Despite recent approaches in running metaheuristics in parallel, the community still lacks for novel studies comparing and benchmarking the canonical optimization techniques while being running in parallel. In this work, we present two extensive studies to the solution quality, energy consumption, and execution time for three different metaheuristics (Genetic Algorithm, Variable Neighborhood Search, and Simulated Annealing) and their distributed counterparts. The main aim of our studies is exploring the efficiency of parallel execution of the metaheuristics while being running in new computing environments. Here, we want to identify the combinatorics between metaheuristics and solving optimization problems while being run in parallel. For our studies, we consider a multicore machine with 32 cores. This choice to a recent and commonly used system shall enrich the existing literature for multicore systems against the enormous existing studies over cluster systems. The analyses and discussions for the results of the different algorithms exhibit the combinatorics between the different metaheuristics and the parallel execution using a different number of cores. The outcome of these studies builds a guide for future designs of efficient and energy-aware optimization techniques.

[1]  Ling Wang,et al.  A collaborative optimization algorithm for energy-efficient multi-objective distributed no-idle flow-shop scheduling , 2019, Swarm Evol. Comput..

[2]  Jia Luo,et al.  GPU based parallel genetic algorithm for solving an energy efficient dynamic flexible flow shop scheduling problem , 2019, J. Parallel Distributed Comput..

[3]  Kalyanmoy Deb,et al.  A survey of evolutionary algorithms using metameric representations , 2019, Genetic Programming and Evolvable Machines.

[4]  Slawomir Koziel,et al.  Computational Optimization, Methods and Algorithms , 2016, Computational Optimization, Methods and Algorithms.

[5]  Harish Sharma,et al.  A Survey on Parallel Particle Swarm Optimization Algorithms , 2019, Arabian Journal for Science and Engineering.

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Karthikeyan Venkitusamy,et al.  Multi objective evolutionary algorithm for designing energy efficient distribution transformers , 2018, Swarm Evol. Comput..

[8]  Zhile Yang,et al.  Multi-population techniques in nature inspired optimization algorithms: A comprehensive survey , 2019, Swarm Evol. Comput..

[9]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[10]  Abraham Duarte,et al.  A Variable Neighborhood Search approach for the Hamiltonian p-median problem , 2019, Appl. Soft Comput..

[11]  Mohamed Cheriet,et al.  A Survey on Metrics and Measurement Tools for Sustainable Distributed Cloud Networks , 2018, IEEE Communications Surveys & Tutorials.

[12]  Wolfgang Amrhein,et al.  Comparative Analysis of Two Asynchronous Parallelization Variants for a Multi-Objective Coevolutionary Solver , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[13]  Vitor Nazário Coelho,et al.  Exploring parallel multi-GPU local search strategies in a metaheuristic framework , 2018, J. Parallel Distributed Comput..

[14]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[15]  Mitsuo Gen,et al.  Genetic Algorithms , 1999, Wiley Encyclopedia of Computer Science and Engineering.

[16]  Enrique Alba,et al.  Improving flexibility and efficiency by adding parallelism to genetic algorithms , 2002, Stat. Comput..

[17]  Enrique Alba,et al.  Speed-up of synchronous and asynchronous distributed Genetic Algorithms: A first common approach on multiprocessors , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[18]  Dietmar Fey,et al.  Performance investigations of genetic algorithms on graphics cards , 2013, Swarm Evol. Comput..

[19]  Raymond Chiong,et al.  Energy-efficient flexible flow shop scheduling with worker flexibility , 2020, Expert Syst. Appl..

[20]  Tansel Dökeroglu,et al.  A survey on new generation metaheuristic algorithms , 2019, Comput. Ind. Eng..

[21]  Mitsuo Gen,et al.  Accelerating genetic algorithms with GPU computing: A selective overview , 2019, Comput. Ind. Eng..

[22]  Tapio Niemi,et al.  RAPL in Action , 2018, ACM Trans. Model. Perform. Evaluation Comput. Syst..

[23]  Samuel Xavier de Souza,et al.  Parallel synchronous and asynchronous coupled simulated annealing , 2018, The Journal of Supercomputing.

[24]  David A. Bader,et al.  Alternating criteria search: a parallel large neighborhood search algorithm for mixed integer programs , 2018, Comput. Optim. Appl..

[25]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[26]  Ivona Brandic,et al.  Using meta-heuristics and machine learning for software optimization of parallel computing systems: a systematic literature review , 2018, Computing.

[27]  Kenneth A. De Jong,et al.  Using Problem Generators to Explore the Effects of Epistasis , 1997, ICGA.

[28]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[29]  Nicos Christofides,et al.  Combinatorial optimization , 1979 .

[30]  Seoung Bum Kim,et al.  Parallel Simulated Annealing with a Greedy Algorithm for Bayesian Network Structure Learning , 2020, IEEE Transactions on Knowledge and Data Engineering.

[31]  Kris Braekers,et al.  The vehicle routing problem: State of the art classification and review , 2016, Comput. Ind. Eng..

[32]  Pascal Bouvry,et al.  Evolutionary Algorithms Based on Game Theory and Cellular Automata with Coalitions , 2013, Handbook of Optimization.

[33]  Enrique Alba,et al.  A component-based study of energy consumption for sequential and parallel genetic algorithms , 2019, The Journal of Supercomputing.

[34]  Mitsuo Gen,et al.  A parallel multi-objective genetic algorithm with learning based mutation for railway scheduling , 2019, Comput. Ind. Eng..

[35]  Deming Lei,et al.  Two-level imperialist competitive algorithm for energy-efficient hybrid flow shop scheduling problem with relative importance of objectives , 2019, Swarm Evol. Comput..

[36]  Enrique Alba,et al.  Analyzing the Energy Consumption of Sequential and Parallel Metaheuristics , 2019, 2019 International Conference on High Performance Computing & Simulation (HPCS).

[37]  Enrique Alba,et al.  Performance analysis of synchronous and asynchronous distributed genetic algorithms on multiprocessors , 2019, Swarm Evol. Comput..