Parallel adaptive tabu search for large optimization problems

This paper presents a new approach for parallel tabu search based on adaptive par-allelism. Adaptive parallelism demonstrates that massively parallel computing using a hundred of heterogeneous machines is feasible to solve large optimization problems. The parallel tabu search algorithm includes diierent tabu list sizes and new intensiication/diversiication mechanisms. Encouraging results have been obtained in solving the quadratic assignment problem. We have improved the best known solutions for some large real-world problems. 1 Motivation and goals Many interesting combinatorial optimization problems are NP-hard, and then they cannot be solved exactly within a reasonable amount of time. Consequently, heuris-tics must be used to solve real-world problems. Tabu search (TS) is a general purpose heuristic (meta-heuristic) that has been proposed by Glover 1]. TS has achieved widespread successes in solving practical optimization problems in diier-ent domains (resource management, process design, logistics, telecommunications, ...). Promising results of applying TS to a variety of academic optimization problems (traveling salesman, quadratic assignment, time-tabling, job-shop scheduling, ...) are reported in the literature 2]. Solving large problems motivates the development of a parallel implementation of TS. The proliferation of powerful workstations and fast communication networks with constantly decreasing cost/performance ratio have shown the emergence of heterogeneous workstation networks and homogeneous clusters of processors (DEC Alpha farms, IBM SP/2, Cray T3D, CM-5, ...) as platforms for high performance computing. These parallel platforms are generally composed of an important park of machines shared by many users. Many parallel TS algorithms have been proposed in the literature. In general, they don't use advanced programming tools (load balancing, adaptive parallelism, checkpointing, ...) to eeciently use the machines. Most of them are developed for dedicated parallel homogeneous machines. Load analysis of networks of workstations during long periods of time showed that only a few percentage of the available power was used 3]]4]. There is a substantial amount of idle time. In addition, a workstation belongs to an owner who will not tolerate external applications degrading the performance of his machine. Therefore, dynamic adaptive scheduling of parallel applications is essential. Our aim is to develop a parallel adaptive TS strategy, which can beneet greatly from a platform having combined computing resources of massively parallel ma

[1]  T. Koopmans,et al.  Assignment Problems and the Location of Economic Activities , 1957 .

[2]  Marvin Theimer,et al.  Finding idle machines in a workstation-based distributed system , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[3]  É. Taillard COMPARISON OF ITERATIVE SEARCHES FOR THE QUADRATIC ASSIGNMENT PROBLEM. , 1995 .

[4]  C. Reeves Modern heuristic techniques for combinatorial problems , 1993 .

[5]  Éric D. Taillard,et al.  Robust taboo search for the quadratic assignment problem , 1991, Parallel Comput..

[6]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[7]  Miron Livny,et al.  Parallel Processing on Dynamic Resources with CARMI , 1995, JSSPP.

[8]  Catherine Roucairol,et al.  A Parallel Tabu Search Algorithm Using Ejection Chains for the Vehicle Routing Problem , 1996 .

[9]  Celso C. Ribeiro,et al.  Parallel tabu search message-passing synchronous strategies for task scheduling under precedence constraints , 1996, J. Heuristics.

[10]  David A. Nichols,et al.  Using idle workstations in a shared computing environment , 1987, SOSP '87.

[11]  Teofilo F. Gonzalez,et al.  P-Complete Approximation Problems , 1976, J. ACM.

[12]  Éric D. Taillard,et al.  Parallel iterative search methods for vehicle routing problems , 1993, Networks.

[13]  E. Talbi,et al.  MARS * : Adaptive scheduling of parallel applications in a multi-userheterogeneous environmentZ , 1996 .

[14]  David Gelernter,et al.  Supercomputing out of recycled garbage: preliminary experience with Piranha , 1992, ICS '92.

[15]  Panos M. Pardalos,et al.  The Quadratic Assignment Problem: A Survey and Recent Developments , 1993, Quadratic Assignment and Related Problems.

[16]  Stefan Voß,et al.  Tabu Search: Applications and Prospects , 1993 .

[17]  Jadranka Skorin-Kapov,et al.  Massively parallel tabu search for the quadratic assignment problem , 1993, Ann. Oper. Res..

[18]  Michel Gendreau,et al.  TOWARDS A TAXONOMY OF PARALLEL TABU SEARCH ALGORITHMS. , 1993 .

[19]  Miroslaw Malek,et al.  Serial and parallel simulated annealing and tabu search algorithms for the traveling salesman problem , 1990 .

[20]  Michel Gendreau,et al.  A PARALLEL TABU SEARCH HEURISTIC FOR THE VEHICLE ROUTING PROBLEM WITH TIME WINDOWS , 1997 .

[21]  Jens Clausen,et al.  Joining forces in solving large-scale quadratic assignment problems in parallel , 1997, Proceedings 11th International Parallel Processing Symposium.

[22]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..