Branch-and-Bound interval global optimization on shared memory multiprocessors

The focus of this paper is on the analysis and evaluation of a type of parallel strategies applied to the algorithm Advanced Multidimensional Interval analysis Global Optimization (AMIGO). We investigate two parallel versions of AMIGO, called Parallel AMIGO (PAMIGO) algorithm, Global-PAMIGO and Local-PAMIGO. The idea behind our study is that in order to exploit the potential parallelism of algorithms, researchers need to adapt them to the target computer architectures. Our PAMIGO algorithms have been designed for shared memory architectures and are based on a threaded programming model, which is suitable to be run on current personal computers with multicore processors. Our first experimental results show a promising speed-up up to four process units. We analyse the loss of efficiency when the number of process units is greater than four by obtaining a profile of the algorithm executions. Secondly we experiment with the use of a local memory allocator per thread. This increases the efficiency by reducing the number of lock conflicts given by the standard system memory allocator. Our experimental results for both PAMIGO versions, using up to 15 process units, obtain a good performance for hard to solve problems on unicore and multicore processors. It is noteworthy that both versions of PAMIGO obtain a similar performance. Our experiments may be useful for researchers who use parallel B&B algorithms.

[1]  Panos M. Pardalos,et al.  Parallel algorithms for global optimization problems , 1996, Solving Combinatorial Optimization Problems in Parallel.

[2]  Bradford Nichols,et al.  Pthreads programming - a POSIX standard for better multiprocessing , 1996 .

[3]  Jerry Eriksson,et al.  A parallel interval method implementation for global optimization using dynamic load balancing , 1995, Reliab. Comput..

[4]  Kaj Madsen,et al.  Use of a Real-Valued Local Minimum in Parallel Interval Global Optimization , 1994 .

[5]  Suiunbek Ibraev,et al.  A new parallel method for verified global optimization , 2002 .

[6]  Afonso Ferreira,et al.  Parallel best-first branch-and-bound in discrete optimization: a framework , 1995, Solving Combinatorial Optimization Problems in Parallel.

[7]  Inmaculada García,et al.  Work load balance approaches for branch and bound algorithms on distributed systems , 1999, Proceedings of the Seventh Euromicro Workshop on Parallel and Distributed Processing. PDP'99.

[8]  Teodor Gabriel Crainic,et al.  Parallel Branch‐and‐Bound Algorithms , 2006 .

[9]  David A. Bader,et al.  Parallel Algorithm Design for Branch and Bound , 2005 .

[10]  Nathalie Revol,et al.  A Methodology of Parallelization for Continuous Verified Global Optimization , 2001, PPAM.

[11]  Andreas Wiethoff Verifizierte globale Optimierung auf Parallelrechnern , 1997 .

[12]  Inmaculada García,et al.  AMIGO: Advanced Multidimensional Interval analysis Global Optimization algorithm , 2004 .

[13]  H. Zimmermann Towards global optimization 2: L.C.W. DIXON and G.P. SZEGÖ (eds.) North-Holland, Amsterdam, 1978, viii + 364 pages, US $ 44.50, Dfl. 100,-. , 1979 .

[14]  Kevin Ying,et al.  Dynamic Thread Creation: An Asynchronous Load Balancing Scheme For Parallel Searches , 1998 .

[15]  Bernard Gendron,et al.  Parallel Branch-and-Branch Algorithms: Survey and Synthesis , 1994, Oper. Res..

[16]  El Mostafa Daoudi,et al.  Parallelization of the Continuous Global Optimization Problem with Inequality Constraints by Using Interval Arithmetic , 2001, HPCN Europe.

[17]  Sonja Berner,et al.  Parallel methods for verified global optimization practice and theory , 1996, J. Glob. Optim..

[18]  R. B. Kearfott Rigorous Global Search: Continuous Problems , 1996 .

[19]  Teodor Gabriel Crainic,et al.  PARALLEL BRANCH-AND-BOUND ALGORITHMS: SURVEY AND SYNTHESIS , 1993 .

[20]  L. Dixon,et al.  Parallel algorithms for global optimization , 1993 .

[21]  Simon Kahan,et al.  "MAMA!": a memory allocator for multithreaded architectures , 2006, PPoPP '06.

[22]  Eldon Hansen,et al.  Global optimization using interval analysis , 1992, Pure and applied mathematics.

[23]  José A. Martínez,et al.  Interval Parallel Global Optimization with Charm++ , 2004, PARA.

[24]  Kathryn S. McKinley,et al.  Hoard: a scalable memory allocator for multithreaded applications , 2000, SIGP.

[25]  A. Neumaier Interval methods for systems of equations , 1990 .

[26]  Jon G. Rokne,et al.  New computer methods for global optimization , 1988 .

[27]  Tibor Csendes,et al.  On the selection of subdivision directions in interval branch-and-bound methods for global optimization , 1995, J. Glob. Optim..

[28]  Coromoto León,et al.  Performance analysis of branch-and-bound skeletons , 2006, 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP'06).

[29]  Ramon E. Moore,et al.  Rigorous methods for global optimization , 1992 .

[30]  Jens Clausen,et al.  Parallel Search-Based Methods in Optimization , 1996, PARA.