Symmetric and Asymmetric Parallelization of a Cost-Decomposition Algorithm for Multicommodity Flow Problems

We study the coarse-grained parallelization of an efficient bundle-based cost-decomposition algorithm for the solution of multicommodity min-cost flow (MMCF) problems. We show that a code exploiting only the natural parallelism inherent in the cost-decomposition approach, i.e., solving the min-cost flow subproblems in parallel, obtains satisfactory efficiencies even with many processors on large, difficult MMCF problems with many commodities. This is exactly the class of instances where the decomposition approach attains its best results in sequential. The parallel code we developed is highly portable and flexible, and it can be used on different machines. We also show how to exploit a common characteristic of current supercomputer facilities, i.e., the side-to-side availability of massively parallel and vector supercomputers, to implement an asymmetric decomposition algorithm where each architecture is used for the tasks for which it is best suited.

[1]  David Abramson,et al.  A Parallel Interior Point Method and Its Application to Facility Location Problems , 1998, Comput. Optim. Appl..

[2]  Antonio Frangioni,et al.  Computational Experience with a Parallel Implementation of an Interior-Point Algorithm for Multicommodity Network Flows , 1999, System Modelling and Optimization.

[3]  John M. Mulvey,et al.  Vectorization and multitasking of nonlinear network programming algorithms , 1988, Math. Program..

[4]  D. Medhi Parallel bundle-based decomposition for large-scale structured mathematical programming problems , 1990 .

[5]  Giorgio Gallo,et al.  A Bundle Type Dual-Ascent Approach to Linear Multicommodity Min-Cost Flow Problems , 1999, INFORMS J. Comput..

[6]  Michael C. Ferris,et al.  Parallel Variable Distribution , 1994, SIAM J. Optim..

[7]  Mustafa Ç. Pinar,et al.  Parallel Decomposition of Multicommodity Network Flows Using a Linear-Quadratic Penalty Algorithm , 1992, INFORMS J. Comput..

[8]  Stavros A. Zenios,et al.  On the Fine-Grain Decomposition of Multicommodity Transportation Problems , 1991, SIAM J. Optim..

[9]  Stavros A. Zenios,et al.  Data parallel computing for network-structured optimization problems , 1994, Comput. Optim. Appl..

[10]  Teodor Gabriel Crainic,et al.  Bundle-based relaxation methods for multicommodity capacitated fixed charge network design , 2001, Discret. Appl. Math..

[11]  Michael C. Ferris,et al.  Partitioning mathematical programs for parallel solution , 1998, Math. Program..

[12]  M C Ferris,et al.  Parallel Constraint Distribution , 1991, SIAM J. Optim..

[13]  S. Kontogiorgis,et al.  Alternating direction splitting for block Angular parallel optimization , 1996 .

[14]  R. Ravi,et al.  Approximation through multicommodity flow , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[15]  Robert R. Meyer,et al.  An Interior Point Method for Block Angular Optimization , 1991, SIAM J. Optim..

[16]  James K. Ho,et al.  Decomposition of linear programs using parallel computation , 1988, Math. Program..

[17]  O. SIAMJ.,et al.  A SPECIALIZED INTERIOR-POINT ALGORITHM FOR MULTICOMMODITY NETWORK FLOWS∗ , 1996 .

[18]  Manlio Gaudioso,et al.  Nonsmooth optimization methods for parallel decomposition of multicommodity flow problems , 1993, Ann. Oper. Res..

[19]  Antonio Frangioni,et al.  Solving semidefinite quadratic problems within nonsmooth optimization algorithms , 1996, Comput. Oper. Res..

[20]  Leonid Khachiyan,et al.  An exponential-function reduction method for block-angular convex programs , 1995, Networks.

[21]  Guangye Li,et al.  An implementation of a parallel primal-dual interior point method for block-structured linear programs , 1992, Comput. Optim. Appl..

[22]  Dimitri P. Bertsekas,et al.  Linear network optimization - algorithms and codes , 1991 .

[23]  Peter C. Patton Performance limits for parallel processors , 1989 .

[24]  James K. Ho,et al.  Load balancing in the parallel optimization of block-angular linear programs , 1993, Math. Program..

[25]  Robert R. Meyer,et al.  Coordination in Coarse-Grained Decomposition , 1994, SIAM J. Optim..

[26]  Antonio Frangioni,et al.  Generalized Bundle Methods , 2002, SIAM J. Optim..

[27]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .