Towards a multigrid method for the minimum-cost flow problem

We present a first step towards a multigrid method for solving the min-cost flow problem. Specifically, we present a strategy that takes advantage of existing black-box fast iterative linear solvers, i.e. algebraic multigrid methods. We show with standard benchmarks that, while less competitive than combinatorial techniques on small problems that run on a single core, our approach scales well with problem size, complexity, and number of processors, allowing for tackling large-scale problems on modern parallel architectures. Our approach is based on combining interior-point with multigrid methods for solving the nonlinear KKT equations via Newton's method. However, the Jacobian matrix arising in the Newton iteration is indefinite and its condition number cannot be expected to be bounded. In fact, the eigenvalues of the Jacobian can both vanish and blow up near the solution, leading to a significant slow-down of the convergence speed of iterative solvers - or to the loss of convergence at all. In order to allow for the application of multigrid methods, which have been originally designed for elliptic problems, we furthermore show that the occurring Jacobian can be interpreted as the stiffness matrix of a mixed formulation of the weighted graph Laplacian of the network, whose metric depends on the slack variables and the multipliers of the inequality constraints. Together with our regularization, this allows for the application of a black-box algebraic multigrid method on the Schur-complement of the system.

[1]  Robert E. Tarjan,et al.  Faster Scaling Algorithms for Network Problems , 1989, SIAM J. Comput..

[2]  James B. Orlin,et al.  A faster strongly polynomial minimum cost flow algorithm , 1993, STOC '88.

[3]  Michael P. Friedlander,et al.  A primal–dual regularized interior-point method for convex quadratic programs , 2010, Mathematical Programming Computation.

[4]  N. Tomizawa,et al.  On some techniques useful for solution of transportation network problems , 1971, Networks.

[5]  David S. Johnson,et al.  Network Flows and Matching: First DIMACS Implementation Challenge , 1993 .

[6]  Andrew V. Goldberg,et al.  Finding minimum-cost circulations by canceling negative cycles , 1989, JACM.

[7]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[8]  Stefano Serra Capizzano,et al.  Accelerated multigrid for graph Laplacian operators , 2015, Appl. Math. Comput..

[9]  Andrew V. Goldberg,et al.  Finding minimum-cost flows by double scaling , 2015, Math. Program..

[10]  Andrew V. Goldberg,et al.  Solving minimum-cost flow problems by successive approximation , 1987, STOC.

[11]  Andrew V. Goldberg,et al.  On Implementing Scaling Push-Relabel Algorithms for the Minimum-Cost Flow Problem , 1991, Network Flows And Matching.

[12]  Dietrich Braess Finite Elements: Introduction , 2007 .

[13]  Raanan Fattal,et al.  Efficient simulation of inextensible cloth , 2007, SIGGRAPH 2007.

[14]  M. Klein A Primal Method for Minimal Cost Flows with Applications to the Assignment and Transportation Problems , 1966 .

[15]  Péter Kovács,et al.  Minimum-cost flow algorithms: an experimental evaluation , 2015, Optim. Methods Softw..

[16]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, STOC '84.

[17]  Richard M. Karp,et al.  Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems , 1972, Combinatorial Optimization.

[18]  ROLF KRAUSE,et al.  A Nonsmooth Multiscale Method for Solving Frictional Two-Body Contact Problems in 2D and 3D with Multigrid Efficiency , 2008, SIAM J. Sci. Comput..

[19]  Daniel A. Spielman,et al.  Faster approximate lossy generalized flow via interior point algorithms , 2008, STOC.

[20]  Achi Brandt,et al.  Lean Algebraic Multigrid (LAMG): Fast Graph Laplacian Linear Solver , 2011, SIAM J. Sci. Comput..

[21]  Kim-Chuan Toh,et al.  Preconditioning and iterative solution of symmetric indefinite linear systems arising from interior point methods for linear programming , 2007, Comput. Optim. Appl..

[22]  James B. Orlin A Faster Strongly Polynomial Minimum Cost Flow Algorithm , 1993, Oper. Res..

[23]  Cosmin G. Petra,et al.  Multigrid Preconditioning of Linear Systems for Interior Point Methods Applied to a Class of Box-constrained Optimal Control Problems , 2010, SIAM J. Numer. Anal..

[24]  Mario Costantini,et al.  A novel phase unwrapping method based on network programming , 1998, IEEE Trans. Geosci. Remote. Sens..

[25]  D. Sorensen,et al.  A new class of preconditioners for large-scale linear systems from interior point methods for linear programming , 2005 .

[26]  Volker Schulz,et al.  Interior point multigrid methods for topology optimization , 2000 .

[27]  Dimitri P. Bertsekas,et al.  Parallel primal-dual methods for the minimum cost flow problem , 1993, Comput. Optim. Appl..

[28]  Jacek Gondzio,et al.  Matrix-free interior point method , 2012, Comput. Optim. Appl..

[29]  Mauricio G. C. Resende,et al.  Fortran subroutines for network flow optimization using an interior point algorithm , 2008 .

[30]  Claudio Gentile,et al.  Experiments with a hybrid interior point/combinatorial approach for network flow problems , 2007, Optim. Methods Softw..

[31]  Robert D. Falgout,et al.  hypre: A Library of High Performance Preconditioners , 2002, International Conference on Computational Science.

[32]  D. R. Fulkerson,et al.  Constructing Maximal Dynamic Flows from Static Flows , 1958 .