Relaxation Method for Large Scale Linear Programming Using Decomposition

We propose a new decomposition method for large-scale linear programming. This method dualizes an (arbitrary) subset of the constraints and then maximizes the resulting dual functional by dual ascent. The ascent directions are chosen from a finite set and are generated by a truncated version of the painted index algorithm of Rockafellar. Central to this method is the novel notion of (e, δ)-complementary slackness (e ≥ 0, δ ∈ [0, 1]) which allows each Lagrangian subproblem to be solved only approximately with O(eδ) accuracy and provides a lower bound of Ω(e(1 − δ)) on the amount of improvement per dual ascent. By dynamically adjusting e, the subproblems can be solved with increasing accuracy. We show that (i) the method terminates finitely, provided that e and δ are bounded away from 0 and 1, respectively, (ii) the final solution produced by the method is feasible and is within O(e) in cost of the optimal cost, and (iii) the final solution produced by the method is optimal for all e sufficiently small.

[1]  N. Z. Shor The rate of convergence of the generalized gradient descent method , 1968 .

[2]  Paul Tseng,et al.  Relaxation Methods for Minimum Cost Ordinary and Generalized Network Flow Problems , 1988, Oper. Res..

[3]  Dimitri P. Bertsekas,et al.  Dual coordinate step methods for linear network flow problems , 1988, Math. Program..

[4]  Robert E. Tarjan,et al.  Data structures and network algorithms , 1983, CBMS-NSF regional conference series in applied mathematics.

[5]  R. Rockafellar The Elementary Vectors of a Subspace of RiY , 2022 .

[6]  Y. Ye Eliminating columns in the simplex method for linear programming , 1989 .

[7]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[8]  Philip Wolfe,et al.  Validation of subgradient optimization , 1974, Math. Program..

[9]  Thomas L. Magnanti,et al.  Deterministic network optimization: A bibliography , 1977, Networks.

[10]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[11]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[12]  Boris Polyak Minimization of unsmooth functionals , 1969 .

[13]  Vladimir F. Demjanov Algorithms for Some Minimax Problems , 1968, J. Comput. Syst. Sci..

[14]  Arjang A. Assad,et al.  Multicommodity network flows - A survey , 1978, Networks.

[15]  Decision Systems.,et al.  Relaxation Method for Linear Programs with Side Constraints , 1987 .

[16]  Claude Lemaréchal,et al.  An Algorithm for Minimizing Convex Functions , 1974, IFIP Congress.

[17]  Werner Oettli,et al.  An iterative method, having linear rate of convergence, for solving a pair of dual linear programs , 1972, Math. Program..

[18]  Jeff L. Kennington,et al.  A Survey of Linear Cost Multicommodity Network Flows , 1978, Oper. Res..

[19]  Paul Tseng,et al.  Relaxation Methods for Linear Programs , 1987, Math. Oper. Res..

[20]  R. Grinold Steepest Ascent for Large Scale Linear Programs , 1972 .

[21]  Dimitri P. Bertsekas,et al.  Distributed Asynchronous Relaxation Methods for Linear Network Flow Problems , 1987 .

[22]  T. L. Magnanti OPTIMIZATION FOR SPARSE SYSTEMS , 1976 .

[23]  R. Rockafellar MONOTROPIC PROGRAMMING: DESCENT ALGORITHMS AND DUALITY , 1981 .

[24]  Cynthia Barnhart A network-based primal-dual solution methodology for the multi-commodity network flow problem , 1988 .

[25]  D. Bertsekas,et al.  A DESCENT NUMERICAL METHOD FOR OPTIMIZATION PROBLEMS WITH NONDIFFERENTIABLE COST FUNCTIONALS , 1973 .

[26]  Paul Tseng,et al.  Relaxation methods for monotropic programs , 1990, Math. Program..

[27]  Paul Tseng,et al.  Relaxation methods for monotropic programming problems , 1986 .

[28]  W. D. Northup,et al.  USING DUALITY TO SOLVE DISCRETE OPTIMIZATION PROBLEMS: THEORY AND COMPUTATIONAL EXPERIENCE* , 1975 .

[29]  A. Barrett Network Flows and Monotropic Optimization. , 1984 .

[30]  Éva Tardos,et al.  A strongly polynomial minimum cost circulation algorithm , 1985, Comb..