On the convergence of the affine-scaling algorithm

AbstractThe affine-scaling algorithm, first proposed by Dikin, is presently enjoying great popularity as a potentially effective means of solving linear programs. An outstanding question about this algorithm concerns its convergence in the presence of degeneracy. In this paper, we give new convergence results for this algorithm that do not require any non-degeneracy assumption on the problem. In particular, we show that if the stepsize choice of either Dikin or Barnes or Vanderbei, et al. is used, then the algorithm generates iterates that converge at least linearly with a convergence ratio of $$1 - \beta /\sqrt n $$ , wheren is the number of variables andβ ∈ (0,1] is a certain stepsize ratio. For one particular stepsize choice which is an extension of that of Barnes, we show that the cost of the limit point is within O(β/(1−β)) of the optimal cost and, forβ sufficiently small (roughly, proportional to how close the cost of the nonoptimal vertices are to the optimal cost), is exactly optimal. We prove the latter result by using an unusual proof technique, that of analyzing the ergodic convergence of the corresponding dual vectors. For the special case of network flow problems with integer data, we show that it suffices to takeβ = 1/(6mC), wherem is the number of constraints andC is the sum of the cost coefficients, to attain exact optimality.

[1]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[2]  Pravin M. Vaidya,et al.  An algorithm for linear programming which requires O(((m+n)n2+(m+n)1.5n)L) arithmetic operations , 1987, Math. Program..

[3]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[4]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, STOC '84.

[5]  Shinji Mizuno,et al.  A polynomial-time algorithm for a class of linear complementarity problems , 1989, Math. Program..

[6]  Y. Ye An extension of Karmarkar's algorithm and the trust region method for quadratic programming , 1989 .

[7]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[8]  James Renegar,et al.  A polynomial-time algorithm, based on Newton's method, for linear programming , 1988, Math. Program..

[9]  O. Mangasarian,et al.  Lipschitz continuity of solutions of linear inequalities, programs and complementarity problems , 1987 .

[10]  Paul Tseng,et al.  Relaxation Methods for Linear Programs , 1987, Math. Oper. Res..

[11]  D. Bertsekas Network Flows and Monotropic Optimization (R. T. Rockafellar) , 1985 .

[12]  Mauricio G. C. Resende,et al.  A Polynomial-Time Primal-Dual Affine Scaling Algorithm for Linear and Convex Quadratic Programming and Its Power Series Extension , 1990, Math. Oper. Res..

[13]  A. Hoffman On approximate solutions of systems of linear inequalities , 1952 .

[14]  Dimitri P. Bertsekas,et al.  Dual coordinate step methods for linear network flow problems , 1988, Math. Program..

[15]  Paul Tseng,et al.  Complexity analysis of a linear complementarity algorithm based on a Lyapunov function , 1992, Math. Program..

[16]  R. C. Monteiro,et al.  Interior path following primal-dual algorithms , 1988 .

[17]  Earl R. Barnes,et al.  A variation on Karmarkar’s algorithm for solving linear programming problems , 1986, Math. Program..

[18]  Roy E. Marsten,et al.  Implementation of a Dual Affine Interior Point Algorithm for Linear Programming , 1989, INFORMS J. Comput..

[19]  Robert J. Vanderbei,et al.  Affine-scaling for linear programs with free variables , 1989, Math. Program..

[20]  K. Kortanek,et al.  Convergence results and numerical experiments on a linear programming hybrid algorithm , 1987 .

[21]  I. I. Dikin Letter to the editor , 1988, Math. Program..

[22]  土谷 隆 Global Convergence Property of the Affine - Scaling Methods for Primal Degenerate Linear Programming Problems , 1989 .

[23]  S. M. Robinson Bounds for error in the solution set of a perturbed linear program , 1973 .

[24]  Yinyu Ye,et al.  An O(n3L) potential reduction algorithm for linear programming , 1991, Math. Program..

[25]  Clyde L. Monma,et al.  Computational experience with a dual affine variant of Karmarkar's method for linear programming , 1987 .

[26]  R. Vanderbei Dikin ' s Convergence Result for the Affine-Scaling Algorithm , 1990 .

[27]  Mauricio G. C. Resende,et al.  Data Structures and Programming Techniques for the Implementation of Karmarkar's Algorithm , 1989, INFORMS J. Comput..

[28]  Renato D. C. Monteiro,et al.  Limiting behavior of the affine scaling continuous trajectories for linear programming problems , 1991, Math. Program..

[29]  Jeanne M. Jacobson,et al.  Letter to the , 1991 .

[30]  Nimrod Megiddo,et al.  Boundary Behavior of Interior Point Algorithms in Linear Programming , 1989, Math. Oper. Res..

[31]  Gregory B. Passty Ergodic convergence to a zero of the sum of monotone operators in Hilbert space , 1979 .

[32]  Takashi Tsuchiya,et al.  Global convergence of the affine scaling methods for degenerate linear programming problems , 1991, Math. Program..

[33]  Paul Tseng,et al.  Relaxation methods for monotropic programs , 1990, Math. Program..

[34]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[35]  Sanjay Mehrotra,et al.  A method of analytic centers for quadratically constrained convex quadratic programs , 1991 .

[36]  C. C. Gonzaga,et al.  An Algorithm for Solving Linear Programming Problems in O(n 3 L) Operations , 1989 .