A simple polynomial-time algorithm for convex quadratic programming

In this note we propose a polynomial-time algorithm for convex quadratic programming. This algorithm augments the objective by a logarithmic penalty function and then solves a sequence of quadratic approximations of this program. This algorithm has a complexity of O(ml/2-L) iterations and O(m 3-5 .L) arithmetic operations, where m is the number of variables and L is the size of the problem encoding in binary. The novel feature of this algorithm is that it admits a very simple proof of its complexity, which makes it valuable both as a teaching and as a research tool. The proof uses a new Lyapunov function to measure the duality gap, which has itself interesting properties that can be used in a line search procedure to accelerate convergence. If the cost is separable, the line search is particularly simple to implement and, if the cost is linear, the line search stepsize is obtainable in a closed form. This algorithm maintains both primal and dual feasibility at all iterations.

[1]  C. C. Gonzaga,et al.  An Algorithm for Solving Linear Programming Problems in O(n 3 L) Operations , 1989 .

[2]  R. Freund Projective Transformations for Interior Point Methods, Part II: Analysis of An Algorithm for Finding the Weighted Center of a Polyhedral System , 1988 .

[3]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[4]  G. Sonnevend An "analytical centre" for polyhedrons and new classes of global algorithms for linear (smooth, convex) programming , 1986 .

[5]  Y. Ye Further Development on the Interior Algorithm for Convex Quadratic Programming , 1987 .

[6]  E. Polak Introduction to linear and nonlinear programming , 1973 .

[7]  V. Strassen Gaussian elimination is not optimal , 1969 .

[8]  Shinji Mizuno,et al.  A polynomial-time algorithm for a class of linear complementarity problems , 1989, Math. Program..

[9]  R. C. Monteiro,et al.  An O(n3L) Interior Point Algorithm for Convex Quadratic Programming. , 1987 .

[10]  Sanjay Mehrotra,et al.  An Algorithm for Convex Quadratic Programming That Requires O(n3.5L) Arithmetic Operations , 1990, Math. Oper. Res..

[11]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, Comb..

[12]  N. Z. Shor Utilization of the operation of space dilatation in the minimization of convex functions , 1972 .

[13]  L. Khachiyan,et al.  The polynomial solvability of convex quadratic programming , 1980 .

[14]  R. Kellogg,et al.  Pathways to solutions, fixed points, and equilibria , 1983 .

[15]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[16]  Michael A. Saunders,et al.  On projected newton barrier methods for linear programming and an equivalence to Karmarkar’s projective method , 1986, Math. Program..