An Efficient Hybrid Algorithm for the Separable Convex Quadratic Knapsack Problem

This article considers the problem of minimizing a convex, separable quadratic function subject to a knapsack constraint and a box constraint. An algorithm called NAPHEAP has been developed to solve this problem. The algorithm solves the Karush-Kuhn-Tucker system using a starting guess to the optimal Lagrange multiplier and updating the guess monotonically in the direction of the solution. The starting guess is computed using the variable fixing method or is supplied by the user. A key innovation in our algorithm is the implementation of a heap data structure for storing the break points of the dual function and computing the solution of the dual problem. Also, a new version of the variable fixing algorithm is developed that is convergent even when the objective Hessian is not strictly positive definite. The hybrid algorithm NAPHEAP that uses a Newton-type method (variable fixing method, secant method, or Newton's method) to bracket a root, followed by a heap-based monotone break point search, can be faster than a Newton-type method by itself, as demonstrated in the numerical experiments.

[1]  Phillipp Kaestner,et al.  Linear And Nonlinear Programming , 2016 .

[2]  William W. Hager,et al.  Optimality conditions for maximizing a function over a polyhedron , 2014, Math. Program..

[3]  Naum Zuselevich Shor,et al.  Minimization Methods for Non-Differentiable Functions , 1985, Springer Series in Computational Mathematics.

[4]  William W. Hager,et al.  A multilevel bilinear programming algorithm for the vertex separator problem , 2018, Comput. Optim. Appl..

[5]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[6]  Bala Shetty,et al.  A Parallel Projection for the Multicommodity Network Model , 1990 .

[7]  Panos M. Pardalos,et al.  An algorithm for a singly constrained class of quadratic programs subject to upper and lower bounds , 1990, Math. Program..

[8]  Jeffery L. Kennington,et al.  A polynomially bounded algorithm for a singly constrained quadratic program , 1980, Math. Program..

[9]  C. Michelot A finite algorithm for finding the projection of a point onto the canonical simplex of ∝n , 1986 .

[10]  William W. Hager,et al.  A New Active Set Algorithm for Box Constrained Optimization , 2006, SIAM J. Optim..

[11]  Stavros A. Zenios,et al.  Massively Parallel Algorithms for Singly Constrained Convex Programs , 1992, INFORMS J. Comput..

[12]  A DavisTimothy,et al.  An Efficient Hybrid Algorithm for the Separable Convex Quadratic Knapsack Problem , 2016 .

[13]  Bala Shetty,et al.  Quadratic resource allocation with generalized upper bounds , 1997, Oper. Res. Lett..

[14]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[15]  F. Clarke Generalized gradients and applications , 1975 .

[16]  Dorit S. Hochbaum,et al.  About strongly polynomial time algorithms for quadratic optimization over submodular constraints , 1995, Math. Program..

[17]  P. Brucker Review of recent development: An O( n) algorithm for quadratic knapsack problems , 1984 .

[18]  N. Maculan,et al.  An O(n) Algorithm for Projecting a Vector on the Intersection of a Hyperplane and a Box in Rn , 2003 .

[19]  William W. Hager,et al.  Continuous quadratic programming formulations of optimization problems on graphs , 2015, Eur. J. Oper. Res..

[20]  K. Kiwiel Variable Fixing Algorithms for the Continuous Quadratic Knapsack Problem , 2008 .

[21]  J. J. Moré,et al.  Quasi-Newton updates with bounds , 1987 .

[22]  William W. Hager,et al.  Graph Partitioning and Continuous Quadratic Programming , 1999, SIAM J. Discret. Math..

[23]  References , 1971 .

[24]  Jose A. Ventura,et al.  Computational development of a lagrangian dual approach for quadratic networks , 1991, Networks.

[25]  Dorit S. Hochbaum,et al.  Strongly Polynomial Algorithms for the Quadratic Transportation Problem with a Fixed Number of Sources , 1994, Math. Oper. Res..

[26]  Siddhartha S. Syam,et al.  A Projection Method for the Integer Quadratic Knapsack Problem , 1996 .

[27]  Yu-Hong Dai,et al.  Improved Projected Gradient Algorithms for Singly Linearly Constrained Quadratic Programs Subject to Lower and Upper Bounds , 2010, Asia Pac. J. Oper. Res..

[28]  Roberto Cominetti,et al.  A Newton’s method for the continuous quadratic knapsack problem , 2014, Math. Program. Comput..

[29]  A. G. Robinson,et al.  On the continuous quadratic knapsack problem , 1992, Math. Program..

[30]  Roger Fletcher,et al.  New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds , 2006, Math. Program..

[31]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[32]  J. Danskin The Theory of Max-Min and its Application to Weapons Allocation Problems , 1967 .

[33]  Arnoldo C. Hax,et al.  Disaggregation and Resource Allocation Using Convex Knapsack Problems with Bounded Variables , 1981 .

[34]  James T. Hungerford,et al.  THE SEPARABLE CONVEX QUADRATIC KNAPSACK PROBLEM , 2013 .