Random knapsack in expected polynomial time

We present the first average-case analysis proving a polynomial upper bound on the expected running time of an exact algorithm for the 0/1 knapsack problem. In particular, we prove for various input distributions, that the number of Pareto-optimal knapsack fillings is polynomially bounded in the number of available items. An algorithm by Nemhauser and Ullmann can enumerate these solutions very efficiently so that a polynomial upper bound on the number of Pareto-optimal solutions implies an algorithm with expected polynomial running time.The random input model underlying our analysis is quite general and not restricted to a particular input distribution. We assume adversarial weights and randomly drawn profits (or vice versa). Our analysis covers general probability distributions with finite mean and, in its most general form, can even handle different probability distributions for the profits of different items. This feature enables us to study the effects of correlations between profits and weights. Our analysis confirms and explains practical studies showing that so-called strongly correlated instances are harder to solve than weakly correlated ones.

[1]  George S. Lueker,et al.  On the Average Difference between the Solutions to Linear and Integer Knapsack Problems , 1982 .

[2]  Andrew V. Goldberg,et al.  On finding the exact solution of a zero-one knapsack problem , 1984, STOC '84.

[3]  George S. Lueker Exponentially small bounds on the expected optimum of the partition and subset sum problems , 1998 .

[4]  Claude Puech,et al.  Probabilistic analysis of the subset-sum problem , 1982, Discret. Appl. Math..

[5]  George S. Lueker,et al.  Average-case analysis of off-line and on-line knapsack problems , 1995, SODA '95.

[6]  Moni Naor,et al.  Efficient cryptographic schemes provably as secure as subset sum , 2004, Journal of Cryptology.

[7]  Karl Heinz Borgwardt,et al.  Average Saving Effects in Enumerative Methods for Solving Knapsack Problems , 1994, J. Complex..

[8]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[9]  Paolo Toth,et al.  New trends in exact algorithms for the 0-1 knapsack problem , 2000, Eur. J. Oper. Res..

[10]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[11]  Mihalis Yannakakis,et al.  On the approximability of trade-offs and optimal access of Web sources , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[12]  Egon Balas,et al.  An Algorithm for Large Zero-One Knapsack Problems , 1980, Oper. Res..

[13]  Alan M. Frieze,et al.  On the Lagarias-Odlyzko Algorithm for the Subset Sum Problem , 1986, SIAM J. Comput..

[14]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[15]  S. Martello,et al.  Algorithms for Knapsack Problems , 1987 .

[16]  G. Nemhauser,et al.  Discrete Dynamic Programming and Capital Allocation , 1969 .

[17]  G. Dantzig Discrete-Variable Extremum Problems , 1957 .

[18]  Ellis Horowitz,et al.  Computing Partitions with Applications to the Knapsack Problem , 1974, JACM.

[19]  Gérard Plateau,et al.  An algorithm for the solution of the 0–1 knapsack problem , 2005, Computing.

[20]  Martin E. Dyer,et al.  Probabilistic Analysis of the Multidimensional Knapsack Problem , 1989, Math. Oper. Res..

[21]  René Beier,et al.  Random knapsack in expected polynomial time , 2003, STOC '03.