A linear programming primer: from Fourier to Karmarkar

The story of linear programming is one with all the elements of a grand historical drama. The original idea of testing if a polyhedron is non-empty by using a variable elimination to project down one dimension at a time until a tautology emerges dates back to a paper by Fourier in 1823. This gets re-invented in the 1930s by Motzkin. The real interest in linear programming happens during World War II when mathematicians ponder best ways of utilising resources at a time when they are constrained. The problem of optimising a linear function over a set of linear inequalities becomes the focus of the effort. Dantzig’s Simplex Method is announced and the Rand Corporation becomes a hot bed of computational mathematics. The range of applications of this modelling approach grows and the powerful machinery of numerical analysis and numerical linear algebra becomes a major driver for the advancement of computing machines. In the 1970s, constructs of theoretical computer science indicate that linear programming may in fact define the frontier of tractable problems that can be solved effectively on large instances. This raised a series of questions and answers: Is the Simplex Method a polynomial-time method and if not can we construct novel polynomial time methods, etc. And that is how the Ellipsoid Method from the Soviet Union and the Interior Point Method from Bell Labs make their way into this story as the heroics of Khachiyan and Karmarkar. We have called this paper a primer on linear programming since it only gives the reader a quick narrative of the grand historical drama. Hopefully it motivates a young reader to delve deeper and add another chapter.

[1]  Nimrod Megiddo,et al.  Towards a Genuinely Polynomial Algorithm for Linear Programming , 1983, SIAM J. Comput..

[2]  Vijay Chandru,et al.  Variable Elimination in Linear Constraints , 1993, Comput. J..

[3]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[4]  Richard M. Karp,et al.  On Linear Characterizations of Combinatorial Optimization Problems , 1982, SIAM J. Comput..

[5]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, Comb..

[6]  Nimrod Megiddo,et al.  On Finding Primal- and Dual-Optimal Bases , 1991, INFORMS J. Comput..

[7]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[8]  A. Charnes Optimality and Degeneracy in Linear Programming , 1952 .

[9]  Michael J. Maher,et al.  On Fourier's algorithm for linear arithmetic constraints , 1992, Journal of Automated Reasoning.

[10]  Edith Cohen,et al.  Improved algorithms for linear inequalities with two variables per inequality , 1991, STOC '91.

[11]  L. Khachiyan Polynomial algorithms in linear programming , 1980 .

[12]  Jean-Louis Lassez,et al.  From LP to LP: Programming with Constraints , 1991, TACS.

[13]  Robert J. Vanderbei,et al.  Linear Programming: Foundations and Extensions , 1998, Kluwer international series in operations research and management service.

[14]  Ilan Adler,et al.  A Strongly Polynomial Algorithm for a Special Class of Linear Programs , 1991, Oper. Res..

[15]  N. Z. Shor Convergence rate of the gradient descent method with dilatation of the space , 1970 .

[16]  Arthur F. Veinott,et al.  Polyhedral sets having a least element , 1972, Math. Program..

[17]  Th. Motzkin Beiträge zur Theorie der linearen Ungleichungen , 1936 .

[18]  H. P. Williams Fourier's Method of Linear Programming and its Dual , 1986 .

[19]  V. Klee,et al.  HOW GOOD IS THE SIMPLEX ALGORITHM , 1970 .

[20]  Richard E. Stone,et al.  Erratum: The Simplex and Projective Scaling Algorithms as Iteratively Reweighted Least Squares Methods , 1991, SIAM Rev..

[21]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[22]  Pravin M. Vaidya,et al.  Speeding-up linear programming using fast matrix multiplication , 1989, 30th Annual Symposium on Foundations of Computer Science.

[23]  Joseph Naor,et al.  Simple and Fast Algorithms for Linear and Integer Programs With Two Variables per Inequality , 1994, SIAM J. Comput..

[24]  Robert E. Bixby,et al.  Commentary - Progress in Linear Programming , 1994, INFORMS J. Comput..

[25]  P. Wolfe A Technique for Resolving Degeneracy in Linear Programming , 1963 .

[26]  Martin Grötschel,et al.  The ellipsoid method and its consequences in combinatorial optimization , 1981, Comb..

[27]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[28]  K. Borgwardt The Simplex Method: A Probabilistic Analysis , 1986 .

[29]  Robert E. Bixby,et al.  Progress in Linear Programming , 1993 .

[30]  Michael J. Todd Commentary - Theory and Practice for Interior-Point Methods , 1994, INFORMS J. Comput..

[31]  K. Borgwardt The Simplex Method: A Probabilistic Analysis , 1986 .

[32]  Edith Cohen,et al.  Improved algorithms for linear inequalities with two variables per inequality , 1991, STOC '91.

[33]  G. Dantzig,et al.  Notes on Linear Programming: Part 1. The Generalized Simplex Method for Minimizing a Linear Form under Linear Inequality Restraints , 1954 .