Linear equations, Inequalities, Linear Programs (LP), and a New Efficient Algorithm

The dawn of mathematical modeling and algebra occurred well over 3000 years ago in several countries (Babylonia, China, India,...). The earliest algebraic systems constructed are systems of linear equations, and soon after, the famous elimination method for solving them was discovered in China and India. This effort culminated in the writing of two books that attracted international attention by the Arabic mathematician Muhammad ibn-Musa Alkhawarizmi in the first half of 9th century. The first, Al-Maqala fi Hisab al-jabr w’almuqabilah (An essay on Algebra and equations), was translated into Latin under the title Ludus Algebrae, the name “algebra” for the subject came from this Latin title, and Alkhawarizmi is regarded as the father of algebra. Linear algebra is the branch of algebra dealing with systems of linear equations. The second book Kitab al-Jam’a wal-Tafreeq bil Hisab al-Hindi appeared in Latin translation under the title Algoritmi de Numero Indorum (meaning Alkhawarizmi Concerning the Hindu Art of Reckoning), and the word “algorithm” for procedures for solving algebraic systems originated from this Latin title. The elimination method for solving linear equations remained unknown in Europe until Gauss rediscovered it in 19th century while approximating by a quadratic formula the orbit of the asteroid Ceres based on recorded observations in tracking it earlier by the Italian astronomer Piazzi. Europeans gave the names “Gaussian elimination method”, “GJ (Gauss-Jordan) elimination method” for this method. However, there was no computationally viable method until recently to solve systems of linear constraints including inequalities. Examples of linear constraints with inequalities started appearing in published literature in mid-18th century. In the 19th and early 20th century Fourier,

[1]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[2]  G. Sonnevend An "analytical centre" for polyhedrons and new classes of global algorithms for linear (smooth, convex) programming , 1986 .

[3]  Steven Vajda,et al.  The Theory of Linear Economic Models , 1960 .

[4]  P. Gordan Ueber die Auflösung linearer Gleichungen mit reellen Coefficienten , 1873 .

[5]  Katta G. Murty,et al.  Linear complementarity, linear and nonlinear programming , 1988 .

[6]  Katta G. Murty,et al.  A New Practically Efficient Interior Point Method for LP , 2006, Algorithmic Oper. Res..

[7]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[8]  Frank Swetz,et al.  The Nine Chapters on the Mathematical Art Companion and Commentary , 2001 .

[9]  D. Wilhelmsen A nearest point algorithm for convex polyhedral cones and applications to positive linear approximation , 1976 .

[10]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, Comb..

[11]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[12]  Katta G. Murty The gravitational method for linear programming , 1986 .

[13]  Thomas L. Morin,et al.  Complexity of the Gravitational Method for Linear Programming , 1996, FSTTCS.

[14]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[15]  Philip Wolfe,et al.  Finding the nearest point in A polytope , 1976, Math. Program..

[16]  N. Megiddo Pathways to the optimal set in linear programming , 1989 .

[17]  Tamás Terlaky,et al.  The central path visits all the vertices of the Klee–Minty cube , 2006, Optim. Methods Softw..

[18]  Katta G. Murty,et al.  The steepest descent gravitational method for linear programming , 1989, Discret. Appl. Math..

[19]  Yahya Fathi,et al.  A critical index algorithm for nearest point problems on simplicial cones , 1982, Math. Program..

[20]  Yuval Rabani,et al.  Linear Programming , 2007, Handbook of Approximation Algorithms and Metaheuristics.

[21]  Josef Stoer,et al.  On the complexity of following the central path of linear programs by linear extrapolation II , 1991, Math. Program..

[22]  Yinyu Ye,et al.  Interior point algorithms: theory and analysis , 1997 .

[23]  C. Roos,et al.  A survey of the implications of the behavior of the central path for the duality theory of linear programming , 1995 .

[24]  L. McLinden An analogue of Moreau's proximation theorem, with application to the nonlinear complementarity problem. , 1980 .

[25]  P. Wolfe Algorithm for a least-distance programming problem , 1974 .

[26]  Katta G. Murty A Gravitational Interior Point Method for LP , 2005 .

[27]  Shinji Mizuno,et al.  On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming , 1993, Math. Oper. Res..

[28]  M. Kojima,et al.  A primal-dual interior point algorithm for linear programming , 1988 .

[29]  George B. Dantzig,et al.  Linear Programming 1: Introduction , 1997 .

[30]  R. Saigal Linear Programming: A Modern Integrated Analysis , 1995 .

[31]  J. B. G. Frenk,et al.  Theory and algorithms for semidefinite programming , 2000 .

[32]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[33]  Renato D. C. Monteiro,et al.  Interior path following primal-dual algorithms. part I: Linear programming , 1989, Math. Program..

[34]  Markku Kallio,et al.  Large-Scale Convex Optimization Via Saddle Point Computation , 1999, Oper. Res..