Parallel search paths for the simplex algorithm

It is well known that the simplex method is inherently a sequential algorithm with little scope for parallelization. Even so, during the last decades several attempts were made to parallelize it since it is one of the most important algorithms for solving linear optimization problems. Such parallelization ideas mostly rely on iteration parallelism and overlapping. Since the simplex method goes through a series of basic solutions until it finds an optimal solution, each of them must be available before performing the next basis change. This phenomenon imposes a limit on the performance of the parallelized version of the simplex method which uses overlapping iterations. Another approach can be considered if we think about alternative paths on the n-dimensional simplex polyhedron. As the simplex method goes through the edges of this polyhedron it is generally true that the speed of convergence of the algorithm is not smooth. It depends on the actual part of the surface. If a parallel version of the simplex algorithm simultaneously goes on different paths on this surface a highly reliable algorithm can be constructed. There is no known dominating strategy for pivot selection. Therefore, one can try different pivot selection methods in parallel in order to guide the algorithm on different pathways. This approach can be used effectively with periodic synchronization on shared memory multi-core computing environments to speed up the solution algorithm and get around numerically and/or algorithmically difficult situations throughout the computations.

[1]  Gautam Mitra,et al.  Investigating the sparse simplex algorithm on a distributed memory multiprocessor , 2000, Parallel Comput..

[2]  Gavriel Yarmish A Distributed Implementation of the Simplex Method , 2001 .

[3]  István Maros A General Pricing Scheme for the Simplex Method , 2003, Ann. Oper. Res..

[4]  Alexander Martin,et al.  Parallelizing the Dual Simplex Method , 2000, INFORMS J. Comput..

[5]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[6]  Zarka Cvetanovic,et al.  Efficient decomposition and performance of parallel PDE, FFT, Monte Carlo simulations, simplex, and Sparse solvers , 2004, The Journal of Supercomputing.

[7]  Donald Goldfarb,et al.  Data-Parallel Implementations of Dense Simplex Methods on the Connection Machine CM-2 , 1995, INFORMS J. Comput..

[8]  Jack Dongarra,et al.  Applied Parallel Computing Industrial Computation and Optimization , 1996, Lecture Notes in Computer Science.

[9]  Robert E. Bixby,et al.  Solving Real-World Linear Programs: A Decade and More of Progress , 2002, Oper. Res..

[10]  Michael A. Saunders,et al.  A practical anti-cycling procedure for linearly constrained optimization , 1989, Math. Program..

[11]  István Maros,et al.  The Pannon Optimizier – A Linear Programming Solver for Research Purposes , 2015, MACRo.

[12]  István Maros,et al.  Advances in design and implementation of optimization software , 2002, Eur. J. Oper. Res..

[13]  Jeffery L. Kennington,et al.  An Empirical Evaluation of the KORBX® Algorithms for Military Airlift Applications , 1990, Oper. Res..

[14]  W. Shu Parallel Implementation of a Sparse Simplex Algorithm on MIMD Distributed Memory Computers , 1995, J. Parallel Distributed Comput..

[15]  J. A. Julian Hall,et al.  Towards a practical parallelisation of the simplex method , 2010, Comput. Manag. Sci..

[16]  Didier El Baz,et al.  Efficient Implementation of the Simplex Method on a CPU-GPU System , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[17]  K. I. M. McKinnon,et al.  PARSMI, a Parallel Revised Simplex Algorithm Incorporating Minor Iterations and Devex Pricing , 1996, PARA.

[18]  Richard V. Helgason,et al.  A parallelization of the simplex method , 1988 .

[19]  István Maros,et al.  Product Form of the Inverse Revisited , 2012, SCOR.

[20]  Qi Huangfu,et al.  Parallelizing the dual revised simplex method , 2015, Mathematical Programming Computation.

[21]  I. Maros Computational Techniques of the Simplex Method , 2002 .

[22]  Peter Martini,et al.  An efficient GPU implementation of the revised simplex method , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[23]  H. Markowitz The Elimination form of the Inverse and its Application to Linear Programming , 1957 .

[24]  G. Dantzig,et al.  THE PRODUCT FORM FOR THE INVERSE IN THE SIMPLEX METHOD , 1954 .

[25]  K. I. M. McKinnon,et al.  Hyper-Sparsity in the Revised Simplex Method and How to Exploit it , 2005, Comput. Optim. Appl..

[26]  Daniel,et al.  The Product Form for the Inverse in the Simplex Method , 2010 .

[27]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[28]  James K. Ho,et al.  On the efficacy of distributed simplex algorithms for linear programming , 1994, Comput. Optim. Appl..

[29]  Qi Huangfu,et al.  Novel update techniques for the revised simplex method , 2015, Comput. Optim. Appl..

[30]  Qi Huangfu,et al.  A High Performance Dual Revised Simplex Solver , 2011, PPAM.

[31]  K. I. M. McKinnon,et al.  ASYNPLEX, an asynchronous parallelrevised simplex algorithm , 1998, Ann. Oper. Res..