Stability of Augmented System Factorizations in Interior-Point Methods

Some implementations of interior-point algorithms obtain their search directions by solving symmetric indefinite systems of linear equations. The conditioning of the coefficient matrices in these so-called augmented systems deteriorates on later iterations, as some of the diagonal elements grow without bound. Despite this apparent difficulty, the steps produced by standard factorization procedures are often accurate enough to allow the interior-point method to converge to high accuracy. When the underlying linear program is nondegenerate, we show that convergence to arbitrarily high accuracy occurs, at a rate that closely approximates the theory. We also explain and demonstrate what happens when the linear program is degenerate, where convergence to acceptable accuracy (but not arbitrarily high accuracy) is usually obtained.

[1]  Elmer Earl. Branstetter,et al.  The theory of linear programming , 1963 .

[2]  J. Bunch,et al.  Some stable methods for calculating inertia and solving symmetric linear systems , 1977 .

[3]  I. Lustig,et al.  Computational experience with a primal-dual interior point method for linear programming , 1991 .

[4]  D. Ponceleón Barrier methods for large-scale quadratic programming , 1991 .

[5]  Nimrod Megiddo,et al.  On Finding Primal- and Dual-Optimal Bases , 1991, INFORMS J. Comput..

[6]  Yinyu Ye,et al.  On the finite convergence of interior-point algorithms for linear programming , 1992, Math. Program..

[7]  Clóvis C. Gonzaga,et al.  Path-Following Methods for Linear Programming , 1992, SIAM Rev..

[8]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[9]  Stephen J. Wright A path-following infeasible-interior-point algorithm for linear complementarity problems , 1993 .

[10]  Iain S. Duff,et al.  The solution of augmented systems , 1993 .

[11]  Shinji Mizuno,et al.  On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming , 1993, Math. Oper. Res..

[12]  Yinyu Ye,et al.  Convergence behavior of interior-point algorithms , 1993, Math. Program..

[13]  Roy E. Marsten,et al.  Feature Article - Interior Point Methods for Linear Programming: Computational State of the Art , 1994, INFORMS J. Comput..

[14]  Yin Zhang,et al.  On the Convergence of a Class of Infeasible Interior-Point Methods for the Horizontal Linear Complementarity Problem , 1994, SIAM J. Optim..

[15]  S. Vavasis Stable Numerical Algorithms for Equilibrium Systems , 1994, SIAM J. Matrix Anal. Appl..

[16]  Stephen J. Wright Stability of Linear Equations Solvers in Interior-Point Methods , 1995, SIAM J. Matrix Anal. Appl..

[17]  Michael J. Todd,et al.  Potential-reduction methods in mathematical programming , 1997, Math. Program..

[18]  Joseph R. Shinnerl,et al.  Stability of Symmetric Ill-Conditioned Systems Arising in Interior Methods for Constrained Optimization , 1996, SIAM J. Matrix Anal. Appl..

[19]  John G. Lewis,et al.  Accurate Symmetric Indefinite Linear Equation Solvers , 1999, SIAM J. Matrix Anal. Appl..