A New Unblocking Technique to Warmstart Interior Point Methods Based on Sensitivity Analysis

One of the main drawbacks associated with Interior Point Methods (IPMs) is the perceived lack of an efficient warmstarting scheme which would enable the use of information from a previous solution of a similar problem. Recently there has been renewed interest in the subject. A common problem with warmstarting for IPM is that an advanced starting point which is close to the boundary of the feasible region, as is typical, might lead to blocking of the search direction. Several techniques have been proposed to address this issue. Most of these aim to lead the iterate back into the interior of the feasible region—we classify them as either “modification steps” or “unblocking steps” depending on whether the modification is taking place before solving the modified problem to prevent future problems, or during the solution if and when problems become apparent. A new “unblocking” strategy is suggested which attempts to directly address the issue of blocking by performing sensitivity analysis on the Newton step with the aim of increasing the size of the step that can be taken. This analysis is used in a new technique to warmstart interior point methods: we identify components of the starting point that are responsible for blocking and aim to improve these by using our sensitivity analysis. The relative performance of a selection of different warmstarting techniques suggested in the literature and the new proposed unblocking by sensitivity analysis is evaluated on the warmstarting test set based on a selection of NETLIB problems proposed by [Benson and Shanno, Comput. Optim. Appl., 38 (2007), pp. 371-399]. Warmstarting techniques are also applied in the context of solving nonlinear programming problems as a sequence of quadratic programs solved by interior point methods. We also apply the warmstarting technique to the problem of finding the complete efficient frontier in portfolio management problems (a problem with 192 million variables—to our knowledge the largest problem to date solved by a warmstarted IPM). We find that the resulting best combined warmstarting strategy manages to save between 50 and 60% of interior point iterations, consistently outperforming similar approaches reported in current optimization literature.

[1]  Jörg Fliege An Efficient Interior-Point Method for Convex Multicriteria Optimization Problems , 2006, Math. Oper. Res..

[2]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[3]  E. Alper Yildirim,et al.  Implementation of warm-start strategies in interior-point methods for linear programming in fixed dimension , 2008, Comput. Optim. Appl..

[4]  C. Mészáros,et al.  A repository of convex quadratic programming problems , 1999 .

[5]  Stephen J. Wright,et al.  Warm-Start Strategies in Interior-Point Methods for Linear Programming , 2002, SIAM J. Optim..

[6]  Jacek Gondzio,et al.  Reoptimization With the Primal-Dual Interior Point Method , 2002, SIAM J. Optim..

[7]  David F. Shanno,et al.  Interior-point methods for nonconvex nonlinear programming: regularization and warmstarts , 2008, Comput. Optim. Appl..

[8]  Roy E. Marsten,et al.  Computational experience with a globally convergent primal—dual predictor—corrector algorithm for linear programming , 1994, Math. Program..

[9]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[10]  J. Gondzio HOPDM (version 2.12) — A fast LP solver based on a primal-dual interior point method , 1995 .

[11]  David F. Shanno,et al.  An exact primal–dual penalty method approach to warmstarting interior-point methods for linear programming , 2007, Comput. Optim. Appl..

[12]  Jacek Gondzio,et al.  Warm start of the primal-dual method applied in the cutting-plane scheme , 1998, Math. Program..

[13]  Jacek Gondzio,et al.  Parallel interior-point solver for structured quadratic programs: Application to financial planning problems , 2007, Ann. Oper. Res..

[14]  J. Gondizo,et al.  Warm Start and ε-Subgradients in a Cutting Plane Scheme for Block-Angular Linear Programs , 1999, Comput. Optim. Appl..

[15]  Alexander L. Hipolito A weighted least squaes study of robustness in interior point linear programming , 1993, Comput. Optim. Appl..

[16]  Marc C. Steinbach,et al.  Markowitz Revisited: Mean-Variance Models in Financial Portfolio Analysis , 2001, SIAM Rev..