Multiple Cuts in the Analytic Center Cutting Plane Method

We analyze the multiple cut generation scheme in the analytic center cutting plane method. We propose an optimal primal and dual updating direction when the cuts are central. The direction is optimal in the sense that it maximizes the product of the new dual slacks and of the new primal variables within the trust regions defined by Dikin's primal and dual ellipsoids. The new primal and dual directions use the variance-covariance matrix of the normals to the new cuts in the metric given by Dikin's ellipsoid. We prove that the recovery of a new analytic center from the optimal restoration direction can be done in O(plog (p+1)) damped Newton steps, where p is the number of new cuts added by the oracle, which may vary with the iteration. The results and the proofs are independent of the specific scaling matrix---primal, dual, or primal-dual---that is used in the computations. The computation of the optimal direction uses Newton's method applied to a self-concordant function of p variables. The convergence result of [Ye, Math. Programming, 78 (1997), pp. 85--104] holds here also: the algorithm stops after $O^*(\frac{\bar p^2n^2}{\varepsilon^2})$ cutting planes have been generated, where $\bar p$ is the maximum number of cuts generated at any given iteration.

[1]  Yinyu Ye,et al.  A Potential Reduction Algorithm Allowing Column Generation , 1992, SIAM J. Optim..

[2]  Michael J. Todd,et al.  Solving combinatorial optimization problems using Karmarkar's algorithm , 1992, Math. Program..

[3]  J. Goffin,et al.  Decomposition and nondifferentiable optimization with the projective algorithm , 1992 .

[4]  Dick den Hertog,et al.  Interior Point Approach to Linear, Quadratic and Convex Programming: Algorithms and Complexity , 1994 .

[5]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[6]  Yurii Nesterov,et al.  Complexity estimates of some cutting plane methods based on the analytic barrier , 1995, Math. Program..

[7]  Jean-Philippe Vial,et al.  A cutting plane method from analytic centers for stochastic programming , 1995, Math. Program..

[8]  Yinyu Ye,et al.  Complexity Analysis of an Interior Cutting Plane Method for Convex Feasibility Problems , 1996, SIAM J. Optim..

[9]  Jacek Gondzio,et al.  Solving nonlinear multicommodity flow problems by the analytic center cutting plane method , 1997, Math. Program..

[10]  Jacek Gondzio,et al.  ACCPM — A library for convex optimization based on an analytic center cutting plane method☆ , 1996 .

[11]  Yinyu Ye,et al.  Complexity analysis of the analytic center cutting plane method that uses multiple cuts , 1997, Math. Program..

[12]  Z. Luo Analysis of a Cutting Plane Method That Uses Weighted Analytic Center and Multiple Cuts , 1997, SIAM J. Optim..

[13]  Jacek Gondzio,et al.  Warm start of the primal-dual method applied in the cutting-plane scheme , 1998, Math. Program..

[14]  Jean-Philippe Vial,et al.  Theory and algorithms for linear optimization - an interior point approach , 1998, Wiley-Interscience series in discrete mathematics and optimization.

[15]  J. Goffin,et al.  Using the Primal Dual Infeasible Newton Method in the Analytic Center Method for Problems Defined by , 1998 .

[16]  Yinyu Ye,et al.  Interior point algorithms: theory and analysis , 1997 .

[17]  Jean-Philippe Vial,et al.  A two-cut approach in the analytic center cutting plane method , 1997, Math. Methods Oper. Res..

[18]  Yurii Nesterov,et al.  Homogeneous Analytic Center Cutting Plane Methods for Convex Problems and Variational Inequalities , 1999, SIAM J. Optim..

[19]  Jean-Philippe Vial,et al.  Shallow, deep and very deep cuts in the analytic center cutting plane method , 1999, Math. Program..