Fast, accurate second order methods for network optimization

Dual descent methods are commonly used to solve network flow optimization problems, since their implementation can be distributed over the network. These algorithms, however, often exhibit slow convergence rates. Approximate Newton methods which compute descent directions locally have been proposed as alternatives to accelerate the convergence rates of conventional dual descent. The effectiveness of these methods, is limited by the accuracy of such approximations. In this paper, we propose an efficient and accurate distributed second order method for network flow problems. Our approach utilizes the sparsity pattern of the dual Hessian to approximate the the Newton direction using a novel distributed solver for symmetric diagonally dominant linear equations. We analyze the properties of the proposed algorithm and show that superlinear convergence within a neighborhood of the optimal value. We finally demonstrate the effectiveness of the approach in a set of experiments.

[1]  D. Bertsekas,et al.  Projected Newton methods and optimization of multicommodity flows , 1982, 1982 21st IEEE Conference on Decision and Control.

[2]  Asuman E. Ozdaglar,et al.  A distributed newton method for network optimization , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[3]  J. Sun,et al.  Applying a Newton Method to Strictly Convex Separable Network Quadratic Programs , 1998, SIAM J. Optim..

[4]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[5]  Steven H. Low,et al.  Optimization flow control with Newton‐like algorithm , 2000, Telecommun. Syst..

[6]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[7]  Alejandro Ribeiro,et al.  Accelerated dual descent for network optimization , 2011, Proceedings of the 2011 American Control Conference.

[8]  Alejandro Ribeiro,et al.  Ergodic Stochastic Optimization Algorithms for Wireless Communication and Networking , 2010, IEEE Transactions on Signal Processing.

[9]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[10]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[11]  Asuman E. Ozdaglar,et al.  A distributed Newton method for Network Utility Maximization , 2010, 49th IEEE Conference on Decision and Control (CDC).

[12]  Richard Peng,et al.  An efficient parallel solver for SDD linear systems , 2013, STOC.

[13]  A. Barrett Network Flows and Monotropic Optimization. , 1984 .

[14]  A. Banerjee Convex Analysis and Optimization , 2006 .

[15]  M. Projected Newton Methods and Optimization of Multicommodity Flows , 2022 .