Distributed multiuser optimization: Algorithms and error analysis

We consider a class of multiuser optimization problems in which user interactions are seen through congestion cost functions or coupling constraints. Our primary emphasis lies on the convergence and error analysis of distributed algorithms in which users communicate through aggregate user information. Traditional implementations are reliant on strong convexity assumptions, require coordination across users in terms of consistent stepsizes, and often rule out early termination by a group of users. We consider how some of these assumptions can be weakened in the context of projection methods motivated by fixed-point formulations of the problem. Specifically, we focus on (approximate) primal and primal-dual projection algorithms. We analyze the convergence behavior of the methods and provide error bounds in settings with limited coordination across users and regimes where a group of users may prematurely terminate affecting the convergence point.

[1]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[2]  R. Srikant,et al.  Network Optimization and Control , 2008, Found. Trends Netw..

[3]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[4]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[5]  M. Anthony,et al.  Mathematics for Economics and Finance: Introduction to optimisation , 1996 .

[6]  Andrzej Ruszczynski,et al.  A merit function approach to the subgradient method with averaging , 2008, Optim. Methods Softw..

[7]  Angelia Nedic,et al.  Multiuser Optimization: Distributed Algorithms and Error Analysis , 2011, SIAM J. Optim..

[8]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[9]  Prashant G. Mehta,et al.  Nash equilibrium problems with congestion costs and shared constraints , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[10]  Derong Liu The Mathematics of Internet Congestion Control , 2005, IEEE Transactions on Automatic Control.

[11]  Masao Fukushima,et al.  Parametrized variational inequality approaches to generalized Nash equilibrium problems with shared constraints , 2011, Comput. Optim. Appl..

[12]  Asuman E. Ozdaglar,et al.  Subgradient methods in network resource allocation: Rate analysis , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[13]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[14]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control , 2003 .

[15]  Angelia Nedic,et al.  Subgradient Methods for Saddle-Point Problems , 2009, J. Optimization Theory and Applications.

[16]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[17]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.