Asynchronous Multiagent Primal-Dual Optimization

We present a framework for asynchronously solving convex optimization problems over networks of agents which are augmented by the presence of a centralized cloud computer. This framework uses a Tikhonov-regularized primal-dual approach in which the agents update the system's primal variables and the cloud updates its dual variables. To minimize coordination requirements placed upon the system, the times of communications and computations among the agents are allowed to be arbitrary, provided they satisfy mild conditions. Communications from the agents to the cloud are likewise carried out without any coordination in their timing. However, we require that the cloud keeps the dual variable's value synchronized across the agents, and a counterexample is provided that demonstrates that this level of synchrony is indeed necessary for convergence. Convergence rate estimates are provided in both the primal and dual spaces, and simulation results are presented that demonstrate the operation and convergence of the proposed algorithm.

[1]  Magnus Egerstedt,et al.  Cloud-based centralized/decentralized multi-agent optimization with communication delays , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[2]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[3]  John N. Tsitsiklis,et al.  Convergence rate and termination of asynchronous iterative algorithms , 1989, ICS '89.

[4]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[5]  George Kesidis,et al.  Incentive-Based Energy Consumption Scheduling Algorithms for the Smart Grid , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[6]  V. S. Anil Kumar,et al.  Distributed Algorithms for Constructing Approximate Minimum Spanning Trees in Wireless Sensor Networks , 2009, IEEE Transactions on Parallel and Distributed Systems.

[7]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[8]  David J. Goodman,et al.  Wireless and Mobile Communications , 1994 .

[9]  Bhaskar Krishnamachari,et al.  Sensor network algorithms and applications , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[10]  Sarvapali D. Ramchurn,et al.  Agent-based micro-storage management for the Smart Grid , 2010, AAMAS.

[11]  James T. Kwok,et al.  Asynchronous Distributed ADMM for Consensus Optimization , 2014, ICML.

[12]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[13]  Mac Schwager,et al.  Decentralized path planning for coverage tasks using gradient descent adaptive control , 2014, Int. J. Robotics Res..

[14]  Dimitri P. Bertsekas,et al.  Distributed asynchronous computation of fixed points , 1983, Math. Program..

[15]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[16]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[17]  Jochen H. Schiller Wireless and Mobile Communications , 2008, Handbook of Research on Ubiquitous Computing Technology for Real Time Enterprises.

[18]  Debasis Mitra,et al.  An Asynchronous Distributed Algorithm for Power Control in Cellular Radio Systems , 1994 .

[19]  Douglas E. Comer,et al.  Internetworking with TCP/IP, Volume 1: Principles, Protocols, and Architectures, Fourth Edition , 2000 .

[20]  Douglas Comer,et al.  Internetworking with TCP/IP , 1988 .

[21]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[22]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[23]  Gérard M. Baudet,et al.  Asynchronous Iterative Methods for Multiprocessors , 1978, JACM.

[24]  Angelia Nedic,et al.  Multiuser Optimization: Distributed Algorithms and Error Analysis , 2011, SIAM J. Optim..

[25]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[26]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[27]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[28]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[29]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[30]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.