Cloud-based centralized/decentralized multi-agent optimization with communication delays

We present and analyze a hybrid computational architecture for performing multi-agent optimization. The optimization problems under consideration have convex objective and constraint functions with mild smoothness conditions imposed on them. For such problems, we provide a primal-dual algorithm implemented in the hybrid architecture, which consists of a decentralized network of agents into which an updated dual vector is occasionally injected, and we establish its convergence properties. In this setting, a central cloud computer is responsible for aggregating information, computing dual variable updates, and distributing these updates to the agents. The agents update their (primal) state variables and also communicate among themselves with each agent sharing and receiving state information with some number of its neighbors. Throughout, communications with the cloud are not assumed to be synchronous or instantaneous, and communication delays are explicitly accounted for in the modeling and analysis of the system. Experimental results for a team of robots are presented to support the theoretical developments made.

[1]  V. S. Anil Kumar,et al.  Distributed Algorithms for Constructing Approximate Minimum Spanning Trees in Wireless Sensor Networks , 2009, IEEE Transactions on Parallel and Distributed Systems.

[2]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[3]  Angelia Nedic,et al.  Distributed Asynchronous Constrained Stochastic Optimization , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Yi Guo,et al.  A distributed and optimal motion planning approach for multiple mobile robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Bhaskar Krishnamachari,et al.  Sensor network algorithms and applications , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Convex Optimization Over Random Networks , 2011, IEEE Transactions on Automatic Control.

[7]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[8]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[9]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[10]  Debasis Mitra,et al.  An Asynchronous Distributed Algorithm for Power Control in Cellular Radio Systems , 1994 .

[11]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[12]  Magnus Egerstedt,et al.  Cloud-based optimization: A quasi-decentralized approach to multi-agent coordination , 2014, 53rd IEEE Conference on Decision and Control.

[13]  Mac Schwager,et al.  Decentralized path planning for coverage tasks using gradient descent adaptive control , 2014, Int. J. Robotics Res..

[14]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[15]  Magnus Egerstedt,et al.  Distributed Frequency Control of Prosumer-Based Electric Energy Systems , 2014, IEEE Transactions on Power Systems.

[16]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[17]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[18]  Giuseppe Notarstefano,et al.  Network Abstract Linear Programming with Application to Cooperative Target Localization , 2009 .

[19]  I. Konnov Equilibrium Models and Variational Inequalities , 2013 .

[20]  Francesco Bullo,et al.  Esaim: Control, Optimisation and Calculus of Variations Spatially-distributed Coverage Optimization and Control with Limited-range Interactions , 2022 .

[21]  Angelia Nedic,et al.  Multiuser Optimization: Distributed Algorithms and Error Analysis , 2011, SIAM J. Optim..

[22]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.