Asynchronous latency analysis on decentralized iterative algorithms for large scale networked systems

Decentralized methods are often desirable for solving many control and optimization problems for large scale networked systems. Convergence of the decentralized iterative method may be affected by the delay caused by communication and computation. This paper investigates the latency impact of asynchronous decentralized algorithms with the contractive property on convergence. An asynchronous decentralized algorithm is presented with its convergence conditions and the theoretical upper bound of latency is derived. Numerical examples are shown to demonstrate the effectiveness of the algorithm, and the testing results are analyzed.

[1]  Michel Dubois,et al.  EFFECTS OF ASYNCHRONISM ON THE CONVERGENCE RATE OF A CLASS OF ITERATIONS , 1995 .

[2]  Jacques M. Bahi,et al.  A decentralized convergence detection algorithm for asynchronous parallel iterative algorithms , 2005, IEEE Transactions on Parallel and Distributed Systems.

[3]  Stephen P. Boyd,et al.  Distributed optimization for cooperative agents: application to formation flight , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[4]  Jeremy T. Bradley,et al.  Extracting state-based performance metrics using asynchronous iterative techniques , 2010, Perform. Evaluation.

[5]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[6]  Richard M. Murray,et al.  INFORMATION FLOW AND COOPERATIVE CONTROL OF VEHICLE FORMATIONS , 2002 .

[7]  Michel Dubois,et al.  Parallel asynchronous algorithms for discrete data , 1990, JACM.

[8]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[9]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[10]  Sandip Roy,et al.  A new focus in the science of networks: towards methods for design , 2008, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[12]  M. Alighanbari,et al.  Decentralized Task Assignment for Unmanned Aerial Vehicles , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[13]  John N. Tsitsiklis,et al.  Convergence rate and termination of asynchronous iterative algorithms , 1989, ICS '89.

[14]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[15]  V. Borkar,et al.  Asymptotic agreement in distributed estimation , 1982 .

[16]  Ekram Hossain,et al.  Cross-layer optimization frameworks for multihop wireless networks using cooperative diversity , 2008, IEEE Transactions on Wireless Communications.

[17]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[18]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[19]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[20]  Yi Guo,et al.  Formation control of nonholonomic mobile robots , 2006, 2006 American Control Conference.

[21]  Khashayar Khorasani,et al.  Multi-agent team cooperation: A game theory approach , 2009, Autom..

[22]  Francesco Bullo,et al.  Coordination and Geometric Optimization via Distributed Dynamical Systems , 2003, SIAM J. Control. Optim..

[23]  Adrian Moga,et al.  Performance of asynchronous linear iterations with random delays , 1996, Proceedings of International Conference on Parallel Processing.