Convergence Speed in Distributed Consensus and Averaging

We study the convergence speed of distributed iterative algorithms for the consensus and averaging problems, with emphasis on the latter. We first consider the case of a fixed communication topology. We show that a simple adaptation of a consensus algorithm leads to an averaging algorithm. We prove lower bounds on the worst-case convergence time for various classes of linear, time-invariant, distributed consensus methods, and provide an algorithm that essentially matches those lower bounds. We then consider the case of a time-varying topology, and provide a polynomial-time averaging algorithm.

[1]  J. Wolfowitz.  Products of indecomposable, aperiodic, stochastic matrices , 1963 .

[2]  M. Degroot.  Reaching a Consensus , 1974 .

[3]  A. Odlyzko,et al.  Bounds for eigenvalues of certain stochastic matrices , 1981 .

[4]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[5]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[6]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[7]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[8]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[9]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[10]  Andrei Z. Broder,et al.  On the second eigenvalue of random regular graphs , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[11]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[12]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[13]  Nicholas J. Higham,et al.  INVERSE PROBLEMS NEWSLETTER , 1991 .

[14]  P. Diaconis,et al.  Geometric Bounds for Eigenvalues of Markov Chains , 1991 .

[15]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[16]  Diane Hernek.  Random walks on colored graphs: analysis and applications , 1996 .

[17]  George J. Pappas,et al.  Feasible formations of multi-agent systems , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[18]  László Lovász,et al.  Random Walks on Graphs: A Survey , 1993 .

[19]  A. Rbnyi.  ON THE EVOLUTION OF RANDOM GRAPHS , 2001 .

[20]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[21]  Scott Shenker,et al.  Geographic routing without location information , 2003, MobiCom '03.

[22]  P. DeMarzo,et al.  Persuasion Bias, Social Influence, and Uni-Dimensional Opinions , 2001 .

[23]  Yanbin Liu,et al.  Reputation propagation and agreement in mobile ad-hoc networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[24]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[25]  Qun Li,et al.  Global clock synchronization in sensor networks , 2006, IEEE Transactions on Computers.

[26]  S. Treil.  Linear Algebra Done Wrong , 2004 .

[27]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[28]  Huaiqing Wang,et al.  Multi-agent coordination using nearest neighbor rules: revisiting the Vicsek model , 2004, ArXiv.

[29]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[30]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[31]  D. Angeli,et al.  Stability of leaderless multi-agent systems. Extension of a result by Moreau , 2004, math/0411338.

[32]  F. Bullo,et al.  On collective motion in sensor networks: sample problems and distributed algorithms , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[33]  M. Cao,et al.  A Lower Bound on Convergence of a Distributed Network Consensus Algorithm , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[34]  Julia K. Parrish,et al.  Extracting Interactive Control Algorithms from Group Dynamics of Schooling Fish , 2005 .

[35]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[36]  Stephen P. Boyd,et al.  Gossip algorithms: design, analysis and applications , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[37]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[38]  R.M. Murray,et al.  Distributed Averaging on Asynchronous Communication Networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[39]  Ming Cao,et al.  COORDINATION OF AN ASYNCHRONOUS MULTI-AGENT SYSTEM VIA AVERAGING , 2005 .

[40]  Panos J. Antsaklis,et al.  On communication requirements for multi-agent consensus seeking , 2006 .

[41]  Francesco Bullo,et al.  Notes on averaging over acyclic digraphs and discrete coverage control , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[42]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[43]  A. Dimakis,et al.  Geographic gossip: efficient aggregation for sensor networks , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[44]  Benjamin Van Roy,et al.  Consensus Propagation , 2005, IEEE Transactions on Information Theory.

[45]  Mehran Mesbahi,et al.  On maximizing the second smallest eigenvalue of a state-dependent graph Laplacian , 2006, IEEE Transactions on Automatic Control.

[46]  V. Blondel,et al.  Convergence of different linear and non-linear Vicsek models , 2006 .

[47]  Jorge Cortés,et al.  Finite-time convergent gradient flows with applications to network consensus , 2006, Autom..

[48]  V. Blondel.  CONVERGENCE OF LINEAR AND NON-LINEAR VERSIONS OF VICSEK’S MODEL , 2006 .

[49]  R. Carli,et al.  Average consensus on networks with transmission noise or quantization , 2007, 2007 European Control Conference (ECC).

[50]  Luca Schenato,et al.  A distributed consensus protocol for clock synchronization in wireless sensor network , 2007, 2007 46th IEEE Conference on Decision and Control.

[51]  Joao P. Hespanha,et al.  Estimation and control with relative measurements: algorithms and scaling laws , 2007 .

[52]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[53]  George J. Pappas,et al.  Flocking in Fixed and Switching Networks , 2007, IEEE Transactions on Automatic Control.

[54]  Jean-Charles Delvenne,et al.  Optimal strategies in the average consensus problem , 2007, 2007 46th IEEE Conference on Decision and Control.

[55]  Panganamala Ramana Kumar,et al.  Fundamental limits on synchronization of affine clocks in networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[56]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[57]  Ruggero Carli,et al.  Quantized average consensus via dynamic coding/decoding schemes , 2008, 2008 47th IEEE Conference on Decision and Control.

[58]  David Angeli,et al.  Tight estimates for convergence of some non-stationary consensus algorithms , 2007, Syst. Control. Lett..

[59]  Mac Schwager,et al.  Consensus learning for distributed coverage control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[60]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: A Graphical Approach , 2008, SIAM J. Control. Optim..

[61]  Bernard Chazelle,et al.  Natural algorithms , 2009, SODA.

[62]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[63]  D. Angeli,et al.  Convergence Speed of Unsteady Distributed Consensus: Decay Estimate Along the Settling Spanning-Trees , 2006, SIAM J. Control. Optim..

[64]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[65]  Naomi Ehrich Leonard,et al.  Nonuniform coverage and cartograms , 2010, 49th IEEE Conference on Decision and Control (CDC).

[66]  Matthew O. Jackson,et al.  Naïve Learning in Social Networks and the Wisdom of Crowds , 2010 .

[67]  Bernard Chazelle,et al.  The geometry of flocking , 2010, SCG.

[68]  Asuman E. Ozdaglar,et al.  Spread of (Mis)Information in Social Networks , 2009, Games Econ. Behav..

[69]  Alexander Olshevsky,et al.  Efficient information aggregation strategies for distributed control and signal processing , 2010, 1009.6036.

[70]  Bernard Chazelle,et al.  Analytical Tools for Natural Algorithms , 2010, ICS.

[71]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[72]  Dirk A. Lorenz,et al.  On Conditions for Convergence to Consensus , 2008, IEEE Transactions on Automatic Control.

[73]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[74]  John N. Tsitsiklis,et al.  Degree Fluctuations and the Convergence Time of Consensus Algorithms , 2011, IEEE Transactions on Automatic Control.

[75]  L. Asz.  Random Walks on Graphs: a Survey , 2022 .