Distributed Averaging Under Constraints on Information Exchange: Emergence of Lévy Flights

In this paper, we study the fragility of a popular distributed averaging algorithm when the information exchange among the nodes is limited by communication delays, fading connections and additive noise. We show that the otherwise well studied and benign multi-agent system can generate a collective global complex behavior. We characterize this behavior, common to many natural and human-made interconnected systems, as a collective hyper-jump diffusion process and as a Lévy flight process in a special case. We further describe the mechanism for its emergence and predict its occurrence, under standard assumptions, by checking the Mean Square instability of a certain part of the system. We show that the strong connectivity property of the network topology guarantees that the complex behavior is global and manifested by all the agents in the network, even though the source of uncertainty is localized. This work is the first, to the best of our knowledge, to establish the intimate relationship between the propagation of channel uncertainties in networked systems, the MS stability robustness and the emergence of Lévy flights in distributed averaging systems. As averaging is central to science and engineering, the results of the paper may have far-reaching consequences on the understanding and engineering of complex networked systems.

[1]  J M Carlson,et al.  Highly optimized tolerance: a mechanism for power laws in designed systems. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[4]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[5]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[6]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[7]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[8]  R. Mantegna,et al.  Scaling behaviour in the dynamics of an economic index , 1995, Nature.

[9]  Tang,et al.  Self-organized criticality. , 1988, Physical review. A, General physics.

[10]  Nicola Elia,et al.  Limitations of Linear Control Over Packet Drop Networks , 2011, IEEE Transactions on Automatic Control.

[11]  Nicola Elia,et al.  Remote stabilization over fading channels , 2005, Syst. Control. Lett..

[12]  Jing Wang,et al.  Mitigation of complex behavior over networked systems: Analysis of spatially invariant structures , 2013, Autom..

[13]  B. Mandelbrot.  The Variation of Certain Speculative Prices , 1963 .

[14]  N. Elia.  Emergence of Power Laws in Networked Control Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[15]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[16]  Sandro Zampieri,et al.  Average consensus with packet drop communication , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[17]  Jonathan H. Manton,et al.  Coordination and Consensus of Networked Agents with Noisy Measurements: Stochastic Algorithms and Asymptotic Behavior , 2009, SIAM J. Control. Optim..

[18]  Frederic Bartumeus,et al.  ANIMAL SEARCH STRATEGIES: A QUANTITATIVE RANDOM‐WALK ANALYSIS , 2005 .

[19]  Richard M. Murray,et al.  INFORMATION FLOW AND COOPERATIVE CONTROL OF VEHICLE FORMATIONS , 2002 .

[20]  Manfred Schroeder,et al.  Fractals, Chaos, Power Laws: Minutes From an Infinite Paradise , 1992 .

[21]  Sergio Barbarossa,et al.  Distributed Decision Through Self-Synchronizing Sensor Networks in the Presence of Propagation Delays and Asymmetric Channels , 2007, IEEE Transactions on Signal Processing.

[22]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[23]  Subhrakanti Dey,et al.  Stochastic consensus over noisy networks with Markovian and arbitrary switches , 2010, Autom..

[24]  Nicola Elia,et al.  Emergence of Lévy flights in Distributed Consensus Systems , 2010 .

[25]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[26]  C. Sparrow.  The Fractal Geometry of Nature , 1984 .

[27]  Ali Jadbabaie,et al.  Non-Bayesian Social Learning , 2011, Games Econ. Behav..

[28]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[29]  Martine Chevrollier,et al.  Lévy flights of photons in hot atomic vapours , 2009, 0904.2454.

[30]  Walter Willinger,et al.  Towards a Theory of Scale-Free Graphs: Definition, Properties, and Implications , 2005, Internet Math..

[31]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[32]  Jonathan H. Manton,et al.  Stochastic Consensus Seeking With Noisy and Directed Inter-Agent Communication: Fixed and Randomly Varying Topologies , 2010, IEEE Transactions on Automatic Control.

[33]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[34]  T. Geisel,et al.  The scaling laws of human travel , 2006, Nature.

[35]  R. Menzel,et al.  Displaced honey bees perform optimal scale-free search flights. , 2007, Ecology.

[36]  H. Kesten.  Random difference equations and Renewal theory for products of random matrices , 1973 .

[37]  Jing Wang,et al.  Mean square stability of consensus over fading networks with nonhomogeneous communication delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[38]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[39]  C. Goldie.  IMPLICIT RENEWAL THEORY AND TAILS OF SOLUTIONS OF RANDOM EQUATIONS , 1991 .

[40]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[41]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[42]  Amr El Abbadi,et al.  Distributed average consensus with stochastic communication failures , 2007, 2007 46th IEEE Conference on Decision and Control.