Breathe before speaking: efficient information dissemination despite noisy, limited and anonymous communication

Distributed computing models typically assume reliable communication between processors. While such assumptions often hold for engineered networks, e.g., due to underlying error correction protocols, their relevance to biological systems, wherein messages are often distorted before reaching their destination, is quite limited. In this study we aim at bridging this gap by rigorously analyzing a model of communication in large anonymous populations composed of simple agents which interact through short and highly unreliable messages. We focus on the rumor-spreading problem and the majority-consensus problem, two fundamental tasks in distributed computing, and initiate their study under communication noise. Our model for communication is extremely weak and follows the push gossip communication paradigm: In each synchronous round each agent that wishes to send information delivers a message to a random anonymous agent. This communication is further restricted to contain only one bit (essentially representing an opinion). Lastly, the system is assumed to be so noisy that the bit in each message sent is flipped independently with probability 1/2-ε, for some small Aε >0. Even in this severely restricted, stochastic and noisy setting we give natural protocols that solve the noisy rumor-spreading and the noisy majority-consensus problems efficiently. Our protocols run in O(log n / ε2) rounds and use O(n log n / ε2) messages/bits in total, where n is the number of agents. These bounds are asymptotically optimal and, in fact, are as fast and message efficient as if each agent would have been simultaneously informed directly by the source. Our efficient, robust, and simple algorithms suggest balancing between silence and transmission, synchronization, and majority-based decisions as important ingredients towards understanding collective communication schemes in anonymous and noisy populations.

[1]  Eamonn B. Mallon,et al.  Information flow, opinion polling and collective intelligence in house-hunting social insects. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  M. Newman Spread of epidemic disease on networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Colin Cooper,et al.  The Power of Two Choices in Distributed Voting , 2014, ICALP.

[4]  H. Eisen,et al.  Evidence that a single peptide-MHC complex on a target cell can elicit a cytolytic T cell response. , 1996, Immunity.

[5]  Roger Wattenhofer,et al.  Stone Age Distributed Computing , 2012, ArXiv.

[6]  Christian Scheideler,et al.  Stabilizing consensus with the power of two choices , 2011, SPAA '11.

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Krzysztof Diks,et al.  Optimal Adaptive Broadcasting with a Bounded Fraction of Faulty Nodes , 2000, Algorithmica.

[9]  David Peleg,et al.  Distributed Computing: A Locality-Sensitive Approach , 1987 .

[10]  B. Pittel On spreading a rumor , 1987 .

[11]  Richard M. Karp,et al.  Randomized rumor spreading , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[12]  Anna Huber,et al.  Strong robustness of randomized rumor spreading protocols , 2009, Discret. Appl. Math..

[13]  Michael J. Fischer,et al.  Computation in networks of passively mobile finite-state sensors , 2004, PODC '04.

[14]  George Giakkoupis,et al.  On the bit communication complexity of randomized rumor spreading , 2010, SPAA '10.

[15]  Shlomi Dolev,et al.  Direction election in flocking swarms , 2014, Ad Hoc Networks.

[16]  Paul G. Spirakis,et al.  Natural models for evolution on networks , 2011, Theor. Comput. Sci..

[17]  Paul G. Spirakis,et al.  Mediated population protocols , 2011, Theor. Comput. Sci..

[18]  M. Carroll,et al.  The complement system in regulation of adaptive immunity , 2004, Nature Immunology.

[19]  Chryssis Georgiou,et al.  Meeting the deadline: on the complexity of fault-tolerant continuous gossip , 2011, Distributed Computing.

[20]  Luca Trevisan,et al.  Simple Dynamics for Majority Consensus , 2013, SPAA 2014.

[21]  Mahmoud Fouz,et al.  Asymptotically Optimal Randomized Rumor Spreading , 2011, ICALP.

[22]  J. Buck Synchronous Rhythmic Flashing of Fireflies. II. , 1938, The Quarterly Review of Biology.

[23]  Amos Korman,et al.  Memory Lower Bounds for Randomized Collaborative Search and Implications for Biology , 2012, DISC.

[24]  Noga Alon,et al.  A Biological Solution to a Fundamental Distributed Computing Problem , 2011, Science.

[25]  Andrzej Pelc,et al.  Adaptive Broadcasting with Faulty Nodes , 1996, Parallel Comput..

[26]  James Aspnes,et al.  An Introduction to Population Protocols , 2007, Bull. EATCS.

[27]  Thomas Sauerwald,et al.  On the runtime and robustness of randomized broadcasting , 2009, Theor. Comput. Sci..

[28]  Rachid Guerraoui,et al.  Asynchronous gossip , 2013, JACM.

[29]  George Giakkoupis,et al.  Rumor spreading and vertex expansion , 2012, SODA.

[30]  Bernard Chazelle,et al.  Natural algorithms , 2009, SODA.

[31]  D. Sumpter,et al.  Consensus Decision Making by Fish , 2008, Current Biology.

[32]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[33]  Thierry Aubin,et al.  How do king penguins (Aptenodytes patagonicus apply the mathematical theory of information to communicate in windy conditions? , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[34]  R. Germain,et al.  Variability and Robustness in T Cell Activation from Regulated Heterogeneity in Protein Levels , 2008, Science.

[35]  Frank R. Kschischang,et al.  Coding for Errors and Erasures in Random Network Coding , 2008, IEEE Trans. Inf. Theory.

[36]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[37]  David Eisenstat,et al.  A simple population protocol for fast robust approximate majority , 2007, Distributed Computing.

[38]  E. Wilson,et al.  The Superorganism: The Beauty, Elegance, and Strangeness of Insect Societies , 2008 .

[39]  Aravind Srinivasan,et al.  Randomized Distributed Edge Coloring via an Extension of the Chernoff-Hoeffding Bounds , 1997, SIAM J. Comput..

[40]  Bernhard Haeupler,et al.  Simple, Fast and Deterministic Gossip and Rumor Spreading , 2012, SODA.

[41]  Jean-Sébastien Sereni,et al.  Collaborative search on the plane without communication , 2012, PODC '12.

[42]  Noga Alon,et al.  Beeping a maximal independent set , 2011, Distributed Computing.

[43]  K. Joag-dev,et al.  Negative Association of Random Variables with Applications , 1983 .

[44]  S. Redner,et al.  On the role of zealotry in the voter model , 2007 .

[45]  H. Brumm,et al.  Acoustic Communication in Noise , 2005 .

[46]  Jean-Pierre Eckmann,et al.  Desert ants achieve reliable recruitment across noisy interactions , 2013, Journal of The Royal Society Interface.

[47]  B. Bassler,et al.  Quorum sensing: cell-to-cell communication in bacteria. , 2005, Annual review of cell and developmental biology.

[48]  Devdatt P. Dubhashi,et al.  Balls and bins: A study in negative dependence , 1996, Random Struct. Algorithms.

[49]  Petar Maymounkov,et al.  Global computation in a poorly connected world: fast rumor spreading with no dependence on conductance , 2011, STOC '12.

[50]  Michael J. Fischer,et al.  Self-stabilizing population protocols , 2005, TAAS.

[51]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[52]  Alan M. Frieze,et al.  The shortest-path problem for graphs with random arc-lengths , 1985, Discret. Appl. Math..

[53]  Michael W. Sneddon,et al.  Single-cell quantification of IL-2 response by effector and regulatory T cells reveals critical plasticity in immune response , 2010, Molecular systems biology.

[54]  M. Mobilia Does a single zealot affect an infinite group of voters? , 2003, Physical review letters.

[55]  T. Moon Error Correction Coding: Mathematical Methods and Algorithms , 2005 .

[56]  Shay Kutten,et al.  Making Population Protocols Self-stabilizing , 2009, SSS.

[57]  G. Roberts Why individual vigilance declines as group size increases , 1996, Animal Behaviour.

[58]  Reuven Bar-Yehuda,et al.  Fault Tolerant Distributed Majority Commitment , 1988, J. Algorithms.

[59]  Scott Shenker,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[60]  C. Stevens,et al.  An evaluation of causes for unreliability of synaptic transmission. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Doug Terry,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.