Communication cost of consensus for nodes with limited memory

Significance Algorithms that allow a large number, n, of processors to reach consensus are of substantial current interest due to applications in sensor networks and blockchains. When each processor is assigned an initial bit, the consensus bit should match the majority of these bits with high probability. We present a consensus algorithm where the total number of communications between all processors grows linearly in n, yet each processor uses surprisingly few bits of memory; we also prove a lower bound that shows that this memory requirement is sharp up to a factor of three. Our result contrasts with previous algorithms where the consensus matches the majority with probability one at the cost of a superlinear number of communications. Motivated by applications in wireless networks and the Internet of Things, we consider a model of n nodes trying to reach consensus with high probability on their majority bit. Each node i is assigned a bit at time 0 and is a finite automaton with m bits of memory (i.e., 2m states) and a Poisson clock. When the clock of i rings, i can choose to communicate and is then matched to a uniformly chosen node j. The nodes j and i may update their states based on the state of the other node. Previous work has focused on minimizing the time to consensus and the probability of error, while our goal is minimizing the number of communications. We show that, when m>3⁡log⁡log⁡log(n), consensus can be reached with linear communication cost, but this is impossible if m<log⁡log⁡log(n). A key step is to distinguish when nodes can become aware of knowing the majority bit and stop communicating. We show that this is impossible if their memory is too low.

[1]  Dan Alistarh,et al.  Fast and Exact Majority in Population Protocols , 2015, PODC.

[2]  Colin Cooper,et al.  Population protocols for leader election and exact majority with O(log^2 n) states and O(log^2 n) convergence time , 2017, ArXiv.

[3]  Snowflake to Avalanche : A Novel Metastable Consensus Protocol Family for Cryptocurrencies Team Rocket , 2018 .

[4]  A. Montanari,et al.  Majority dynamics on trees and the dynamic cavity method , 2009, 0907.0449.

[5]  Martin Vetterli,et al.  The Distributed Multiple Voting Problem , 2011, IEEE Journal of Selected Topics in Signal Processing.

[6]  Mohammed Abdullah,et al.  Global majority consensus by local majority polling on graphs , 2012, 2014 7th International Conference on NETwork Games, COntrol and OPtimization (NetGCoop).

[7]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[8]  Matti Siekkinen,et al.  TLS and energy consumption on a mobile device: A measurement study , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[9]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[10]  Michael J. Fischer,et al.  Computation in networks of passively mobile finite-state sensors , 2004, PODC '04.

[11]  Ho-Lin Chen,et al.  Speed Faults in Computation by Chemical Reaction Networks , 2014, DISC.

[12]  Andrea E. F. Clementi,et al.  Plurality Consensus in the Gossip Model , 2014, SODA.

[13]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[14]  Martin E. Dyer,et al.  Discordant voting processes on finite graphs , 2016, ICALP.

[15]  Dariusz R. Kowalski,et al.  Distributed agreement with optimal communication complexity , 2010, SODA '10.

[16]  Partha Niyogi,et al.  Algorithmic stability and ensemble-based learning , 2002 .

[17]  David Soloveichik,et al.  Stable leader election in population protocols requires linear time , 2015, Distributed Computing.

[18]  Hung T. Nguyen,et al.  A course in stochastic processes , 1996 .

[19]  George Giakkoupis,et al.  Efficient Plurality Consensus, Or: the Benefits of Cleaning up from Time to Time , 2016, ICALP.

[20]  Petra Berenbrink,et al.  Simple and Efficient Leader Election , 2018, SOSA.

[21]  David Eisenstat,et al.  A simple population protocol for fast robust approximate majority , 2007, Distributed Computing.

[22]  Paul G. Spirakis,et al.  Determining majority in networks with local interactions and very small local memory , 2014, Distributed Computing.

[23]  Richard M. Karp,et al.  Randomized rumor spreading , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[24]  David Doty,et al.  Timing in chemical reaction networks , 2013, SODA.

[25]  Milan Vojnovic,et al.  Using Three States for Binary Consensus on Complete Graphs , 2009, IEEE INFOCOM 2009.

[26]  Dan Alistarh,et al.  Time-Space Trade-offs in Population Protocols , 2016, SODA.

[27]  Adrian Kosowski,et al.  Population Protocols Are Fast , 2018 .

[28]  David J. Aldous,et al.  Lower bounds for covering times for reversible Markov chains and random walks on graphs , 1989 .

[29]  Christian Cachin,et al.  Architecture of the Hyperledger Blockchain Fabric , 2016 .

[30]  Merav Parter,et al.  A Polylogarithmic Gossip Algorithm for Plurality Consensus , 2016, PODC.

[31]  Alan M. Frieze,et al.  Multiple Random Walks in Random Regular Graphs , 2009, SIAM J. Discret. Math..

[32]  Wenwu Yu,et al.  Distributed Consensus Filtering in Sensor Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Elchanan Mossel,et al.  Opinion Exchange Dynamics , 2014, Probability Surveys.

[34]  David Peleg,et al.  Distributed Probabilistic Polling and Applications to Proportionate Agreement , 1999, ICALP.

[35]  Ayalvadi Ganesh,et al.  Probabilistic consensus via polling and majority rules , 2013, Queueing Syst. Theory Appl..

[36]  Dan Alistarh,et al.  Space-Optimal Majority in Population Protocols , 2017, SODA.

[37]  Luca Cardelli,et al.  The Cell Cycle Switch Computes Approximate Majority , 2012, Scientific Reports.

[38]  Dan Alistarh,et al.  Polylogarithmic-Time Leader Election in Population Protocols , 2015, ICALP.

[39]  Moez Draief,et al.  Convergence Speed of Binary Interval Consensus , 2010, 2010 Proceedings IEEE INFOCOM.

[40]  Masafumi Yamashita,et al.  Probabilistic Local Majority Voting for the Agreement Problem on Finite Graphs , 1999, COCOON.

[41]  Martin Vetterli,et al.  Interval consensus: From quantized gossip to voting , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[42]  Elchanan Mossel,et al.  Majority dynamics and aggregation of information in social networks , 2012, Autonomous Agents and Multi-Agent Systems.

[43]  Sanjeev R. Kulkarni,et al.  An upper bound on the convergence time for quantized consensus , 2013, INFOCOM.