Unbeatable Set Consensus via Topological and Combinatorial Reasoning

The set consensus problem has played an important role in the study of distributed systems for over two decades. Indeed, the search for lower bounds and impossibility results for this problem spawned the topological approach to distributed computing, which has given rise to new techniques in the design and analysis of protocols. The design of efficient solutions to set consensus has also proven to be challenging. In the synchronous crash failure model, the literature contains a sequence of solutions to set consensus, each improving upon the previous ones. This paper presents an unbeatable protocol for nonuniform k-set consensus in the synchronous crash failure model. This is an efficient protocol whose decision times cannot be improved upon. Moreover, the description of our protocol is extremely succinct. Proving unbeatability of this protocol is a nontrivial challenge. We provide two proofs for its unbeatability: one is a subtle constructive combinatorial proof, and the other is a topological proof of a new style. These two proofs provide new insight into the connection between topological reasoning and combinatorial reasoning about protocols, which has long been a subject of interest. In particular, our topological proof reasons in a novel way about subcomplexes of the protocol complex, and sheds light on an open question posed by Guerraoui and Pochon (2009). Finally, using the machinery developed in the design of this unbeatable protocol, we propose a protocol for uniform k-set consensus that beats all known solutions by a large margin.

[1]  Rachid Guerraoui,et al.  The Complexity of Early Deciding Set Agreement: How can Topology help? , 2009, Electron. Notes Theor. Comput. Sci..

[2]  Rachid Guerraoui,et al.  A Topological Treatment of Early-Deciding Set-Agreement , 2006, OPODIS.

[3]  Maurice Herlihy,et al.  Transforming worst-case optimal solutions for simultaneous tasks into all-case optimal solutions , 2011, PODC '11.

[4]  Vassos Hadzilacos,et al.  On the Relationship Between the Atomic Commitment and Consensus Problems , 1990, Fault-Tolerant Distributed Computing.

[5]  Maurice Herlihy,et al.  Unifying synchronous and asynchronous message-passing models , 1998, PODC '98.

[6]  Nancy A. Lynch,et al.  Impossibility of distributed consensus with one faulty process , 1985, JACM.

[7]  Rachid Guerraoui,et al.  The Complexity of Early Deciding Set Agreement , 2011, SIAM J. Comput..

[8]  Idit Keidar,et al.  A simple proof of the uniform consensus synchronous lower bound , 2003, Inf. Process. Lett..

[9]  Nancy A. Lynch,et al.  Tight bounds for k-set agreement , 2000, J. ACM.

[10]  Jiannong Cao,et al.  A bivalency proof of the lower bound for uniform consensus , 2005, Inf. Process. Lett..

[11]  Yoram Moses,et al.  Unbeatable consensus , 2014, Distributed Computing.

[12]  Michel Raynal,et al.  Early-Stopping k-Set Agreement in Synchronous Systems Prone to Any Number of Process Crashes , 2005, PaCT.

[13]  Soma Chaudhuri,et al.  Agreement is harder than consensus: set consensus problems in totally asynchronous systems , 1990, PODC '90.

[14]  Eli Gafni,et al.  Generalized FLP impossibility result for t-resilient asynchronous computations , 1993, STOC.

[15]  Yoram Moses,et al.  Brief announcement: pareto optimal solutions to consensus and set consensus , 2013, PODC '13.

[16]  André Schiper,et al.  Uniform consensus is harder than consensus , 2004, J. Algorithms.

[17]  Yoram Moses,et al.  Programming simultaneous actions using common knowledge , 1987, Algorithmica.

[18]  Maurice Herlihy,et al.  Distributed Computing Through Combinatorial Topology , 2013 .

[19]  Nancy A. Lynch,et al.  Impossibility of distributed consensus with one faulty process , 1983, PODS '83.

[20]  Joseph Y. Halpern,et al.  Knowledge and common knowledge in a distributed environment , 1984, JACM.

[21]  Yoram Moses,et al.  Knowledge and Common Knowledge in a Byzantine Environment I: Crash Failures , 1986, TARK.

[22]  Michel Raynal,et al.  Optimal early stopping uniform consensus in synchronous systems with process omission failures , 2004, SPAA '04.

[23]  Michael E. Saks,et al.  Wait-free k-set agreement is impossible: the topology of public knowledge , 1993, STOC.

[24]  Joseph Y. Halpern,et al.  A characterization of eventual Byzantine agreement , 1990, PODC '90.

[25]  Rachid Guerraoui,et al.  Tight Bounds on Early Local Decisions in Uniform Consensus , 2003, DISC.

[26]  Danny Dolev,et al.  Early stopping in Byzantine agreement , 1990, JACM.

[27]  Maurice Herlihy,et al.  Elements of Combinatorial Topology , 2014 .

[28]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[29]  Maurice Herlihy,et al.  The topological structure of asynchronous computability , 1999, JACM.

[30]  Dan Alistarh,et al.  Of Choices, Failures and Asynchrony: The Many Faces of Set Agreement , 2011, Algorithmica.

[31]  Brian A. Coan,et al.  A communication-efficient canonical form for fault-tolerant distributed protocols , 1986, PODC '86.

[32]  Yoram Moses,et al.  Relating Knowledge and Coordinated Action: The Knowledge of Preconditions Principle , 2016, TARK.