Jolteon and Ditto: Network-Adaptive Efficient Consensus with Asynchronous Fallback

Existing committee-based Byzantine state machine replication (SMR) protocols, typically deployed in production blockchains, face a clear trade-off: (1) they either achieve linear communication cost in the happy path, but sacrifice liveness during periods of asynchrony, or (2) they are robust (progress with probability one) but pay quadratic communication cost. We believe this trade-off is unwarranted since existing linear protocols still have asymptotic quadratic cost in the worst case. We design Ditto, a Byzantine SMR protocol that enjoys the best of both worlds: optimal communication on and off the happy path (linear and quadratic, respectively) and progress guarantee under asynchrony and DDoS attacks. We achieve this by replacing the view-synchronization of partially synchronous protocols with an asynchronous fallback mechanism at no extra asymptotic cost. Specifically, we start from HotStuff, a state-of-the-art linear protocol, and gradually build Ditto. As a separate contribution and an intermediate step, we design a 2-chain version of HotStuff, Jolteon, which leverages a quadratic view-change mechanism to reduce the latency of the standard 3-chain HotStuff. We implement and experimentally evaluate all our systems. Notably, Jolteon's commit latency outperforms HotStuff by 200-300ms with varying system size. Additionally, Ditto adapts to the network and provides better performance than Jolteon under faulty conditions and better performance than VABA (a state-of-the-art asynchronous protocol) under faultless conditions. This proves our case that breaking the robustness-efficiency trade-off is in the realm of practicality.

[1]  Marko Vukolic,et al.  The Next 700 BFT Protocols , 2015, ACM Trans. Comput. Syst..

[2]  Elaine Shi,et al.  The Honey Badger of BFT Protocols , 2016, CCS.

[3]  Alexander Spiegelman,et al.  ACE: Abstract Consensus Encapsulation for Liveness Boosting of State Machine Replication , 2019, OPODIS.

[4]  Kartik Nayak,et al.  Flexible Byzantine Fault Tolerance , 2019, CCS.

[5]  Victor Shoup,et al.  Secure and Efficient Asynchronous Broadcast Protocols , 2001, CRYPTO.

[6]  Benny Pinkas,et al.  SBFT: A Scalable and Decentralized Trust Infrastructure , 2018, 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[7]  Dahlia Malkhi,et al.  Asynchronous Distributed Key Generation for Computationally-Secure Randomness, Consensus, and Threshold Signatures. , 2020, CCS.

[8]  Jing Xu,et al.  Dumbo: Faster Asynchronous BFT Protocols , 2020, IACR Cryptol. ePrint Arch..

[9]  Matthieu Rambaud,et al.  Brief Announcement: Malicious Security Comes for Free in Consensus with Leaders , 2021, IACR Cryptol. ePrint Arch..

[10]  HariGovind V. Ramasamy,et al.  Parsimonious Asynchronous Byzantine-Fault-Tolerant Atomic Broadcast , 2005, OPODIS.

[11]  Alexander Spiegelman,et al.  In Search for a Linear Byzantine Agreement , 2020, ArXiv.

[12]  Nancy A. Lynch,et al.  Impossibility of distributed consensus with one faulty process , 1983, PODS '83.

[13]  Vitalik Buterin,et al.  Casper the Friendly Finality Gadget , 2017, ArXiv.

[14]  Kartik Nayak,et al.  On the Optimality of Optimistic Responsiveness , 2020, IACR Cryptol. ePrint Arch..

[15]  Kartik Nayak,et al.  Strengthened Fault Tolerance in Byzantine Fault Tolerant Replication , 2021, 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS).

[16]  Murat Demirbas,et al.  Bottlenecks in Blockchain Consensus Protocols , 2021, 2021 IEEE International Conference on Omni-Layer Intelligent Systems (COINS).

[17]  Victor Shoup,et al.  Optimistic Asynchronous Atomic Broadcast , 2005, ICALP.

[18]  Qiang Tang,et al.  Bolt-Dumbo Transformer: Asynchronous Consensus As Fast As the Pipelined BFT , 2021, CCS.

[19]  Idit Keidar,et al.  All You Need is DAG , 2021, PODC.

[20]  Jason Paul Cruz,et al.  Hybrid-BFT: Optimistically Responsive Synchronous Consensus with Optimal Latency or Resilience , 2020, IACR Cryptol. ePrint Arch..

[21]  Jonathan Katz,et al.  Network-Agnostic State Machine Replication , 2020, IACR Cryptol. ePrint Arch..

[22]  Ittai Abraham,et al.  Asymptotically Optimal Validated Asynchronous Byzantine Agreement , 2019, PODC.

[23]  Chen Feng,et al.  Fast-HotStuff: A Fast and Resilient HotStuff Protocol , 2020, ArXiv.

[24]  Jianbo Gao,et al.  Performance Analysis of the Libra Blockchain: An Experimental Study , 2019, 2019 2nd International Conference on Hot Information-Centric Networking (HotICN).

[25]  Elaine Shi,et al.  PiLi: An Extremely Simple Synchronous Blockchain , 2018, IACR Cryptol. ePrint Arch..

[26]  Victor Shoup,et al.  Random Oracles in Constantinople: Practical Asynchronous Byzantine Agreement Using Cryptography , 2000, Journal of Cryptology.

[27]  Ittai Abraham,et al.  HotStuff: BFT Consensus with Linearity and Responsiveness , 2019, PODC.

[28]  A. Sonnino,et al.  State Machine Replication in the Libra Blockchain , 2019 .

[29]  Bryan Ford,et al.  Enhancing Bitcoin Security and Performance with Strong Consistency via Collective Signing , 2016, USENIX Security Symposium.

[30]  Miguel Oom Temudo de Castro,et al.  Practical Byzantine fault tolerance , 1999, OSDI '99.

[31]  K ReiterMichael,et al.  Fault-scalable Byzantine fault-tolerant services , 2005 .

[32]  Ethan Buchman,et al.  The latest gossip on BFT consensus , 2018, ArXiv.

[33]  Guiling Wang,et al.  Dumbo-MVBA: Optimal Multi-Valued Validated Asynchronous Byzantine Agreement, Revisited , 2020, IACR Cryptol. ePrint Arch..

[34]  Ramakrishna Kotla,et al.  Zyzzyva , 2007, SOSP.

[35]  Sreeram Kannan,et al.  Blockchain CAP Theorem Allows User-Dependent Adaptivity and Finality , 2021, Financial Cryptography.

[36]  Elaine Shi,et al.  Thunderella: Blockchains with Optimistic Instant Confirmation , 2018, IACR Cryptol. ePrint Arch..

[37]  Nancy A. Lynch,et al.  Consensus in the presence of partial synchrony , 1988, JACM.

[38]  Damian Lesniak,et al.  Aleph: Efficient Atomic Broadcast in Asynchronous Networks with Byzantine Nodes , 2019, AFT.