HT-Ring Paxos: Theory of High Throughput State-Machine Replication for Clustered Data Centers

Implementations of state-machine replication (SMR) prevalently use the variants of Paxos. Some of the recent variants of Paxos like, Ring Paxos, Multi-Ring Paxos, S-Paxos and HT-Paxos achieve significantly high throughput. However, to meet the growing demand of high throughput, we are proposing HT-Ring Paxos, a variant of Paxos that is basically derived from the classical Paxos. Moreover, it also adopts some fundamental concepts of Ring Paxos, S-Paxos and HT-Paxos for increasing throughput. Furthermore, HT-Ring Paxos is best suitable for clustered data centers and achieves comparatively high throughput among all variants of Paxos. However, similar to Ring Paxos, latency of the HT-Ring Paxos is quite high as compared with other variants of Paxos.

[1]  Yawei Li,et al.  Megastore: Providing Scalable, Highly Available Storage for Interactive Services , 2011, CIDR.

[2]  Dennis Shasha,et al.  The dangers of replication and a solution , 1996, SIGMOD '96.

[3]  André Schiper,et al.  Tuning Paxos for High-Throughput with Batching and Pipelining , 2012, ICDCN.

[4]  V. Ė. Malyshkin.  Parallel Computing Technologies: 6th International Conference, PaCT 2001, Novosibirsk, Russia, September 3-7, 2001 Proceedings , 2001 .

[5]  Keith Marzullo,et al.  Mencius: Building Efficient Replicated State Machine for WANs , 2008, OSDI.

[6]  Leslie Lamport,et al.  Generalized Consensus and Paxos , 2005 .

[7]  Leslie Lamport,et al.  Reconfiguring a state machine , 2010, SIGA.

[8]  Fred B. Schneider,et al.  Implementing fault-tolerant services using the state machine approach: a tutorial , 1990, CSUR.

[9]  Fernando Pedone,et al.  High performance state-machine replication , 2011, 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN).

[10]  Flavio Paiva Junqueira,et al.  Zab: High-performance broadcast for primary-backup systems , 2011, 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN).

[11]  Leslie Lamport,et al.  Reaching Agreement in the Presence of Faults , 1980, JACM.

[12]  Ajay Agarwal,et al.  An Efficient Read Dominant Data Replication Protocol under Serial Isolation using Quorum Consensus Approach , 2014, ArXiv.

[13]  Leslie Lamport,et al.  Cheap Paxos , 2004, International Conference on Dependable Systems and Networks, 2004.

[14]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[15]  Robert Griesemer,et al.  Paxos made live: an engineering perspective , 2007, PODC '07.

[16]  Ajay Agarwal,et al.  Generalized Grid Quorum Consensus for Replica Control Protocol , 2011, 2011 International Conference on Computational Intelligence and Communication Networks.

[17]  Yoav Tock,et al.  Dr. Multicast: Rx for data center communication scalability , 2008, LADIS '08.

[18]  Ajay Agarwal,et al.  HT-Paxos: High Throughput State-Machine Replication Protocol for Large Clustered Data Centers , 2015, TheScientificWorldJournal.

[19]  André Schiper,et al.  Solving Atomic Broadcast with Indirect Consensus , 2006, International Conference on Dependable Systems and Networks (DSN'06).

[20]  Fernando Pedone,et al.  Multi-Ring Paxos , 2012, IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012).

[21]  Leslie Lamport,et al.  The Implementation of Reliable Distributed Multiprocess Systems , 1978, Comput. Networks.

[22]  Achour Mostéfaoui,et al.  Consensus in One Communication Step , 2001, PaCT.

[23]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[24]  Rachid Guerraoui,et al.  Throughput optimal total order broadcast for cluster environments , 2010, TOCS.

[25]  Fernando Pedone,et al.  Ring Paxos: A high-throughput atomic broadcast protocol , 2010, 2010 IEEE/IFIP International Conference on Dependable Systems & Networks (DSN).

[26]  Brett D. Fleisch,et al.  The Chubby lock service for loosely-coupled distributed systems , 2006, OSDI '06.

[27]  Jean-Philippe Martin,et al.  Fast Byzantine Consensus , 2006, IEEE Transactions on Dependable and Secure Computing.

[28]  André Schiper,et al.  S-Paxos: Offloading the Leader for High Throughput State Machine Replication , 2012, 2012 IEEE 31st Symposium on Reliable Distributed Systems.

[29]  Kenneth P. Birman,et al.  A History of the Virtual Synchrony Replication Model , 2010, Replication.

[30]  Robert H. Thomas,et al.  A Majority consensus approach to concurrency control for multiple copy databases , 1979, ACM Trans. Database Syst..

[31]  Leslie Lamport,et al.  Fast Paxos , 2006, Distributed Computing.

[32]  Yair Amir,et al.  Paxos for System Builders , 2008 .

[33]  Leslie Lamport,et al.  Paxos Made Simple , 2001 .