A Failure Detection System for Large Scale Distributed Systems

Failure detection is a fundamental building block for ensuring fault tolerance in large scale distributed systems. In this paper we present an innovative solution to this problem. The approach is based on adaptive, decentralized failure detectors, capable of working asynchronous and independent on the application flow. The proposed failure detectors are based on clustering, the use of a gossip-based algorithm for detection at local level and the use of a hierarchical structure among clusters of detectors along which traffic is channeled. In this we present result proving that the system is able to scale to a large number of nodes, while still considering the QoS requirements of both applications and resources, and it includes the fault tolerance and system orchestration mechanisms, added in order to asses the reliability and availability of distributed systems in an autonomic manner.

[1]  Ciprian Dobre,et al.  Robust Failure Detection Architecture for Large Scale Distributed Systems , 2009, ArXiv.

[2]  Sam Toueg,et al.  Unreliable failure detectors for reliable distributed systems , 1996, JACM.

[3]  Robbert van Renesse,et al.  A Gossip-Style Failure Detection Service , 2009 .

[4]  Ciprian Dobre,et al.  A dependability layer for large-scale distributed systems , 2011, Int. J. Grid Util. Comput..

[5]  D Xavier,et al.  On the Design of a Failure Detection Service for Large-Scale Distributed Systems , 2003 .

[6]  Gregor von Laszewski,et al.  A fault detection service for wide area distributed computations , 2004, Cluster Computing.

[7]  Pierre Sens,et al.  Implementation and performance evaluation of an adaptable failure detector , 2002, Proceedings International Conference on Dependable Systems and Networks.

[8]  Michel Raynal,et al.  An adaptive failure detection protocol , 2001, Proceedings 2001 Pacific Rim International Symposium on Dependable Computing.

[9]  Marcos K. Aguilera,et al.  On the quality of service of failure detectors based on control theory , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[10]  Ciprian Dobre,et al.  A Distributed Agent Based System to Control and Coordinate Large Scale Data Transfers , 2011, ArXiv.