A Dynamic File Replication and Consistency Mechanism for Efficient Data Center Operation and its Formal Verification

Data centers are built to provide a highly available and scalable infrastructure on which the applications run. As enterprises grow, so do their application need, along with resources required for additional application-specific services. This increase in bottom line expense heightens the overall resource requirement. This paper provides solution to mitigate the impact of these expenses by proposing a file replication and consistency maintenance mechanism that enhances the manageability, scalability, and high availability of resource in these environments. To keep files consistent, changes made at one replica of the file are reflected on other replicas in minimum possible time. File replica is updated on-demand by only propagating the required partial updates. The results show that as compared to Google File System (GFS), the proposed partial write rate shows an improvement of 38.62% while updating the stale replicas. Time required for invalidating the replicas decreases by 34.04% and the time required to update the replica on FRS reduces by 61.75%. Process algebraic approach has been used to establish the relationship between the formal aspect of the file replicating server and its architectural model.

[1]  Jun Rao,et al.  Using Paxos to Build a Scalable, Consistent, and Highly Available Datastore , 2011, Proc. VLDB Endow..

[2]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[3]  Zhiwei Xu,et al.  Grid replication coherence protocol , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[4]  Arun Kumar Misra,et al.  Hybrid reliable load balancing with MOSIX as middleware and its formal verification using process algebra , 2011, Future Gener. Comput. Syst..

[5]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[6]  Jonathan Grudin,et al.  Computer-supported cooperative work: history and focus , 1994, Computer.

[7]  Flavia Donno,et al.  Replica Consistency in a Data Grid , 2004 .

[8]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[9]  Brett D. Fleisch,et al.  The Chubby lock service for loosely-coupled distributed systems , 2006, OSDI '06.

[10]  Rajkumar Buyya,et al.  Special section: Federated resource management in grid and cloud computing systems , 2010, Future Gener. Comput. Syst..

[11]  Erwin Laure,et al.  Replica Management in Data Grids , 2002 .

[12]  Rajkumar Buyya,et al.  High Performance Cluster Computing , 1999 .

[13]  Wilson C. Hsieh,et al.  Bigtable: A Distributed Storage System for Structured Data , 2006, TOCS.

[14]  J. Howard Et El,et al.  Scale and performance in a distributed file system , 1988 .

[15]  GhemawatSanjay,et al.  The Google file system , 2003 .

[16]  Chandramohan A. Thekkath,et al.  Frangipani: a scalable distributed file system , 1997, SOSP.