Merging semantics for conflict updates in geo-distributed file systems

We present our model of file systems and our merging semantics for resolving conflict updates in geo-distributed file systems. The system model fully describes a file system with all of its components including hard links. This model is able to identify all conflict cases which are classified into direct, such as concurrent updates to the same file, and indirect, such as cycles in the namespace of the file system. The merging semantics resolve all types of conflicts while being able to preserve the effect of all conflict updates. Our implementation of the system and the merging semantics outperforms the existing systems in terms of feature completeness.

[1]  John S. Heidemann,et al.  Resolving File Conflicts in the Ficus File System , 1994, USENIX Summer.

[2]  Norman Ramsey,et al.  An algebraic approach to file synchronization , 2001, ESEC/FSE-9.

[3]  Joan Manuel Marquès,et al.  A Commutative Replicated Data Type for Cooperative Editing , 2009, 2009 29th IEEE International Conference on Distributed Computing Systems.

[4]  Eric A. Brewer,et al.  Towards robust distributed systems (abstract) , 2000, PODC '00.

[5]  Alley Stoughton,et al.  Detection of Mutual Inconsistency in Distributed Systems , 1983, IEEE Transactions on Software Engineering.

[6]  Peter L. Reiher,et al.  Roam: a scalable replication system for mobile computing , 1999, Proceedings. Tenth International Workshop on Database and Expert Systems Applications. DEXA 99.

[7]  Peter L. Reiher,et al.  Roam: A Scalable Replication System for Mobility , 2004, Mob. Networks Appl..

[8]  Nestan Tsiskaridze,et al.  Conflict Resolution , 2009, CP.

[9]  Mahadev Satyanarayanan,et al.  Coda: a highly available file system for a distributed workstation environment , 1989, Proceedings of the Second Workshop on Workstation Operating Systems.

[10]  Benjamin C. Pierce,et al.  What is a file synchronizer? , 1998, MobiCom '98.

[11]  Michael L. Kazar,et al.  Synchronization and Caching Issues in the Andrew File System , 1988, USENIX Winter.

[12]  John H. Howard,et al.  On Overview of the Andrew File System , 1988, USENIX Winter.

[13]  Nancy A. Lynch,et al.  Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services , 2002, SIGA.

[14]  Werner Vogels,et al.  Building reliable distributed systems at a worldwide scale demands trade-offs between consistency and availability. , 2022 .

[15]  Mahadev Satyanarayanan,et al.  Disconnected operation in the Coda File System , 1992, TOCS.

[16]  Marvin Theimer,et al.  Managing update conflicts in Bayou, a weakly connected replicated storage system , 1995, SOSP.

[17]  Peter L. Reiher,et al.  Rumor: Mobile Data Access Through Optimistic Peer-to-Peer Replication , 1998, ER Workshops.

[18]  Mahadev Satyanarayanan,et al.  Coda: A Highly Available File System for a Distributed Workstation Environment , 1990, IEEE Trans. Computers.

[19]  Andrew S. Tanenbaum,et al.  Distributed operating systems , 2009, CSUR.

[20]  Marc Shapiro,et al.  Scality's experience with a geo-distributed file system , 2014, Middleware.

[21]  Werner Vogels,et al.  Eventually consistent , 2008, CACM.

[22]  Pascal Molli,et al.  Logoot: A Scalable Optimistic Replication Algorithm for Collaborative Editing on P2P Networks , 2009, 2009 29th IEEE International Conference on Distributed Computing Systems.

[23]  Philip A. Bernstein,et al.  Merging Models Based on Given Correspondences , 2003, VLDB.

[24]  Bruce Walker,et al.  The LOCUS distributed operating system , 1983, SOSP '83.

[25]  Kim-Kwang Raymond Choo,et al.  Google Drive: Forensic analysis of data remnants , 2014, J. Netw. Comput. Appl..

[26]  Marc Shapiro,et al.  Conflict-Free Replicated Data Types , 2011, SSS.

[27]  Nikolaj Bjørner,et al.  Models and Software Model Checking of a Distributed File Replication System , 2007, Formal Methods and Hybrid Real-Time Systems.

[28]  Marc Shapiro,et al.  A comprehensive study of Convergent and Commutative Replicated Data Types , 2011 .

[29]  Antony I. T. Rowstron,et al.  The IceCube approach to the reconciliation of divergent replicas , 2001, PODC '01.

[30]  Bruce J. Walker,et al.  The LOCUS Distributed System Architecture , 1986 .

[31]  Werner Vogels,et al.  Dynamo: amazon's highly available key-value store , 2007, SOSP.