Disconnected Operation in a Distributed File System

From the Publisher: The focus of this work is on the issue of availability in distributed file systems. It presents the important new technique called disconnected operation, in which clients mask failures and voluntary network detachments by emulating the functionality of servers where actual server-oriented solutions are inadequate. This permits client operation even under complete isolation from the server; the clean integration of mobile computers into the system is an important side-effect of the new technique. The design and implementation of disconnected file service in a working system, the Coda file system, is described in detail.

[1]  John S. Heidemann,et al.  Primarily disconnected operation: experiences with Ficus , 1992, [1992 Proceedings] Second Workshop on the Management of Replicated Data.

[2]  David K. Gifford,et al.  A caching file system for a programmer's workstation , 1985, SOSP '85.

[3]  Roger M. Needham,et al.  Using encryption for authentication in large networks of computers , 1978, CACM.

[4]  Garret Swart,et al.  Availability and consistency tradeoffs in the Echo distributed file system , 1989, Proceedings of the Second Workshop on Workstation Operating Systems.

[5]  David S. H. Rosenthal,et al.  Evolving the Vnode interface , 1990, USENIX Summer.

[6]  Mahadev Satyanarayanan,et al.  The ITC distributed file system: principles and design , 1985, SOSP 1985.

[7]  Barbara T. Blaustein,et al.  Updating Replicated Data During Communications Failures , 1985, VLDB.

[8]  Mahadev Satyanarayanan,et al.  A SURVEY OF DISTRIBUTED FILE SYSTEMS , 1990 .

[9]  Lily B. Mummert,et al.  Camelot and Avalon: A Distributed Transaction Facility , 1991 .

[10]  Robert B. Hagmann,et al.  Reimplementing the Cedar file system using logging and group commit , 1987, SOSP '87.

[11]  Keith Marzullo,et al.  Supplying high availability with a standard network file system , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[12]  Sailesh Chutani,et al.  DEcorum File System Architectural Overview , 1990, USENIX Summer.

[13]  Dan Duchamp,et al.  An interface to support lazy replicated file service , 1992, [1992 Proceedings] Second Workshop on the Management of Replicated Data.

[14]  Mahadev Satyanarayanan,et al.  Transparent disconnected operation for fault-tolerance , 1991, OPSR.

[15]  Daniel Barbará,et al.  Using stashing to increase node autonomy in distributed file systems , 1990, Proceedings Ninth Symposium on Reliable Distributed Systems.

[16]  Robbert van Renesse,et al.  Amoeba A Distributed Operating System for the 1990 s Sape , 1990 .

[17]  Mahadev Satyanarayanan,et al.  Disconnected Operation in the Coda File System , 1999, Mobidata.

[18]  M. Hill,et al.  Weak ordering-a new definition , 1990, [1990] Proceedings. The 17th Annual International Symposium on Computer Architecture.

[19]  Mahadev Satyanarayanan,et al.  The Influence of Scale on Distributed File System Design , 1992, IEEE Trans. Software Eng..

[20]  Alan Jay Smith.  Long term file reference patterns and their application to file migration algorithms , 1981 .

[21]  Luis Leopoldo Cova.  Resource management in federated computing environments , 1990 .

[22]  Susan B. Davidson,et al.  An optimistic protocol for partitioned distributed database systems , 1982 .

[23]  Mahadev Satyanarayanan,et al.  A study of file sizes and functional lifetimes , 1981, SOSP.

[24]  Mahadev Satyanarayanan,et al.  Scalable, secure, and highly available distributed file access , 1990, Computer.

[25]  Samuel J. Leffler,et al.  The design and implementation of the , 1990 .

[26]  Michael Burrows,et al.  Autonet: A High-Speed, Self-Configuring Local Area Network Using Point-to-Point Links , 1991, IEEE J. Sel. Areas Commun..

[27]  Steve R. Kleiman,et al.  Vnodes: An Architecture for Multiple File System Types in Sun UNIX , 1986, USENIX Summer.

[28]  Gregory R. Andrews,et al.  A file replication facility for berkeley unix , 1987, Softw. Pract. Exp..

[29]  Rick Floyd.  Short-Term File Reference Patterns in a UNIX Environment, , 1986 .

[30]  Mahadev Satyanarayanan,et al.  Efficient User-Level File Cache Management on the Sun Vnode Interface , 1990, USENIX Summer.

[31]  K. Korner,et al.  Intelligent caching for remote file service , 1990, Proceedings.,10th International Conference on Distributed Computing Systems.

[32]  Susan B. Davidson,et al.  Optimism and consistency in partitioned distributed database systems , 1984, TODS.

[33]  J. Howard Et El,et al.  Scale and performance in a distributed file system , 1988 .

[34]  Ii Richard George Guy,et al.  FICUS: a very large scale reliable distributed file system , 1992 .

[35]  Mahadev Satyanarayanan,et al.  Coda: A Highly Available File System for a Distributed Workstation Environment , 1990, IEEE Trans. Computers.

[36]  R. A. Floyd.  Transparency in distributed file systems , 1989 .

[37]  Bruce Jay Nelson.  Remote procedure call , 1981 .

[38]  Abraham Silberschatz,et al.  Distributed file systems: concepts and examples , 1990, CSUR.

[39]  David R. Cheriton,et al.  Leases: an efficient fault-tolerant mechanism for distributed file cache consistency , 1989, SOSP '89.

[40]  Craig Everhart,et al.  BDesign and Specification of the Cellular Andrew Environment , 1988 .

[41]  William J. Bolosky,et al.  Mach: A New Kernel Foundation for UNIX Development , 1986, USENIX Summer.

[42]  Mahadev Satyanarayanan,et al.  Exploiting weak connectivity in a distributed file system , 1996 .

[43]  Samuel J. Leffler,et al.  A Fast File System for UNIX (Revised July 27, 1983) , 1983 .

[44]  Thomas R. Gross,et al.  Integration of Compression and Caching for a Two-Level File System. , 1991, ASPLOS 1991.

[45]  Mahadev Satyanarayanan,et al.  Log-based directory resolution in the Coda file system , 1993, [1993] Proceedings of the Second International Conference on Parallel and Distributed Information Systems.

[46]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[47]  Michael N. Nelson,et al.  Caching in the Sprite network file system , 1988, TOCS.

[48]  Gaetano Borriello,et al.  Practical dictionary management for hardware data compression , 1992, CACM.

[49]  Mahadev Satyanarayanan.  Autonomy or independence in distributed systems?: position paper , 1988, EW 3.

[50]  Andrew P. Black,et al.  Sessions: A technique and its application to the UNIX file system , 1987, 1987 IEEE Third International Conference on Data Engineering.

[51]  Jon Postel,et al.  Internet Protocol , 1981, RFC.

[52]  Alley Stoughton,et al.  Detection of Mutual Inconsistency in Distributed Systems , 1983, IEEE Transactions on Software Engineering.

[53]  Hector Garcia-Molina,et al.  Consistency in a partitioned network: a survey , 1985, CSUR.

[54]  Hector Garcia-Molina,et al.  Read-only transactions in a distributed database , 1982, TODS.

[55]  Andy J. Wellings,et al.  The pulse distributed file system , 1985, Softw. Pract. Exp..

[56]  Dan Walsh,et al.  Design and implementation of the Sun network filesystem , 1985, USENIX Conference Proceedings.

[57]  Peter J. Denning,et al.  The working set model for program behavior , 1968, CACM.

[58]  Bruce J. Walker,et al.  The LOCUS Distributed System Architecture , 1986 .

[59]  Mahadev Satyanarayanan,et al.  Integrating security in a large distributed system , 1989, TOCS.

[60]  Alessandro Forin,et al.  UNIX as an Application Program , 1990, USENIX Summer.

[61]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[62]  Butler W. Lampson,et al.  On-line data compression in a log-structured file system , 1992, ASPLOS V.

[63]  Andrew S. Grimshaw,et al.  ELFS: object-oriented extensible file systems , 1991, [1991] Proceedings of the First International Conference on Parallel and Distributed Information Systems.

[64]  Rick Floyd,et al.  Directory Reference Patterns in a UNIX Environment. , 1986 .

[65]  Sailesh Chutani,et al.  The Episode File System , 1992 .

[66]  John S. Heidemann,et al.  Implementation of the Ficus Replicated File System , 1990, USENIX Summer.

[67]  Mahadev Satyanarayanan,et al.  Lightweight Recoverable Virtual Memory , 1993, SOSP.

[68]  Dan Duchamp,et al.  An Efficient Variable-Consistency Replicated File Service , 1992 .

[69]  T. J. Kowalski,et al.  Fsck—the UNIX file system check program , 1990 .

[70]  Thomas R. Gross,et al.  Combining the concepts of compression and caching for a two-level filesystem , 1991, ASPLOS IV.

[71]  Butler W. Lampson,et al.  Crash Recovery in a Distributed Data Storage System , 1981 .

[72]  Maurice Herlihy.  Optimistic Concurrency Control for Abstract Data Types , 1987, ACM SIGOPS Oper. Syst. Rev..

[73]  Mary Baker,et al.  Measurements of a distributed file system , 1991, SOSP '91.

[74]  Albert Chang,et al.  Evolution of Storage Facilities in AIX Version 3 for RISC System/6000 Processors , 1990, IBM J. Res. Dev..

[75]  D. W. Topham.  Introduction to the C Shell , 1990 .

[76]  Samuel J. Leffler,et al.  The design and implementation of the 4.3 BSD Unix operating system , 1991, Addison-Wesley series in computer science.

[77]  James J. Kistler.  Increasing file system availability through second-class replication , 1990, [1990] Proceedings. Workshop on the Management of Replicated Data.

[78]  John A. Kunze,et al.  A trace-driven analysis of the UNIX 4.2 BSD file system , 1985, SOSP '85.

[79]  Liba Svobodova.  File servers for network-based distributed systems , 1984, CSUR.

[80]  David K. Gifford,et al.  Weighted voting for replicated data , 1979, SOSP '79.

[81]  Stanley B. Zdonik,et al.  Fido: A Cache That Learns to Fetch , 1991, VLDB.

[82]  David K. Gifford,et al.  The Cedar file system , 1988, CACM.

[83]  Claude Kaiser,et al.  CHORUS Distributed Operating System , 1988, Comput. Syst..

[84]  Mahadev Satyanarayanan,et al.  A status report on research in transparent informed prefetching , 1993, OPSR.

[85]  Michael L. Kazar,et al.  Synchronization and Caching Issues in the Andrew File System , 1988, USENIX Winter.

[86]  Dan Duchamp,et al.  Detection and exploitation of file working sets , 1991, [1991] Proceedings. 11th International Conference on Distributed Computing Systems.