The emerging paradigm shift in storage system architectures

It is argued that currently dominant, large-scale storage architectures, built around central, shared storage systems with CPU-connected devices, are reaching economic and technological limitations and no longer meet performance, capacity, and transparency requirements. Models of historical scientific and technological paradigm shifts are reviewed, and the reasons why the authors believe such a paradigm shift is underway in storage system architectures are discussed. The requirements to be met, important technical problems being investigated, such as network-connected devices, use of storage hierarchies, and system management, and the characteristics of the emerging large-scale, distributed, storage-architecture paradigm are described and illustrated by actual implementations and by standardization work under way in the IEEE Storage System Standards Working Group. >

[1]  Donna Mecozzi,et al.  Design for a transparent, distributed file system , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[2]  Carole B. Hogan,et al.  The Livermore distributed storage system: implementation and experiences , 1990, [1990] Digest of papers. Tenth IEEE Symposium on Mass Storage Systems@m_Crisis in Mass Storage.

[3]  Andrew S. Tanenbaum,et al.  Modern Operating Systems , 1992 .

[4]  David K. Gifford,et al.  The Cedar file system , 1988, CACM.

[5]  Randy H. Katz,et al.  High-performance network and channel-based storage , 1992, Proc. IEEE.

[6]  Bernard T. O'Lear,et al.  Optical Device Interfacing for a Mass Storage System , 1985, Computer.

[7]  Mahadev Satyanarayanan,et al.  A SURVEY OF DISTRIBUTED FILE SYSTEMS , 1990 .

[8]  Randy H. Katz,et al.  A case for redundant arrays of inexpensive disks (RAID) , 1988, SIGMOD '88.

[9]  Abraham Silberschatz,et al.  Distributed file systems: concepts and examples , 1990, CSUR.

[10]  Robert A. Coyne,et al.  An introduction to the Mass Storage System Reference Model, version 5 , 1993, [1993] Proceedings Twelfth IEEE Symposium on Mass Storage systems.

[11]  Jon Postel,et al.  File Transfer Protocol , 1985, RFC.

[12]  Larry D. Wittie,et al.  Computer networks and distributed systems , 1991, Computer.

[13]  Butler W. Lampson,et al.  Distributed Systems — Architecture and Implementation , 1982, Lecture Notes in Computer Science.

[14]  Richard W. Watson,et al.  Storage systems for national information assets , 1992, Proceedings Supercomputing '92.

[15]  Robbert van Renesse,et al.  Amoeba A Distributed Operating System for the 1990 s Sape , 1990 .

[16]  Dan Walsh,et al.  Design and implementation of the Sun network filesystem , 1985, USENIX Conference Proceedings.

[17]  D. Habermehl,et al.  Renaissance: managing the network computer and its storage requirements , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[18]  Nancy P. Kronenberg,et al.  VAXcluster: a closely-coupled distributed system , 1986, TOCS.

[19]  Andrzej M. Goscinski,et al.  Distributed operating systems - the logical design , 1991 .

[20]  James E. Donnelley.  Components of a Network Operating System , 1979, Comput. Networks.

[21]  J. Mitchell,et al.  Issues in the design and use of a distributed file system , 1980, OPSR.

[22]  Liba Svobodova.  File servers for network-based distributed systems , 1984, CSUR.

[23]  Randy H. Katz,et al.  Disk system architectures for high performance computing , 1989, Proc. IEEE.

[24]  David Tweten.  Hiding mass storage under Unix: NASA's MSS-II architecture , 1990, [1990] Digest of papers. Tenth IEEE Symposium on Mass Storage Systems@m_Crisis in Mass Storage.

[25]  Robert A. Coyne,et al.  Dynamic hierarchies and optimization in distributed storage systems , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[26]  J. Cash,et al.  Information Technology and Tomorrow's Manager , 1988 .

[27]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[28]  Michael N. Nelson,et al.  Caching in the Sprite network file system , 1988, TOCS.

[29]  Norman P. Jouppi,et al.  Computer technology and architecture: an evolving interaction , 1991, Computer.

[30]  Mahadev Satyanarayanan,et al.  The Influence of Scale on Distributed File System Design , 1992, IEEE Trans. Software Eng..

[31]  Alan Poston,et al.  Distributed NAStore as the next step , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[32]  Mahadev Satyanarayanan,et al.  Scalable, secure, and highly available distributed file access , 1990, Computer.

[33]  Kathy Benninger,et al.  An AFS-based mass storage system at the Pittsburgh Supercomputing Center , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[34]  William Collins,et al.  A Network File Storage System , 1982, COMPCON.

[35]  Elliott I. Organick,et al.  The multics system: an examination of its structure , 1972 .

[36]  J. D. Kuehler,et al.  A photo-digital mass storage system , 1899, AFIPS '66 (Fall).

[37]  Mahadev Satyanarayanan,et al.  Andrew: a distributed personal computing environment , 1986, CACM.

[38]  J.G. Fletcher,et al.  Computer storage structure and utilization at a large scientific laboratory , 1975, Proceedings of the IEEE.

[39]  Carole B. Hogan,et al.  The Livermore distributed storage system: requirements and overview , 1990, [1990] Digest of papers. Tenth IEEE Symposium on Mass Storage Systems@m_Crisis in Mass Storage.

[40]  Andrew P. Black,et al.  The Eden System: A Technical Review , 1985, IEEE Transactions on Software Engineering.

[41]  Bill Collins,et al.  Mass storage systems reference model system management , 1988, Digest of Papers Ninth IEEE Symposium on Mass Storage Systems, 1988. 'Storage Systems: Perspectives'.

[42]  Anthony L. Peterson.  E-systems Modular Automated Storage System (EMASS) software functionality , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[43]  Richard W. Watson,et al.  Network Architecture Design for Back-End Storage Networks , 1980, Computer.

[44]  B. Collins,et al.  Profiles in mass storage: a tale of two systems , 1988, Proceedings. SUPERCOMPUTING '88.

[45]  Steve R. Kleiman,et al.  Vnodes: An Architecture for Multiple File System Types in Sun UNIX , 1986, USENIX Summer.

[46]  Mahadev Satyanarayanan,et al.  Coda: A Highly Available File System for a Distributed Workstation Environment , 1990, IEEE Trans. Computers.

[47]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[48]  J. G. Fletcher,et al.  An Architecture for Support of Network Operating System Services , 1980, Comput. Networks.

[49]  Marjorie Devaney,et al.  Profiles in mass storage: a tale of two systems , 1988, Digest of Papers Ninth IEEE Symposium on Mass Storage Systems, 1988. 'Storage Systems: Perspectives'.

[50]  J. L. Sloan,et al.  MaSSIVE: the Mass Storage System IV Enterprise , 1993 .

[51]  Bruce J. Walker,et al.  The LOCUS Distributed System Architecture , 1986 .

[52]  William R. Franta,et al.  Future directions of high-speed networks for distributed storage environments , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.

[53]  R. Watson,et al.  Storage in the LLNL Octopus network: an overview and reflections , 1984 .

[54]  B. Clifford Neuman,et al.  Kerberos: An Authentication Service for Open Network Systems , 1988, USENIX Winter.

[55]  Steve Miller,et al.  Mass storage system reference model, Version 4 , 1993 .

[56]  Don E. Tolmie.  Local area gigabit networking , 1991, [1991] Digest of Papers Eleventh IEEE Symposium on Mass Storage Systems.