Parallax: Managing Storage for a Million Machines

OS virtualization is drastically changing the face of system administration for large computer installations such as commercial datacenters and scientific clusters. A recent report by Gartner predicts that commercial use of virtualization will triple over the five year period beginning in 2004 [1]. While it is commonly held that OS virtualization improves the utility, manageability, and scalability of large-scale environments, we believe that it is not sufficient in itself. In this paper we argue that the next key challenge facing these environments lies in the dramatically evolving requirements for the management of persistent storage.

[1]  Garret Swart,et al.  The Echo Distributed File System , 1996 .

[2]  Samuel T. King,et al.  Debugging Operating Systems with Time-Traveling Virtual Machines (Awarded General Track Best Paper Award!) , 2005, USENIX Annual Technical Conference, General Track.

[3]  Andrew Warfield,et al.  Safe Hardware Access with the Xen Virtual Machine Monitor , 2007 .

[4]  Arif Merchant,et al.  FAB: building distributed enterprise disk arrays from commodity components , 2004, ASPLOS XI.

[5]  T. Bittman,et al.  Gartner Predicts 2004: Server virtualization evolves rapidly , 2003 .

[6]  Steven D. Gribble,et al.  Configuration Debugging as Search: Finding the Needle in the Haystack , 2004, OSDI.

[7]  Andrew Warfield,et al.  Facilitating the Development of Soft Devices , 2005, USENIX Annual Technical Conference, General Track.

[8]  Minwen Ji.  Instant Snapshots in a Federated Array of Bricks , 2005 .

[9]  Sean Quinlan,et al.  Venti: A New Approach to Archival Storage , 2002, FAST.

[10]  Carl Smith,et al.  NFS Version 3: Design and Implementation , 1994, USENIX Summer.

[11]  Samuel T. King,et al.  Backtracking intrusions , 2003, SOSP '03.

[12]  H. Apte,et al.  Serverless Network File Systems , 2006 .

[13]  Chandramohan A. Thekkath,et al.  Petal: distributed virtual disks , 1996, ASPLOS VII.

[14]  Sean Quinlan,et al.  A cached WORM file system , 1991, Softw. Pract. Exp..

[15]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[16]  Andrew Warfield,et al.  Are Virtual Machine Monitors Microkernels Done Right? , 2005, HotOS.

[17]  John H. Howard,et al.  On Overview of the Andrew File System , 1988, USENIX Winter.

[18]  Miguel Castro,et al.  Farsite: federated, available, and reliable storage for an incompletely trusted environment , 2002, OPSR.

[19]  Mike Hibler,et al.  USENIX Association Proceedings of the General Track : 2003 USENIX Annual , 2003 .

[20]  Norman C. Hutchinson,et al.  Deciding when to forget in the Elephant file system , 1999, SOSP.