A scalable bandwidth guaranteed distributed continuous media file system using network attached autonomous disks

Repository for continuous media data differs from that of the traditional text-based data both in storage space and streaming bandwidth requirements. The file systems used for continuous media streams need to support large volumes and high bandwidth. We propose a scalable distributed continuous media file system built using autonomous disks. Autonomous disks are attached directly to the network and are able to perform lightweight processing. We discuss different ways to realize the autonomous disk, and describe a prototype implementation on a Linux platform using PC-based hardware. We present the basic requirements of the continuous media file system and present the design methodology and a prototype Linux-based implementation of the distributed file system that supports the requirements. We present experimental results on the performance of the proposed file system prototyped using autonomous disks. We show that the performance of the file system scales linearly with the number of disks and the number of clients. The file system performs much superior to NFS running on the same hardware platform and can deliver higher raw disk bandwidth to the applications. We also present bandwidth and time sensitive read/write procedures for the file system and show that the file system can provide strict bandwidth guarantees for continuous media streams.

[1]  Christoforos E. Kozyrakis,et al.  A case for intelligent RAM , 1997, IEEE Micro.

[2]  Chandramohan A. Thekkath,et al.  Frangipani: a scalable distributed file system , 1997, SOSP.

[3]  P. Venkat Rangan,et al.  Multimedia Storage Servers: A Tutorial , 1995, Computer.

[4]  Joel H. Saltz,et al.  Active disks: programming model, algorithms and evaluation , 1998, ASPLOS VIII.

[5]  Robert Magnus,et al.  Linux Kernel Internals , 1996 .

[6]  Banu Özden,et al.  Disk striping in video server environments , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[7]  Jim Zelenka,et al.  File server scaling with network-attached secure disks , 1997, SIGMETRICS '97.

[8]  Garth A. Gibson,et al.  Active Disks: Remote Execution for Network-Attached Storage (CMU-CS-97-198) , 1997 .

[9]  Jeanna Neefe Matthews,et al.  Serverless network file systems , 1996, TOCS.

[10]  Cyrus Shahabi,et al.  On configuring a single disk continuous media server , 1995, SIGMETRICS '95/PERFORMANCE '95.

[11]  Cuneyt Akinlar,et al.  Bandwidth guarantee in a distributed multimedia file system using network attached autonomous disks , 2000, Proceedings Sixth IEEE Real-Time Technology and Applications Symposium. RTAS 2000.

[12]  Prashant J. Shenoy,et al.  Symphony: an integrated multimedia file system , 1997, Electronic Imaging.

[13]  Krithi Ramamritham,et al.  Scheduling algorithms and operating systems support for real-time systems , 1994, Proc. IEEE.

[14]  Peter Triantafillou,et al.  Prefetching into smart-disk caches for high performance media servers , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Gerhard Weikum,et al.  Disk scheduling for mixed-media workloads in a multimedia server , 1998, MULTIMEDIA '98.

[16]  Grant Erickson,et al.  The Design and Performance of a Shared Disk File System for IRIX , 1998 .

[17]  David A. Patterson,et al.  A case for intelligent disks (IDISKs) , 1998, SGMD.

[18]  Christos Faloutsos,et al.  Overlay Striping and Optimal Parallel I/O for Modern Applications , 1998, Parallel Comput..

[19]  Douglas Comer,et al.  Internetworking with TCP/IP , 1988 .

[20]  Alan F. Benner.  Fibre Channel: Gigabit Communications and I/O for Computer Networks , 1995 .

[21]  Cuneyt Akinlar,et al.  A Scalable High-Bandwidth Distributed File System for Multimedia Applications , 1999 .

[22]  Ramesh Govindan,et al.  A file system for continuous media , 1992, TOCS.

[23]  David A. Goldberg,et al.  Design and Implementation of the Sun Network Filesystem , 1985, USENIX Conference Proceedings.

[24]  Garth A. Gibson,et al.  Filesystems for Network-Attached Secure Disks, , 1997 .

[25]  Garth A. Gibson,et al.  Understanding Customer Dissatisfaction with Underutilized Distributed File Servers (CMU-CS-96-158) , 1996 .