Building MEMS-based storage systems for streaming media

The performance of streaming media servers has been limited by the dual requirements of high disk throughput (to service more clients simultaneously) and low memory use (to decrease system cost). To achieve high disk throughput, disk drives must be accessed with large IOs to amortize disk access overhead. Large IOs imply an increased requirement of expensive DRAM, and, consequently, greater overall system cost. MEMS-based storage, an emerging storage technology, is predicted to offer a price-performance point between those of DRAM and disk drives. In this study, we propose storage architectures that use the relatively inexpensive MEMS-based storage devices as an intermediate layer (between DRAM and disk drives) for temporarily staging large disk IOs at a significantly lower cost. We present data layout mechanisms and synchronized IO scheduling algorithms for the real-time storage and retrieval of streaming data within such an augmented storage system. Analytical evaluation suggests that MEMS-augmented storage hierarchies can reduce the cost and improve the throughput of streaming servers significantly.

[1]  Cyrus Shahabi,et al.  On scheduling atomic and composite multimedia objects , 1995 .

[2]  Andrea C. Arpaci-Dusseau,et al.  Proceedings of the 2002 Usenix Annual Technical Conference Bridging the Information Gap in Storage Protocol Stacks , 2022 .

[3]  Divyakant Agrawal,et al.  Tabular Placement of Relational Data on MEMS-based Storage Devices , 2003, VLDB.

[4]  Alan Jay Smith,et al.  The performance impact of I/O optimizations and disk improvements , 2004, IBM J. Res. Dev..

[5]  Arif Merchant,et al.  Using MEMS-Based Storage in Disk Arrays , 2003, FAST.

[6]  Philip S. Yu,et al.  DASD dancing: a disk load balancing optimization scheme for video-on-demand computer systems , 1995, SIGMETRICS '95/PERFORMANCE '95.

[7]  Erik Riedel,et al.  More Than an Interface - SCSI vs. ATA , 2003, FAST.

[8]  Bo Hong,et al.  Using MEMS-based storage in computer systems---device modeling and management , 2006, TOS.

[9]  Gerald W. Neufeld,et al.  An evaluation of VBR disk admission algorithms for continuous media file servers , 1997, MULTIMEDIA '97.

[10]  Gregory R. Ganger,et al.  MEMS-based Storage Devices and Standard Disk Interfaces: A Square Peg in a Round Hole? , 2004, FAST.

[11]  Bin Liu,et al.  Stream combination: adaptive IO scheduling for streaming servers , 2006, SIGBED.

[12]  H.M. Vin,et al.  Designing an on-demand multimedia service , 1992, IEEE Communications Magazine.

[13]  Ragunathan Rajkumar,et al.  Real-time filesystems. Guaranteeing timing constraints for disk accesses in RT-Mach , 1997, Proceedings Real-Time Systems Symposium.

[14]  Anastasia Ailamaki,et al.  Atropos: A Disk Array Volume Manager for Orchestrated Use of Disks , 2004, FAST.

[15]  D. A. Thompson,et al.  The Future of Magnetic Data Storage Technology , 2000 .

[16]  Zoran Dimitrijevic,et al.  Quality of Service Support for Real-time Storage Systems , 2003 .

[17]  J. Griffin,et al.  Designing computer systems with MEMS-based storage , 2000, SIGP.

[18]  Edward Y. Chang,et al.  MEMS-based disk buffer for streaming media servers , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[19]  Ann L. Chervenak,et al.  Tertiary Storage: An Evaluation of New Applications , 1994 .

[20]  Edward Y. Chang,et al.  Effective Memory Use in a Media Server , 1997, VLDB.

[21]  Abraham Silberschatz,et al.  Random I/O scheduling in online tertiary storage systems , 1996, SIGMOD '96.

[22]  Divyakant Agrawal,et al.  Declustering Two-Dimensional Datasets over MEMS-Based Storage , 2004, EDBT.

[23]  Dürig,et al.  The “ Millipede ” — More than one thousand tips for future AFM data storage , 2000 .

[24]  Babak Hamidzadeh,et al.  Dynamic real-time scheduling strategies for interactive continuous media servers , 1999, Multimedia Systems.

[25]  Jay K. Strosnider,et al.  Disk scheduling for multimedia data streams , 1994, Electronic Imaging.

[26]  Ute Drechsler,et al.  The "Millipede"-More than thousand tips for future AFM storage , 2000, IBM J. Res. Dev..

[27]  Edward Grochowski,et al.  Technological impact of magnetic hard disk drives on storage systems , 2003, IBM Syst. J..

[28]  Edward Y. Chang,et al.  Design and Implementation of Semi-preemptible IO , 2003, FAST.

[29]  Surajit Chaudhuri,et al.  On Scheduling Atomic and Composite Continuous Media Objects , 2002, IEEE Trans. Knowl. Data Eng..

[30]  Arif Merchant,et al.  Awarded Best Paper! - Using MEMS-Based Storage in Disk Arrays , 2003 .

[31]  Bo Hong,et al.  Using MEMS-based storage in computer systems---MEMS storage architectures , 2006, TOS.

[32]  L. Richard Carley,et al.  MEMS-based integrated-circuit mass-storage systems , 2000, CACM.

[33]  Berthier A. Ribeiro-Neto,et al.  Comparing random data allocation and data striping in multimedia servers , 2000, SIGMETRICS '00.

[34]  Randy H. Katz,et al.  Choosing the best storage system for video service , 1995, MULTIMEDIA '95.