Comparing random data allocation and data striping in multimedia servers

We compare performance of a multimedia storage server based on a random data allocation layout and block replication with traditional data striping techniques. Data striping techniques in multimedia servers are often designed for restricted workloads, e.g. sequential access patterns with CBR (constant bit rate) requirements. On the other hand, a system based on random data allocation can support virtually any type of multimedia application, including VBR (variable bit rate) video or audio, and interactive applications with unpredictable access patterns, such as 3D interactive virtual worlds, interactive scientific visualizations, etc. Surprisingly, our results show that system performance with random data allocation is competitive and sometimes even outperforms traditional data striping techniques, for the workloads for which data striping is designed to work best; i.e. streams with sequential access patterns and CBR requirements. Due to its superiority in supporting general workloads and competitive system performance, we believe that random data allocation will be the scheme of choice for next generation multimedia servers.

[1]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[2]  Margo I. Seltzer,et al.  Disk Scheduling Revisited , 1990 .

[3]  G. Parmigiani.  Large Deviation Techniques in Decision, Simulation and Estimation , 1992 .

[4]  Carlo H. Séquin,et al.  Management of large amounts of data in interactive building walkthroughs , 1992, I3D '92.

[5]  Randy H. Katz,et al.  Multi-resolution video representation for parallel disk arrays , 1993, MULTIMEDIA '93.

[6]  Shahram Ghandeharizadeh,et al.  Staggered striping in multimedia information systems , 1994, SIGMOD '94.

[7]  John Wilkes,et al.  An introduction to disk drive modeling , 1994, Computer.

[8]  Eli Upfal,et al.  Balanced allocations (extended abstract) , 1994, STOC '94.

[9]  Choosing the best storage system for video service , 1995, MULTIMEDIA '95.

[10]  Yale N. Patt,et al.  On-line extraction of SCSI disk drive parameters , 1995, SIGMETRICS '95/PERFORMANCE '95.

[11]  Michael B. Jones,et al.  The Tiger Video Fileserver , 1996 .

[12]  Edward W. Knightly,et al.  H-BIND: a new approach to providing statistical performance guarantees to VBR traffic , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[13]  Edward Y. Chang,et al.  Cost Analyses for VBR Video Servers , 1996, IEEE Multim..

[14]  Harrick M. Vin,et al.  Design and performance tradeoffs in clustered video servers , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[15]  Robin Liggett,et al.  Virtual Modeling of Urban Environments , 1996, Presence: Teleoperators & Virtual Environments.

[16]  Richard R. Muntz,et al.  Randomized data allocation for real-time disk I/O , 1996, COMPCON '96. Technologies for the Information Superhighway Digest of Papers.

[17]  E. Grochowski,et al.  Future trends in hard disk drives , 1996 .

[18]  Banu Özden,et al.  Disk striping in video server environments , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[19]  Edward Y. Chang,et al.  Effective Memory Use in a Media Server , 1997, VLDB.

[20]  Yitzhak Birk.  Random RAIDs with selective exploitation of redundancy for high performance video servers , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).

[21]  Harrick M. Vin,et al.  Efficient striping techniques for multimedia file servers , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).

[22]  Jan H. M. Korst.  Random duplicated assignment: an alternative to striping in video servers , 1997, MULTIMEDIA '97.

[23]  Goetz Graefe,et al.  The five-minute rule ten years later, and other computer storage rules of thumb , 1997, SGMD.

[24]  R. Muntz,et al.  An Implicitly Scalable, Fully Interactive Multimedia Storage Server , 1998, Proceedings. 2nd International Workshop on Distributed Interactive Simulation and Real-Time Applications (Cat. No.98EX191).

[25]  Jose Renato Santos,et al.  An implicitly scalable, fully interactive multimedia storage server , 1998, Proceedings. 2nd International Workshop on Distributed Interactive Simulation and Real-Time Applications (Cat. No.98EX191).

[26]  Jose Renato Santos,et al.  Performance analysis of the RIO multimedia storage system with heterogeneous disk configurations , 1998, MULTIMEDIA '98.

[27]  R. Muntz,et al.  Design of a fault tolerant real-time storage system for multimedia applications , 1998, Proceedings. IEEE International Computer Performance and Dependability Symposium. IPDS'98 (Cat. No.98TB100248).

[28]  Jose Renato Santos.  Rio: a universal multimedia storage system based on random data allocation and block replication , 1998 .

[29]  Jose Renato Santos,et al.  A parallel disk storage system for real-time multimedia applications , 1998, Int. J. Intell. Syst..

[30]  Eli Upfal,et al.  Balanced Allocations , 1999, SIAM J. Comput..

[31]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[32]  P. Venkat Rangan,et al.  Multimedia Storage Servers: A Tutorial , 1995, Computer.

[33]  Hai Jin,et al.  Mitra: A Scalable Continuous Media Server , 2002 .