Scalability evaluation of the Yima streaming media architecture

Over the last decade research has been pursued on all aspects of streaming media. While many theoretical results have been reported in the literature, few performance results of large‐scale systems have been published. In this report we specifically explore the scalability aspects of our Yima streaming media architecture in an end‐to‐end test environment. With Yima, it was our goal to design and implement an architecture that would scale in performance from small to large systems. Some of the design features include (1) a multi‐node cluster architecture based on commodity hardware and custom software, (2) media type independence (support ranges from 500 Kb s$^{-1}$ MPEG‐4 to 45 Mb s$^{-1}$ HDTV, at both variable and constant bitrates), (3) fine‐grained online scale up/down capabilities, and (4) a client‐controlled rate smoothing protocol. We briefly discuss the design and implementation of these capabilities of Yima and then thoroughly evaluate its scalability through several sets of experiments. Our results show that Yima scales linearly (within the range of our test parameters) as a function of the cluster size and also as a function of available resources such as network bandwidth and CPU performance. Copyright © 2004 John Wiley & Sons, Ltd.

[1]  Cyrus Shahabi,et al.  AIMS: An Immersidata Management System , 2003, CIDR.

[2]  Alfred C. Weaver,et al.  On Retransmission-Based Error Control for Continuous Media Traffic in Packet-Switching Networks , 1996, Comput. Networks ISDN Syst..

[3]  Surajit Chaudhuri,et al.  On Scheduling Atomic and Composite Continuous Media Objects , 2002, IEEE Trans. Knowl. Data Eng..

[4]  Cyrus Shahabi,et al.  RMI system: Internet meets the future home theatre , 2004, IEEE MultiMedia.

[5]  Berthier A. Ribeiro-Neto,et al.  Comparing random data allocation and data striping in multimedia servers , 2000, SIGMETRICS '00.

[6]  Roger Zimmermann,et al.  Design of a Large Scale Data Stream Recorder , 2003, ICEIS.

[7]  Hong Zhu,et al.  Yima: Design and Evaluation of a Streaming Media System for Residential Broadband Services , 2001, Databases in Telecommunications.

[8]  Cyrus Shahabi,et al.  A multi-threshold online smoothing technique for variable rate multimedia streams , 2006, Multimedia Tools and Applications.

[9]  Jose Renato Santos,et al.  RIO: a real-time multimedia object server , 1997, PERV.

[10]  Shahram Ghandeharizadeh,et al.  Continuous display using heterogeneous disk-subsystems , 1997, MULTIMEDIA '97.

[11]  Roger Zimmermann,et al.  Retransmission-based error control for scalable streaming media systems , 2005, J. Electronic Imaging.

[12]  Bin Cong,et al.  Scalable Parallel Computing: Technology, Architecture, Programming , 1999, Scalable Comput. Pract. Exp..

[13]  Cyrus Shahabi,et al.  Yima: A Second-Generation Continuous Media Server , 2002, Computer.

[14]  Shahram Ghandeharizadeh,et al.  Staggered striping in multimedia information systems , 1994, SIGMOD '94.

[15]  Cyrus Shahabi,et al.  Immersidata Management: Challenges in Management of Data Generated within an Immersive Environment , 1999, Multimedia Information Systems.

[16]  Fouad A. Tobagi,et al.  Streaming RAID: a disk array management system for video files , 1993, MULTIMEDIA '93.

[17]  Ashish Goel,et al.  SCADDAR: an efficient randomized technique to reorganize continuous media blocks , 2002, Proceedings 18th International Conference on Data Engineering.

[18]  Shahram Ghandeharizadeh,et al.  On Minimizing Startup Latency in Scalable Continuous Media Servers ∗ , 1996 .

[19]  Shahram Ghandeharizadeh,et al.  Highly available and heterogeneous continuous media storage systems , 2004, IEEE Transactions on Multimedia.

[20]  Margo I. Seltzer,et al.  Disk Scheduling Revisited , 1990 .

[21]  Cyrus Shahabi,et al.  Super-Streaming: A New Object Delivery Paradigm for Continuous Media Servers , 2000, Multimedia Tools and Applications.

[22]  Shahram Ghandeharizadeh,et al.  HERA: Heterogeneous Extension of RAID , 2000, PDPTA.

[23]  Andrew Laursen,et al.  Oracle media server: providing consumer based interactive access to multimedia data , 1994, SIGMOD '94.

[24]  Shahram Ghandeharizadeh,et al.  Minimizing start-up latency in scalable continuous media servers , 1997, Electronic Imaging.

[25]  Hai Jin,et al.  Mitra: A Scalable Continuous Media Server , 2002 .

[26]  Rajeev Rastogi,et al.  The Fellini Multimedia Storage Server , 1996 .

[27]  David H. C. Du,et al.  Performance of a mass storage system for video-on-demand , 1995, Proceedings of INFOCOM'95.

[28]  Cyrus Shahabi,et al.  Retransmission-based error control in a many-to-many client-server environment , 2003, IS&T/SPIE Electronic Imaging.

[29]  Jose Renato Santos,et al.  Performance analysis of the RIO multimedia storage system with heterogeneous disk configurations , 1998, MULTIMEDIA '98.

[30]  F. Kashani,et al.  Decentralized Resource Management for a Distributed Continuous Media Server , 2002, IEEE Trans. Parallel Distributed Syst..

[31]  Michael B. Jones,et al.  The Tiger Video Fileserver , 1996 .