Efficient algorithms of video replication and placement on a cluster of streaming servers

A cost-effective approach to building up scalable video streaming servers is to couple a number of streaming servers together in a cluster so as to alleviate the inherent storage and networking constraints of streaming services. In this article, we investigate a crucial problem of video replication and placement on a distributed storage cluster of streaming servers for high quality and high availability services. We formulate it as a combinatorial optimization problem with objectives of maximizing the encoding bit rate and the number of replicas of each video and balancing the workload of the servers. The objectives are subject to the constraints of the storage capacity and the outgoing network-I/O bandwidth of the servers. Under the assumption of single fixed encoding bit rate for all video objects with different popularity values, we give an optimal replication algorithm and a bounded placement algorithm, respectively. We further present an efficient replication algorithm that utilizes the Zipf-like video popularity distributions to approximate the optimal solutions, which can reduce the complexity of the optimal replication algorithm. For video objects with scalable encoding bit rates, we propose a heuristic algorithm based on simulated annealing. We conduct a comprehensive performance evaluation of the algorithms and demonstrate their effectiveness via simulations over a synthetic workload set.

[1]  Asit Dan,et al.  An online video placement policy based on bandwidth to space ratio (BSR) , 1995, SIGMOD '95.

[2]  Ernst W. Biersack,et al.  Modeling and Performance Comparison of Reliability Strategies for Distributed Video Servers , 2000, IEEE Trans. Parallel Distributed Syst..

[3]  Kien A. Hua,et al.  Skyscraper broadcasting: a new broadcasting scheme for metropolitan video-on-demand systems , 1997, SIGCOMM '97.

[4]  Philip S. Yu,et al.  The Maximum Factor Queue Length Batching Scheme for Video-on-Demand Systems , 2001, IEEE Trans. Computers.

[5]  Jack Y. B. Lee,et al.  Performance Analysis of a Pull-Based Parallel Video Server , 2000, IEEE Trans. Parallel Distributed Syst..

[6]  Asit Dan,et al.  Multimedia Caching Strategies for Heterogeneous Application and Server Environments , 2004, Multimedia Tools and Applications.

[7]  John C. S. Lui,et al.  Bounding of Performance Measures for Threshold-Based Queuing Systems: Theory and Application to Dynamic Resource Management in Video-on-Demand Servers , 2002, IEEE Trans. Computers.

[8]  Zhi-Li Zhang,et al.  Video staging: a proxy-server-based approach to end-to-end video delivery over wide-area networks , 2000, TNET.

[9]  Bo Li,et al.  An end-to-end adaptation protocol for layered video multicast using optimal rate allocation , 2004, IEEE Transactions on Multimedia.

[10]  Jonathan C. L. Liu,et al.  Guest Editors' Introduction: Continuous Media on Demand , 2001, Computer.

[11]  Richard R. Muntz,et al.  Design of Fault-Tolerant Large-Scale VOD Servers: With Emphasis on High-Performance and Low-Cost , 2001, IEEE Trans. Parallel Distributed Syst..

[12]  Prashant J. Shenoy,et al.  Symphony: an integrated multimedia file system , 1997, Electronic Imaging.

[13]  F. Kashani,et al.  Decentralized Resource Management for a Distributed Continuous Media Server , 2002, IEEE Trans. Parallel Distributed Syst..

[14]  Michael B. Jones,et al.  The Tiger Video Fileserver , 1996 .

[15]  Athina Markopoulou,et al.  Service Differentiation in the Internet to Support Multimedia Traffic , 2001, IWDC.

[16]  Mary K. Vernon,et al.  Minimizing Bandwidth Requirements for On-Demand Data Delivery , 2001, IEEE Trans. Knowl. Data Eng..

[17]  Wu-chi Feng,et al.  Proactive buffer management for the streamed delivery of stored video , 1998, MULTIMEDIA '98.

[18]  Philip S. Yu,et al.  Disk load balancing for video-on-demand systems , 1997, Multimedia Systems.

[19]  Tomasz Imielinski,et al.  Metropolitan area video-on-demand service using pyramid broadcasting , 1996, Multimedia Systems.

[20]  Ashish Goel,et al.  Stochastic load balancing and related problems , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[21]  Cheng-Zhong Xu,et al.  Request redirection and data layout for network traffic balancing in cluster-based video-on-demand s , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[22]  Xiaobo Zhou,et al.  Solving a media mapping problem in a hierarchical server network with parallel simulated annealing , 2000, Proceedings 2000 International Conference on Parallel Processing.

[23]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[24]  Nalini Venkatasubramanian,et al.  Load management in distributed video servers , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[25]  Cheng-Zhong Xu,et al.  Harmonic proportional bandwidth allocation and scheduling for service differentiation on streaming servers , 2004, IEEE Transactions on Parallel and Distributed Systems.

[26]  John C. S. Lui,et al.  Striping doesn't scale: how to achieve scalability for continuous media servers with replication , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[27]  Farnoush Banaei Kashani,et al.  Decentralized Resource Management for a Distributed Continuous Media Server , 2002, IEEE Trans. Parallel Distributed Syst..

[28]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[29]  Randy H. Katz,et al.  Choosing the best storage system for video service , 1995, MULTIMEDIA '95.

[30]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[31]  Lawrence W. Dowdy,et al.  Comparative Models of the File Assignment Problem , 1982, CSUR.

[32]  Berthier A. Ribeiro-Neto,et al.  Comparing random data allocation and data striping in multimedia servers , 2000, SIGMETRICS '00.

[33]  Jeffrey Scott Vitter,et al.  Lexicographically optimal smoothing for broadband traffic multiplexing , 2002, PODC '02.