Optimal video replication and placement on a cluster of video-on-demand servers

A cost-effective approach to building up scalable video-on-demand (VoD) servers is to couple a number of VoD servers together in a cluster. In this article, we study a crucial video replication and placement problem in a distributed storage VoD cluster for high quality and high availability services. We formulate it as a combinatorial optimization problem with objectives of maximizing the encoding bit rate and the number of replicas of each video and balancing the workload of the servers. It is subject to the constraints of the storage capacity and the outgoing network bandwidth of the servers. Under the assumption of single fixed encoding bit rate for all videos, we give an optimal replication algorithm and a bounded-placement algorithm for videos with different popularities. To reduce the complexity of the replication algorithm, we present an efficient algorithm that utilizes the Zipf-like video popularity distributions to approximate the optimal solution. For videos with scalable encoding bit rates, we propose a heuristic algorithm based on simulated annealing. We conduct a comprehensive performance evaluation of the algorithms and demonstrate their effectiveness via simulations over a synthetic workload set.

[1]  Xiaobo Zhou,et al.  Solving a media mapping problem in a hierarchical server network with parallel simulated annealing , 2000, Proceedings 2000 International Conference on Parallel Processing.

[2]  Richard R. Muntz,et al.  Design of Fault-Tolerant Large-Scale VOD Servers: With Emphasis on High-Performance and Low-Cost , 2001, IEEE Trans. Parallel Distributed Syst..

[3]  Prashant J. Shenoy,et al.  Symphony: an integrated multimedia file system , 1997, Electronic Imaging.

[4]  R. Sarnath,et al.  Proceedings of the International Conference on Parallel Processing , 1992 .

[5]  Randy H. Katz,et al.  Choosing the best storage system for video service , 1995, MULTIMEDIA '95.

[6]  Cheng-Zhong Xu,et al.  Request redirection and data layout for network traffic balancing in cluster-based video-on-demand s , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[7]  Fouad A. Tobagi,et al.  Streaming RAID: a disk array management system for video files , 1993, MULTIMEDIA '93.

[8]  Mary K. Vernon,et al.  Minimizing Bandwidth Requirements for On-Demand Data Delivery , 2001, IEEE Trans. Knowl. Data Eng..

[9]  Philip S. Yu,et al.  The Maximum Factor Queue Length Batching Scheme for Video-on-Demand Systems , 2001, IEEE Trans. Computers.

[10]  Jack Y. B. Lee,et al.  Performance Analysis of a Pull-Based Parallel Video Server , 2000, IEEE Trans. Parallel Distributed Syst..

[11]  Wu-chi Feng,et al.  Proactive buffer management for the streamed delivery of stored video , 1998, MULTIMEDIA '98.

[12]  Philip S. Yu,et al.  Disk load balancing for video-on-demand systems , 1997, Multimedia Systems.

[13]  John C. S. Lui,et al.  Striping doesn't scale: how to achieve scalability for continuous media servers with replication , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[14]  Michael B. Jones,et al.  The Tiger Video Fileserver , 1996 .

[15]  Nalini Venkatasubramanian,et al.  Load management in distributed video servers , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[16]  Lawrence W. Dowdy,et al.  Comparative Models of the File Assignment Problem , 1982, CSUR.

[17]  Asit Dan,et al.  An online video placement policy based on bandwidth to space ratio (BSR) , 1995, SIGMOD '95.

[18]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[19]  Ernst W. Biersack,et al.  Modeling and Performance Comparison of Reliability Strategies for Distributed Video Servers , 2000, IEEE Trans. Parallel Distributed Syst..