Cost-Efficient and Robust On-Demand Video Transcoding Using Heterogeneous Cloud Services

Video streams, either in the form of Video On-Demand (VOD) or live streaming, usually have to be converted (i.e., transcoded) to match the characteristics of viewers’ devices (e.g., in terms of spatial resolution or supported formats). Transcoding is a computationally expensive and time-consuming operation. Therefore, streaming service providers have to store numerous transcoded versions of a given video to serve various display devices. With the sharp increase in video streaming, however, this approach is becoming cost-prohibitive. Given the fact that viewers’ access pattern to video streams follows a long tail distribution, for the video streams with low access rate, we propose to transcode them in an on-demand (i.e., lazy) manner using cloud computing services. The challenge in utilizing cloud services for on-demand video transcoding, however, is to maintain a robust QoS for viewers and cost-efficiency for streaming service providers. To address this challenge, in this paper, we present the Cloud-based Video Streaming Services (CVS2) architecture. It includes a QoS-aware scheduling component that maps transcoding tasks to the Virtual Machines (VMs) by considering the affinity of the transcoding tasks with the allocated heterogeneous VMs. To maintain robustness in the presence of varying streaming requests, the architecture includes a cost-efficient VM Provisioner component. The component provides a self-configurable cluster of heterogeneous VMs. The cluster is reconfigured dynamically to maintain the maximum affinity with the arriving workload. Simulation results obtained under diverse workload conditions demonstrate that CVS2 architecture can maintain a robust QoS for viewers while reducing the incurred cost of the streaming service provider by up to 85 percent.

[1]  Magdy A. Bayoumi,et al.  High-speed Motion Estimation Architecture for Real-time Video Transmission , 2012, Comput. J..

[2]  Manish Parashar,et al.  Enabling on-demand science via cloud computing , 2014, IEEE Cloud Computing.

[3]  Peter Fedor,et al.  A tribute to Claude Shannon (1916-2001) and a plea for more rigorous use of species richness, species diversity and the 'Shannon-Wiener' Index , 2003 .

[4]  Eduardo Peixoto,et al.  MPEG-2 to HEVC Video Transcoding With Content-Based Modeling , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Anthony A. Maciejewski,et al.  Stochastic-Based Robust Dynamic Resource Allocation in a Heterogeneous Computing System , 2009, 2009 International Conference on Parallel Processing.

[6]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[7]  Qinghua Zheng,et al.  A version-aware computation and storage trade-off strategy for multi-version VoD systems in the cloud , 2015, 2015 IEEE Symposium on Computers and Communication (ISCC).

[8]  Chen-Hsiu Huang Video Transcoding Architectures and Techniques : An Overview , 2003 .

[9]  Gregory A. Koenig,et al.  Utility Functions and Resource Management in an Oversubscribed Heterogeneous Computing Environment , 2015, IEEE Transactions on Computers.

[10]  J. Lilius,et al.  Stream-Based Admission Control and Scheduling for Video Transcoding in Cloud Computing , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[11]  Sébastien Lafond,et al.  Analysis of video segmentation for spatial resolution reduction video transcoding , 2011, 2011 International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS).

[12]  Rajkumar Buyya,et al.  CVSS: A Cost-Efficient and QoS-Aware Video Streaming Using Cloud Services , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[13]  Sébastien Lafond,et al.  A Computation and Storage Trade-off Strategy for Cost-Efficient Video Transcoding in the Cloud , 2013, 2013 39th Euromicro Conference on Software Engineering and Advanced Applications.

[14]  Anthony A. Maciejewski,et al.  Maximizing stochastic robustness of static resource allocations in a periodic sensor driven cluster , 2014, Future Gener. Comput. Syst..

[15]  Charilaos Christopoulos,et al.  Transcoder architectures for video coding , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  Jiangchuan Liu,et al.  Understanding the Characteristics of Internet Short Video Sharing: A YouTube-Based Measurement Study , 2013, IEEE Transactions on Multimedia.

[17]  Magdy A. Bayoumi,et al.  High Performance On-demand Video Transcoding Using Cloud Services , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[18]  José Antonio Lozano,et al.  A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments , 2014, Journal of Grid Computing.

[19]  Anthony A. Maciejewski,et al.  Stochastic-based robust dynamic resource allocation for independent tasks in a heterogeneous computing system , 2016, J. Parallel Distributed Comput..

[20]  Oliver Werner,et al.  Requantization for transcoding of MPEG-2 intraframes , 1999, IEEE Trans. Image Process..

[21]  J. Famaey,et al.  Content Delivery Networks , 2012 .

[22]  Anthony A. Maciejewski,et al.  Characterizing heterogeneous computing environments using singular value decomposition , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[23]  Xinfeng Zhang,et al.  Parallelizing video transcoding with load balancing on cloud computing , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[24]  Sébastien Lafond,et al.  Prediction-Based Dynamic Resource Allocation for Video Transcoding in Cloud Computing , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[25]  Anthony A. Maciejewski,et al.  Dynamically mapping tasks with priorities and multiple deadlines in a heterogeneous environment , 2007, J. Parallel Distributed Comput..

[26]  Yu Sun,et al.  Video transcoding: an overview of various techniques and research issues , 2005, IEEE Transactions on Multimedia.

[27]  Anthony A. Maciejewski,et al.  Stochastic robustness metric and its use for static resource allocations , 2008, J. Parallel Distributed Comput..

[28]  Rizos Sakellariou,et al.  Adaptive resource configuration for Cloud infrastructure management , 2013, Future Gener. Comput. Syst..

[29]  Alexandru Iosup,et al.  A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing , 2009, CloudComp.

[30]  Frédéric Desprez,et al.  Image Transfer and Storage Cost Aware Brokering Strategies for Multiple Clouds , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[31]  Viktor K. Prasanna,et al.  Efficient collective communication in distributed heterogeneous systems , 2003, J. Parallel Distributed Comput..

[32]  Rajkumar Buyya,et al.  Content Delivery Networks , 2008 .

[33]  Myoungjin Kim,et al.  Towards Efficient Design and Implementation of a Hadoop-based Distributed Video Transcoding System in Cloud Computing Environment , 2013 .

[34]  Anthony A. Maciejewski,et al.  Heuristics for Robust Resource Allocation of Satellite Weather Data Processing on a Heterogeneous Parallel System , 2011, IEEE Transactions on Parallel and Distributed Systems.