Transcoding live adaptive video streams at a massive scale in the cloud

More and more users are watching online videos produced by non-professional sources (e.g., gamers, teachers of online courses, witnesses of public events) by using an increasingly diverse set of devices to access the videos (e.g., smartphones, tablets, HDTV). Live streaming service providers can combine adaptive streaming technologies and cloud computing to satisfy this demand. In this paper, we study the problem of preparing live video streams for delivery using cloud computing infrastructure, e.g., how many representations to use and the corresponding parameters (resolution and bit-rate). We present an integer linear program (ILP) to maximize the average user quality of experience (QoE) and a heuristic algorithm that can scale to large number of videos and users. We also introduce two new datasets: one characterizing a popular live streaming provider (Twitch) and another characterizing the computing resources needed to transcode a video. They are used to set up realistic test scenarios. We compare the performance of the optimal ILP solution with current industry standards, showing that the latter are sub-optimal. The solution of the ILP also shows the importance of the type of video on the optimal streaming preparation. By taking advantage of this, the proposed heuristic can efficiently satisfy a time varying demand with an almost constant amount of computing resources.

[1]  Micah Adler,et al.  Algorithms for optimizing the bandwidth cost of content delivery , 2011, Comput. Networks.

[2]  Laxmi N. Bhuyan,et al.  Load Balancing in a Cluster-Based Web Server for Multimedia Applications , 2006, IEEE Transactions on Parallel and Distributed Systems.

[3]  Chao Mei,et al.  CloudStream: Delivering high-quality streaming videos through a cloud-based SVC proxy , 2011, 2011 Proceedings IEEE INFOCOM.

[4]  Carlos Reano Gonzalez,et al.  CU2rCU: A CUDA-to-rCUDA Converter , 2013 .

[5]  Gwendal Simon,et al.  Optimal Delivery of Rate-Adaptive Streams in Underprovisioned Networks , 2014, IEEE Journal on Selected Areas in Communications.

[6]  Simone Basso,et al.  Measuring DASH streaming performance from the end users perspective using neubot , 2014, MMSys '14.

[7]  Xinggong Zhang,et al.  Parallelizing video transcoding using Map-Reduce-based cloud computing , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[8]  Yongquan Chen,et al.  A Cloud-Based Transcoding Framework for Real-Time Mobile Video Conferencing System , 2014, 2014 2nd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering.

[9]  Xinfeng Zhang,et al.  Parallelizing video transcoding with load balancing on cloud computing , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[10]  Alberto Blanc,et al.  Optimal set of video representations in adaptive streaming , 2014, MMSys '14.

[11]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Wesley De Neve,et al.  Full-Reference Video Quality Metric for Fully Scalable and Mobile SVC Content , 2010, IEEE Transactions on Broadcasting.

[13]  Gwendal Simon,et al.  DASH in Twitch: Adaptive Bitrate Streaming in Live Game Streaming Platforms , 2014, VideoNext '14.

[14]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Second Edition , 2013, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Second Edition.

[15]  Lifeng Sun,et al.  Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[16]  Sébastien Lafond,et al.  Prediction-Based Dynamic Resource Allocation for Video Transcoding in Cloud Computing , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[17]  Cyril Concolato,et al.  Overhead and performance of low latency live streaming using MPEG-DASH , 2014, IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications.

[18]  Jianfei Cai,et al.  Complexity-rate-distortion evaluation of video encoding for cloud media computing , 2011, 2011 17th IEEE International Conference on Networks.

[19]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[20]  Wen Gao,et al.  Complexity-Constrained H.264 Video Encoding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Ryan Shea,et al.  On GPU pass-through performance for cloud gaming: Experiments and analysis , 2013, 2013 12th Annual Workshop on Network and Systems Support for Games (NetGames).