Online architecture for predicting live video transcoding resources

End users stream video increasingly from live broadcasters (via YouTube Live, Twitch etc.). Adaptive live video streaming is realised by transcoding different representations of the original video content. Management of transcoding resources creates costs for the service provider, because transcoding is a CPU-intensive task. Additionally, the content must be transcoded within real time with the transcoding resources in order to provide satisfying Quality of Service. The contribution of this paper is validation of an online architecture for enabling live video transcoding with Docker in a Kubernetes-based cloud environment. Particularly, online cloud resource allocation has been focused on by executing experiments in several configurations. The results indicate that Random Forest regressor provided the best overall performance in terms of precision regarding transcoding speed and CPU consumption on resources, and the amount of realised transcoding tasks. Reinforcement Learning provided lower performance, and required more effort in terms of training.

[1]  Magdy A. Bayoumi,et al.  Cost Efficient Repository Management for Cloud-Based On-demand Video Streaming , 2017, 2017 5th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud).

[2]  Omer F. Rana,et al.  Client-Side Scheduling Based on Application Characterization on Kubernetes , 2017, GECON.

[3]  René Peinl,et al.  Docker Cluster Management for the Cloud - Survey Results and Own Solution , 2016, Journal of Grid Computing.

[4]  Jean-Michel Poggi,et al.  Random Forests for Big Data , 2015, Big Data Res..

[5]  Yonggang Wen,et al.  Morph: A Fast and Scalable Cloud Transcoding System , 2016, ACM Multimedia.

[6]  Pekka Pääkkönen,et al.  Architecture for Predicting Live Video Transcoding Performance on Docker Containers , 2018, 2018 IEEE International Conference on Services Computing (SCC).

[7]  Daniel Pakkala,et al.  Reference Architecture and Classification of Technologies, Products and Services for Big Data Systems , 2015, Big Data Res..

[8]  Gwendal Simon,et al.  DASH in Twitch: Adaptive Bitrate Streaming in Live Game Streaming Platforms , 2014, VideoNext '14.

[9]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[10]  Gordon S. Blair,et al.  Daleel: Simplifying cloud instance selection using machine learning , 2016, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium.

[11]  Yonggang Wen,et al.  Resource Provisioning and Profit Maximization for Transcoding in Clouds: A Two-Timescale Approach , 2017, IEEE Transactions on Multimedia.

[12]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[13]  Lenz Belzner,et al.  Optimization of global production scheduling with deep reinforcement learning , 2018 .

[14]  Tarik Taleb,et al.  Performance benchmark of transcoding as a virtual network function in CDN as a service slicing , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[15]  Antanas Verikas,et al.  Mining data with random forests: A survey and results of new tests , 2011, Pattern Recognit..

[16]  Mou Ling Dennis Wong,et al.  Distributed video transcoding on a heterogeneous computing platform , 2016, 2016 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).

[17]  Yonggang Wen,et al.  Dynamic Priority-Based Resource Provisioning for Video Transcoding With Heterogeneous QoS , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Yves Lemieux,et al.  QoS Assurance with Light Virtualization - A Survey , 2016, 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[19]  Bingsheng He,et al.  QoS-Aware Resource Allocation for Video Transcoding in Clouds , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Eric A. Brewer,et al.  Borg, Omega, and Kubernetes , 2016, ACM Queue.

[21]  Rajkumar Buyya,et al.  Cost-Efficient and Robust On-Demand Video Transcoding Using Heterogeneous Cloud Services , 2018, IEEE Transactions on Parallel and Distributed Systems.

[22]  Magdy A. Bayoumi,et al.  VLSC: Video Live Streaming Using Cloud Services , 2016, 2016 IEEE International Conferences on Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom) (BDCloud-SocialCom-SustainCom).

[23]  Anil A. Bharath,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[24]  Alberto Blanc,et al.  Transcoding live adaptive video streams at a massive scale in the cloud , 2015, MMSys.

[25]  Parthasarathy Ranganathan,et al.  vbench: Benchmarking Video Transcoding in the Cloud , 2018, ASPLOS.

[26]  Sunilkumar S. Manvi,et al.  Virtual resource prediction in cloud environment: A Bayesian approach , 2016, J. Netw. Comput. Appl..

[27]  Waheed Iqbal,et al.  Adaptive resource provisioning for read intensive multi-tier applications in the cloud , 2011, Future Gener. Comput. Syst..

[28]  Hong-Yi Chang,et al.  Complexity of cloud-based transcoding platform for scalable and effective video streaming services , 2016, Multimedia Tools and Applications.

[29]  Tarik Taleb,et al.  On-the-Fly QoE-Aware Transcoding in the Mobile Edge , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[30]  Zhenhuan Gong,et al.  PRESS: PRedictive Elastic ReSource Scaling for cloud systems , 2010, 2010 International Conference on Network and Service Management.

[31]  David Atienza,et al.  MAMUT: Multi-Agent Reinforcement Learning for Efficient Real-Time Multi-User Video Transcoding , 2019, 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[32]  Tarik Taleb,et al.  QoE-aware elasticity support in cloud-native 5G systems , 2016, 2016 IEEE International Conference on Communications (ICC).