Grad: Learning for Overhead-aware Adaptive Video Streaming with Scalable Video Coding

Video streaming commonly uses Dynamic Adaptive Streaming over HTTP (DASH) to deliver good Quality of Experience (QoE) to users. Videos used in DASH are predominantly encoded by single-layered video coding such as H.264/AVC. In comparison, multi-layered video coding such as H.264/SVC provides more flexibility for upgrading the quality of buffered video segments and has the potential to further improve QoE. However, there are two challenges for using SVC in DASH: (i) the complexity in designing ABR algorithms; and (ii) the negative impact of SVC's coding overhead. In this work, we propose a deep reinforcement learning method called Grad for designing ABR algorithms that take advantage of the quality upgrade mechanism of SVC. Additionally, we quantify the impact of coding overhead on the achievable QoE of SVC in DASH, and propose jump-enabled hybrid coding (HYBJ) to mitigate the impact. Through emulation, we demonstrate that Grad-HYBJ, an ABR algorithm for HYBJ learned by Grad, outperforms the best performing state-of-the-art ABR algorithm by 17% in QoE.

[1]  Daniel Zappala,et al.  Quality selection for Dynamic Adaptive Streaming over HTTP with Scalable Video Coding , 2012, MMSys '12.

[2]  Hari Balakrishnan,et al.  Mahimahi: a lightweight toolkit for reproducible web measurement , 2015, SIGCOMM.

[3]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[4]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Vaneet Aggarwal,et al.  LBP: Robust Rate Adaptation Algorithm for SVC Video Streaming , 2018, IEEE/ACM Transactions on Networking.

[6]  Müge Sayit,et al.  Rate adaptation algorithm with backward quality increasing property for SVC-DASH , 2017, 2017 IEEE 7th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[7]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[8]  Filip De Turck,et al.  Minimizing the impact of delay on live SVC-based HTTP adaptive streaming services , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[9]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[10]  Christian Timmerer,et al.  Evaluation of hybrid Scalable Video Coding for HTTP-based adaptive media streaming with high-definition content , 2013, IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[11]  Xiapu Luo,et al.  QDASH: a QoE-aware DASH system , 2012, MMSys '12.

[12]  S. Rimac-Drlje,et al.  Overview of the Scalable Video Coding Extension of the H . 264 / AVC Standard , 2010 .

[13]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[14]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[15]  Mahbub Hassan,et al.  Comprehensive mobile bandwidth traces from vehicular networks , 2016, MMSys.

[16]  Chuck Yoo,et al.  Eliminating bandwidth estimation from adaptive video streaming in wireless networks , 2016, Signal Process. Image Commun..

[17]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[18]  Afshin Taghavi Nasrabadi,et al.  Layer-Assisted Adaptive Video Streaming , 2018, NOSSDAV.

[19]  Federico Chiariotti,et al.  Online learning adaptation strategy for DASH clients , 2016, MMSys.

[20]  Afshin Taghavi Nasrabadi,et al.  Adaptive 360-Degree Video Streaming using Scalable Video Coding , 2017, ACM Multimedia.

[21]  Phuoc Tran-Gia,et al.  Implementation and user-centric comparison of a novel adaptation logic for DASH with SVC , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[22]  Hermann Hellwagner,et al.  A scalable video coding dataset and toolchain for dynamic adaptive streaming over HTTP , 2015, MMSys.

[23]  Filip De Turck,et al.  Design and optimisation of a (FA)Q-learning-based HTTP adaptive streaming client , 2014, Connect. Sci..

[24]  Ahmed H. Zahran,et al.  Beyond throughput: a 4G LTE dataset with channel and context metrics , 2018, MMSys.

[25]  Carsten Griwodz,et al.  Commute path bandwidth traces from 3G networks: analysis and applications , 2013, MMSys.

[26]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[27]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[28]  Ragnhild Eg,et al.  Flicker effects in adaptive video streaming to handheld devices , 2011, ACM Multimedia.

[29]  Bruno Ribeiro,et al.  Oboe: auto-tuning video ABR algorithms to network conditions , 2018, SIGCOMM.

[30]  Jianping Pan,et al.  Dynamic rate adaptation for adaptive video streaming in wireless networks , 2015, Signal Process. Image Commun..

[31]  Ramesh K. Sitaraman,et al.  From theory to practice: improving bitrate adaptation in the DASH reference player , 2018, MMSys.

[32]  Filip De Turck,et al.  Design of a Q-learning-based client quality selection algorithm for HTTP adaptive video streaming , 2013, ALA 2013.