Deep Learning based Prediction Model for Adaptive Video Streaming

Improving the overall Quality of Experience (QoE) of a client for a given video streaming session is a challenging task in a continuously varying network environment. A dynamic bit-rate adaptation strategy at the client side that can maximize the overall QoE for a session is required irrespective of the bandwidth allocation scheme adopted in-network. Even though there are a plethora of state-of-the-art strategies for adaptive bit-rate streaming, they suffer from a few key shortcomings which may significantly restrict the overall QoE potentially achievable by an end-user. For instance, QoE management using a fixed set of rules may not always guarantee optimal bandwidth utilization, video quality enhancement and accurate buffer estimation, especially in the face of severely varying and often unpredictable bandwidth fluctuations. To handle these issues across a wide range of varying network conditions and QoE parameters, machine learning strategies are being used in recent times. ML approaches train the QoE models based on diverse observations related to network bandwidth, actually received bitrate, segment size, etc, corresponding to video segments received in the past. In this work, we propose a Deep Neural Network based model that selects the appropriate video bit-rates in order to maximize the overall QoE of a user. The overall QoE is obtained as a linear combination of various input parameters such as perceived video quality, buffering time and smoothness of the video session. Experimental results reveal that the proposed architecture improves the average QoE achieved by a client by ≈8.84% when compared against Pensieve, a state-of-the-art ML based approach.

[1]  Anh T. Pham,et al.  Buffer-based bitrate adaptation for adaptive HTTP streaming , 2013, 2013 International Conference on Advanced Technologies for Communications (ATC 2013).

[2]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[3]  Christian Timmerer,et al.  An evaluation of dynamic adaptive streaming over HTTP in vehicular environments , 2012, MoVid '12.

[4]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[5]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[6]  Moncef Gabbouj,et al.  Rate adaptation for adaptive HTTP streaming , 2011, MMSys.

[7]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[8]  Andrea Zanella,et al.  QoE Multi-Stage Machine Learning for Dynamic Video Streaming , 2018, IEEE Transactions on Cognitive Communications and Networking.

[9]  Carsten Griwodz,et al.  Commute path bandwidth traces from 3G networks: analysis and applications , 2013, MMSys.

[10]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[11]  Satish Kumar,et al.  A QoE aware LSTM based bit-rate prediction model for DASH video , 2018, 2018 10th International Conference on Communication Systems & Networks (COMSNETS).

[12]  Christian Timmerer,et al.  Dynamic adaptive streaming over HTTP dataset , 2012, MMSys '12.

[13]  John N. Tsitsiklis,et al.  Actor-Critic Algorithms , 1999, NIPS.

[14]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[15]  Sangwook Kim,et al.  Video quality adaptation scheme for improving QoE in HTTP adaptive streaming , 2016, 2016 International Conference on Information Networking (ICOIN).

[16]  Ming-Syan Chen,et al.  Machine learning based rate adaptation with elastic feature selection for HTTP-based streaming , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[17]  Anh T. Pham,et al.  Adaptive streaming of audiovisual content using MPEG DASH , 2012, IEEE Transactions on Consumer Electronics.

[18]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[19]  Cristian Perra,et al.  A Review of Predictive Quality of Experience Management in Video Streaming Services , 2018, IEEE Transactions on Broadcasting.