Two-phase rate adaptation strategy for improving real-time video QoE in mobile networks

With the popularity of smart handheld devices, mobile streaming video has multiplied the global network traffic in recent years. A huge concern of users' quality of experience (QoE) has made rate adaptation methods very attractive. In this paper, we propose a two-phase rate adaptation strategy to improve users' real-time video QoE. First, to measure and assess video QoE, we provide a continuous QoE prediction engine modeled by RNN recurrent neural network. Different from traditional QoE models which consider the QoE-aware factors separately or incompletely, our RNN-QoE model accounts for three descriptive factors (video quality, rebuffering, and rate change) and reflects the impact of cognitive memory and recency. Besides, the video playing is separated into the initial startup phase and the steady playback phase, and we takes different optimization goals for each phase: the former aims at shortening the startup delay while the latter ameliorates the video quality and the rebufferings. Simulation results have shown that RNN-QoE can follow the subjective QoE quite well, and the proposed strategy can effectively reduce the occurrence of rebufferings caused by the mismatch between the requested video rates and the fluctuated throughput and attains standout performance on real-time QoE compared with classical rate adaption methods.

[1]  F. Richard Yu,et al.  Resource allocation and user association for HTTP adaptive streaming in heterogeneous cellular networks with small cells , 2016, China Communications.

[2]  Qian Liu,et al.  QoE in Video Transmission: A User Experience-Driven Strategy , 2017, IEEE Communications Surveys & Tutorials.

[3]  Yang Geng,et al.  QoE assessment and prediction method for high-definition video stream using image damage accumulation , 2016, China Communications.

[4]  Alan C. Bovik,et al.  A time-varying subjective quality model for mobile streaming videos with stalling events , 2015, SPIE Optical Engineering + Applications.

[5]  Krishna R. Pattipati,et al.  A control theoretic approach to ABR video streaming: A fresh look at PID-based rate adaptation , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[6]  Hao Hu,et al.  Proxy-Based Multi-Stream Scalable Video Adaptation Over Wireless Networks Using Subjective Quality and Rate Models , 2013, IEEE Transactions on Multimedia.

[7]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Yang Li,et al.  The THU multi-view face database for videoconferences and baseline evaluations , 2016, Neurocomputing.

[10]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[11]  R. Johari,et al.  A buffer-based approach to rate adaptation , 2014 .

[12]  Alan C. Bovik,et al.  Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience , 2018, IEEE Transactions on Image Processing.

[13]  Xiaoyan Sun,et al.  Optimal Bit Allocation for CTU Level Rate Control in HEVC , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Gustavo de Veciana,et al.  Modeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations , 2013, IEEE Transactions on Image Processing.

[15]  Yanjiao Chen,et al.  QoE-Aware Dynamic Video Rate Adaptation , 2014, GLOBECOM 2014.

[16]  Wendong Wang,et al.  QoE-Driven Cross-Layer Optimization for Wireless Dynamic Adaptive Streaming of Scalable Videos Over HTTP , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[18]  Jing Wang,et al.  HAS dynamic buffer-driven resource management to enhance QoE in mobile network , 2017, China Communications.

[19]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[20]  Yang Li,et al.  Real-time personalized content catering via viewer sentiment feedback: a QoE perspective , 2015, IEEE Network.

[21]  Nagabhushan Eswara,et al.  A Continuous QoE Evaluation Framework for Video Streaming Over HTTP , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Ning Ge,et al.  Improving low bitrate video coding via computation incorporating a priori information , 2015 .